benchmarkingblog

Benchmarking and Systems Performance

How can I make use of benchmarks in my purchasing decision?

leave a comment »

How can I make use of benchmarks in my purchasing decision?

  • Where is the best beach to snorkel off of in March?
  • If I choose the Rocky Mountains for my one week vacation, will I get altitude sickness?
  • What about Mongolia?
  • Sometimes choosing a vacation spot can be even more fun than the vacation itself. What do you use for input when you’re planning your time away? Weather statistics, websites, travel books, a recommendation from your brother-in-law — all can be great tools.

    An IT purchasing decision can be just as exciting.

    And one important tool to use in that decision should be benchmarks.

    Three types of benchmarks should be considered: industry standard, vendor, and client benchmarks. Industry standard benchmarks such as TPC and SPEC are especially valuable when considering a hardware or software purchasing decision involving such workloads as online transaction processing, business intelligence, Java, web, and high performance computing. Vendor benchmarks such as those from SAP are extremely useful because they could include the exact type of application that matches your solution. And client benchmarks, where you actually run your home grown applications on a vendor’s configuration, can give you a clarity that you just may not be able to get any other way.

    By analyzing the hardware and software used in these benchmarks and comparing them to your own, you can model anticipated workload on a system you are considering. You can compare one result with another. You can study the impact of an upgrade in software, addition of more processor cores, one system vs. a cluster, a change in an operating system, a different database.

    Benchmark data is not going to give you the absolute answer on what to purchase. Performance, of course, is only one factor out of many to consider in a decision. But oh what a factor it is.

    And if you have an opinion on the White Mountains vs. the Rocky Mountains in early June, please let me know.

    ************************************************
    Required Stuff

    SPEC, SPECint, SPECfp, SPECjbb, SPECweb, SPECjAppServer, SPECjEnterprise, SPECjvm, SPECvirt, SPECompM, SPECompL, SPECsfs, SPECpower, SPEC MPI and SPECpower_ssj are trademarks of the Standard Performance Evaluation Corporation (SPEC).

    TPC-C ,TPC-H, and TPC-E are trademarks of the Transaction Performance Processing Council (TPPC).

    SAP, mySAP and other SAP product and service names mentioned herein as well as their respective
    logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries all
    over the world.

    The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

    technorati tags: , , , , ,,,,,

    About these ads

    Written by benchmarkingblog

    March 11, 2011 at 4:08 pm

    Posted in SAP, SPEC, TPC

    Tagged with , , ,

    Leave a Reply

    Fill in your details below or click an icon to log in:

    WordPress.com Logo

    You are commenting using your WordPress.com account. Log Out / Change )

    Twitter picture

    You are commenting using your Twitter account. Log Out / Change )

    Facebook photo

    You are commenting using your Facebook account. Log Out / Change )

    Google+ photo

    You are commenting using your Google+ account. Log Out / Change )

    Connecting to %s

    %d bloggers like this: