benchmarkingblog

Benchmarking and Systems Performance

Archive for the ‘Uncategorized’ Category

Avoid “Jump the Gun” Benchmark Tests

leave a comment »

I was talking with someone the other day and noticed something funny. They were chomping at the bit to do some deep down Java tuning. Let’s make ten changes at once and blow this thing out of the water tuning. What they didn’t yet have was a clue on where they were going and how they would even know if they got there.

Before starting any systems performance testing or benchmarking, here are some of my best practices:

  • First things first, define your benchmark objectives. You need success metrics so you know that you have succeeded. They can be response times, they can be transaction rates, they can be users, they can be anything — as long as they are something.
  • Document your hardware/software architecture. Include device names and specifications for systems, network, storage, applications.
  • Implement just one change variable at a time. (OK, sometimes we can get away with a couple.)
  • Keep a change log — what tests were run, what changes were made, what the results were, what your conclusions were for that specific test.
  • Map your tests to what performance reports you based your conclusions on. Sometimes using codes or special syntax when you name your reports helps.
  • Keep going, don’t give up, you will get there.

Some of this we learned in science class. Some of this is common sense. But you’d be surprised sometimes by how much sense these days is uncommon.

************************************************

The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

2NTTAUNP6FGR
technorati tags: , , , , ,,,,,,,

,,,,,,,,

Written by benchmarkingblog

April 13, 2012 at 11:53 am

Posted in Performance, Uncategorized

Tagged with ,

Big Day, Big Data, Big Announcements

with 2 comments

This past weekend began with a movie late Friday night. Then on to a day at the beach and another day picking blueberries and paddling seven miles in a canoe on the river. It was hot and sunny every minute and all I can think is how blessed to live here and now with the opportunity to have this jam-packed weekend.

Lately, IBM has consolidated announcements into many on the same day — in a jam-packed extravaganza. And we are fortunate to have these announcements today brimming with excitement and new technologies.

When data around the world reaches 35 zettabytes by 2020, that’s big data. You need to efficiently process, analyze and store the massive and growing types and amounts of data you’re collecting. IBM has announced today new solutions that do just this.

The IBM XIV family, with Gen2 and Gen3, is proven, high-end disk storage, designed for growth with unmatched ease of use. New IBM XIV models incorporate serial attached SCSI (SAS) HDDs, increased cache and InfiniBand system internal connectivity. IBM XIV increases performance by up to 4x throughput over the previous generation to boost business intelligence processing as well as speeding up backup and archiving processes. Response time is increased by up to 3x in OLTP, database, and email applications.

And we’re not just talking legacy storage read and write raw performance here — but true application performance using tests in the lab that incorporate such diverse applications as SAS business analytics, Microsoft Exchange mailboxes, and Oracle data warehouses.

See the new ITG paper comparing XIV and EMC. See why tape is the new black. And of course, don’t miss all the awesome announcements including the IBM z114, with up to 18% performance improvement per core and up to 12% more capacity within the same energy footprint as a z10 BC — what a way to consolidate hundreds of distributed servers. And let’s not leave out the Power running Linux new benchmark results.

Jam-packed announcements, jam-packed weekend. Oh and I also made blueberry jam.

************************************************

The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

technorati tags: , , , , ,,,,,,,,,,,,,,

Written by benchmarkingblog

July 12, 2011 at 8:15 am

Posted in Uncategorized, XIV, z114

Tagged with ,

It’s Better on TOP (500)

leave a comment »

Two weeks ago I climbed Old Rag. Old Rag is one of the most awesome mountains in the Shenandoah, only 70 miles from Washington DC and one of the few treeless tops in the park with an incredible 360 degree view. What did I learn from my climb?

  • When it’s 95 degrees, you really do need 2 liters of water per person.
  • Black flies have now migrated from Canada and New England to Virginia.
  • You definitely want to rub your suntan lotion in first, then put on the insect repellent.
  • If you take off your pack first, it’s amazing how much easier you can pull yourself through crevasses.
  • If you’re anything older than 19, you may need some help getting around boulders.
  • A “shelter” in the Shenandoah is not the same thing as a “hut” in the White Mountains. There is no drinking water and they don’t sell cookies.

So you may be thinking — this is a nice way to spend a vacation day? But despite all, there’s just something about being on top.

And today, the TOP500 list of the world’s most powerful supercomputers was released.

  • IBM has the most installed aggregate throughput with over 15,334 out of 58,876 Teraflops (26.0%).
  • IBM has had this lead for 24 lists in a row.
  • IBM has the most energy-efficient system.
  • IBM has the most systems with 213. HP had 154. Oracle had 12.

Oh, and one more thing. Besides the top of the mountain, there’s the beautiful mountain laurel blooming white and pink. And the cold stream you can soak your hot feet and insect bitten legs in at the bottom. And that’s when you really feel that you wouldn’t trade the top of Old Rag for anything. Except maybe another top.

************************************************

Source: http://www.top500.org. Results current as of 6/20/11.

The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

technorati tags: , , , , ,,,,,,,,,,,,,,

 

Written by benchmarkingblog

June 20, 2011 at 12:01 pm

Posted in TOP500, Uncategorized

Tagged with

%d bloggers like this: