benchmarkingblog

Elisabeth Stahl on Benchmarking and IT Optimization

Archive for the ‘Uncategorized’ Category

What’s In Your Bag?

leave a comment »

With summer just beginning in this part of the world, vacations are on everyone’s mind. And for me, that means hiking.

I actually have a list of everything that should go into my hiking knapsack. It’s written on a scrap of an old envelope and was first used prior to my going up Mount Washington. Here’s what’s on it:

  1. The Electronics: compass, map, phone, headlamp
  2. The Emergency Food: trail mix and granola bars, extra water
  3. The Moleskin: for my big right toe
  4. The Defense: bear spray and pocket knife
  5. The Sweater: my old gray cashmere with the big holes
  6. The Support: my hiking poles
  7. Just In Case: bug net, bandages, extra wool socks, hat, gloves, rain pants and long underwear
  8. If I Get in Trouble: whistle and waterproof matches
  9. The Drug of Choice: Motrin — for my back
  10. May be needed at the end: After Bite and the hot tub

Without these, I’d be lost. Literally. Maybe even worse.

And I was reminded the other day that the same type of preparation I use for my hiking trips is imperative when preparing my laptop bag for a business meeting.

And I realized that in the end I bring pretty much the same stuff.

  1. The Electronics: chargers, pointers, batteries
  2. The Emergency Food: cereal bars and pretzels, in case they don’t feed you
  3. The Moleskin: calendar that is – to schedule the next meeting
  4. The Defense: quick wit and verbal barbs
  5. The Sweater: my nice black cashmere, for when the air conditioning blows
  6. The Support: list of other subject matter experts
  7. Just In Case: the cheat sheet with the latest POWER8 news, the titles of who will be at the meeting, and the fun-to-read magazine because you never know when you are going to have to wait
  8. If I Get in Trouble: AAA or American Express Travel
  9. The Drug of Choice: Motrin — for my head
  10. May be needed at the end: drink in the hot tub

************************************************

The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

technorati tags: , , ,,,,

Written by benchmarkingblog

June 25, 2015 at 4:00 pm

Posted in Uncategorized

Will the Real Benchmark Please Stand Up

leave a comment »

They are at it once again. Those imposter benchmarks.

You know. The ones that initially look and feel like real IT industry performance benchmarks.

But then you read the article again, you look a bit more closely and you realize. They are at it again.

So how can we detect and overcome this benchmark fraud ?

  • Make sure the names of the actual benchmarks are clearly stated. You know, something with letters like TPC, SPEC, SAP, STAC, . . .
  • Make sure the metrics are correct. You know, something like transactions per minute or number of users.
  • Make sure there’s a really good footnote with all the details. Just the data is not enough.
  • Make sure there is a link to the site about the benchmark and preferably the results.
  • Make sure that if you sense an imposter benchmark, find REAL data on the systems you are interested in. At an official benchmark or vendor site.  Or run the real workload as a client benchmark.

If you’re not seeing these things, very likely it is some obscure testing that may or may not have a proper benchmark kit, audited results, etc. And it may very likely be artificially tuned to exploit only certain hardware or software that the imposter is looking to promote.

An industry benchmark masquerader that is actually a tried and true swindler.

************************************************

The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

technorati tags: , , ,,,,,,,,

Written by benchmarkingblog

June 4, 2015 at 6:31 pm

Posted in Uncategorized

Tagged with

Avoid “Jump the Gun” Benchmark Tests

leave a comment »

I was talking with someone the other day and noticed something funny. They were chomping at the bit to do some deep down Java tuning. Let’s make ten changes at once and blow this thing out of the water tuning. What they didn’t yet have was a clue on where they were going and how they would even know if they got there.

Before starting any systems performance testing or benchmarking, here are some of my best practices:

  • First things first, define your benchmark objectives. You need success metrics so you know that you have succeeded. They can be response times, they can be transaction rates, they can be users, they can be anything — as long as they are something.
  • Document your hardware/software architecture. Include device names and specifications for systems, network, storage, applications.
  • Implement just one change variable at a time. (OK, sometimes we can get away with a couple.)
  • Keep a change log — what tests were run, what changes were made, what the results were, what your conclusions were for that specific test.
  • Map your tests to what performance reports you based your conclusions on. Sometimes using codes or special syntax when you name your reports helps.
  • Keep going, don’t give up, you will get there.

Some of this we learned in science class. Some of this is common sense. But you’d be surprised sometimes by how much sense these days is uncommon.

************************************************

The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

2NTTAUNP6FGR
technorati tags: , , , , ,,,,,,,

,,,,,,,,

Written by benchmarkingblog

April 13, 2012 at 11:53 am

Posted in Performance, Uncategorized

Tagged with ,

Big Day, Big Data, Big Announcements

with 2 comments

This past weekend began with a movie late Friday night. Then on to a day at the beach and another day picking blueberries and paddling seven miles in a canoe on the river. It was hot and sunny every minute and all I can think is how blessed to live here and now with the opportunity to have this jam-packed weekend.

Lately, IBM has consolidated announcements into many on the same day — in a jam-packed extravaganza. And we are fortunate to have these announcements today brimming with excitement and new technologies.

When data around the world reaches 35 zettabytes by 2020, that’s big data. You need to efficiently process, analyze and store the massive and growing types and amounts of data you’re collecting. IBM has announced today new solutions that do just this.

The IBM XIV family, with Gen2 and Gen3, is proven, high-end disk storage, designed for growth with unmatched ease of use. New IBM XIV models incorporate serial attached SCSI (SAS) HDDs, increased cache and InfiniBand system internal connectivity. IBM XIV increases performance by up to 4x throughput over the previous generation to boost business intelligence processing as well as speeding up backup and archiving processes. Response time is increased by up to 3x in OLTP, database, and email applications.

And we’re not just talking legacy storage read and write raw performance here — but true application performance using tests in the lab that incorporate such diverse applications as SAS business analytics, Microsoft Exchange mailboxes, and Oracle data warehouses.

See the new ITG paper comparing XIV and EMC. See why tape is the new black. And of course, don’t miss all the awesome announcements including the IBM z114, with up to 18% performance improvement per core and up to 12% more capacity within the same energy footprint as a z10 BC — what a way to consolidate hundreds of distributed servers. And let’s not leave out the Power running Linux new benchmark results.

Jam-packed announcements, jam-packed weekend. Oh and I also made blueberry jam.

************************************************

The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

technorati tags: , , , , ,,,,,,,,,,,,,,

Written by benchmarkingblog

July 12, 2011 at 8:15 am

Posted in Uncategorized, XIV, z114

Tagged with ,

It’s Better on TOP (500)

leave a comment »

Two weeks ago I climbed Old Rag. Old Rag is one of the most awesome mountains in the Shenandoah, only 70 miles from Washington DC and one of the few treeless tops in the park with an incredible 360 degree view. What did I learn from my climb?

  • When it’s 95 degrees, you really do need 2 liters of water per person.
  • Black flies have now migrated from Canada and New England to Virginia.
  • You definitely want to rub your suntan lotion in first, then put on the insect repellent.
  • If you take off your pack first, it’s amazing how much easier you can pull yourself through crevasses.
  • If you’re anything older than 19, you may need some help getting around boulders.
  • A “shelter” in the Shenandoah is not the same thing as a “hut” in the White Mountains. There is no drinking water and they don’t sell cookies.

So you may be thinking — this is a nice way to spend a vacation day? But despite all, there’s just something about being on top.

And today, the TOP500 list of the world’s most powerful supercomputers was released.

  • IBM has the most installed aggregate throughput with over 15,334 out of 58,876 Teraflops (26.0%).
  • IBM has had this lead for 24 lists in a row.
  • IBM has the most energy-efficient system.
  • IBM has the most systems with 213. HP had 154. Oracle had 12.

Oh, and one more thing. Besides the top of the mountain, there’s the beautiful mountain laurel blooming white and pink. And the cold stream you can soak your hot feet and insect bitten legs in at the bottom. And that’s when you really feel that you wouldn’t trade the top of Old Rag for anything. Except maybe another top.

************************************************

Source: http://www.top500.org. Results current as of 6/20/11.

The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

technorati tags: , , , , ,,,,,,,,,,,,,,

 

Written by benchmarkingblog

June 20, 2011 at 12:01 pm

Posted in TOP500, Uncategorized

Tagged with

%d bloggers like this: