Elisabeth Stahl on Benchmarking and IT Optimization

When You Wish Upon a Star – A New Performance Website !

leave a comment »

When I was in college, one of my favorite places to go (to get away from my theoretical math classes) was the city art museum. I would leave my dorm really early in the morning — it must have actually been about 11AM — walk over the bridge, through many deserted city blocks and then over to the museum, grabbing a hot pretzel along the way. The journey seemed to take forever, much of it through an urban wasteland.

One of my dreams during this time involved a shortcut of sorts. In this dream, I would leave campus, cross the bridge and immediately take a short stroll along the river over to the museum. And it certainly was a dream – as the area where this supposed trail would be consisted of old train tracks, trash, brush, debris, waste, refuse, rubbish, litter, scrap, flotsam and jetsam, rubble and detritus.

Many years later, I returned to my alma mater. And found myself crossing the bridge once again to go to my favorite museum. But this time as I approached the end of the bridge I suddenly saw a stairway the went down to the river. And I took it. And lo and behold, there it was — the path of my dreams, a bike and hike paved trail that followed along the river, directly to my beloved art museum.

These amazing things don’t happen very often but when they do you can’t really believe it. And that’s what I’ve been thinking about a new awesome website from IBM.

For many years, as some of you know, I worked on industry standard benchmarks, writing articles about IBM and other results and highlighting comparisons. First it was in a newsletter, then an internal company website, then this blog — but I always dreamed that there would be a one-stop shop for everyone to go to see all the new and exciting benchmark results. And now we have it.

You can now find detailed IBM Power Systems performance data proof points. This brand new website contains test results for several different IT area workloads:

• Big Data and Analytics:  Showing faster time-to-value of big data. Discover how hadoop innovation can deliver faster, more affordable business insights
• Technical Computing:  See how IBM Power Systems solutions deliver faster time to insight and offer accelerated performance for demanding HPC workloads
• Cloud:  Find how to run swiftly and smoothly on a high performing global infrastructure. Deploy global cloud infrastructures rapidly on virtual servers
• Virtualization:  See how new virtualization technology makes deploying applications easier
• Online Transactional Processing and Enterprise Resource Planning:  IBM and SAP industry-leading performance across multiple workloads.


Sometimes dreams do come true.


The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

technorati tags: , , ,,,,,,,,


Written by benchmarkingblog

August 3, 2016 at 4:36 pm

Posted in Performance

Tagged with

Blockchain on my Mind

leave a comment »

It’s really hard to believe but I actually used to go hiking in jeans. That’s right, blue jeans. 100% cotton blue jeans.

Long before “cotton kills” became the mantra of the North Face set, everyone hiked in jeans. For years — mostly in the beautiful sunny summer, south of the Mason-Dixon line — it was actually just fine.

Until one day I got caught in a giant frigid rainstorm on Cannon Mountain in the White Mountains in New Hampshire. I quickly became soaked with icy water, my jeans drenched and hanging heavy. I’ll never forget getting off that mountain, jeans glued to my chilled skin. And then stripping down in the mountain parking lot, spreading everything on top of the car to dry out in the warm sun that had suddenly appeared.

A few years later I discovered these new zip-off hiking pants that could get wet and then dry almost instantly. This technology became a game changer for me. Suddenly, I achieved a decrease in unpleasant hiking time, a reduced risk from illness, and lower costs by avoiding a bad day on the mountain.

Blockchain, the distributed ledger that is everywhere in the news, is similar. Like with the zip-offs, some of us may be early adopters, some of us may have not even heard of it yet. But it’s a groundbreaking technology that is changing business at a breakneck speed.

Blockchain is a technology for applications that establishes trust, accountability and transparency while streamlining business processes. Approvals for items like letters of credit, invoices, mortgage verifications, clearings, and money transfers can now be done right away — and not take days to weeks to even months.

And don’t think that blockchain is just for the financial industry. The ledgers and smart contracts have great value cross-industry including supply chain, healthcare, government, retail. I’ve seen it work for shipping companies. I’ve seen an excellent use case for insurance companies.  I’ve seen it replace lawyers.

IBM is part of the Hyperledger Project, a collaborative effort created to advance blockchain technology by identifying and addressing important features for a cross-industry open standard for distributed ledgers that can transform the way business transactions are conducted globally.

IBM can help with understanding which of your applications will benefit from blockchain and how to get started. Some sure indicators that a workload could benefit from blockchain include managing contractual relationships between more than two parties, complex business logic, and looking to reduce cost.

Using high end systems such as IBM z and Power systems for blockchain implementations is key. Blockchain can be deployed on these systems or connect to these systems to take advantage of the fast processors, memory, cache, hardware accelerators and cryptography, security and integration. The GoLang APIs, the RocksDB database, and the security and consensus algorithms, all on which blockchain relies, can really benefit from these features.

(In fact, lately I’ve been finding it hard to stop thinking about blockchain. True story: Late last night I was innocently reading a book on the couch about Rosemary Kennedy while someone in my family was fixing our kitchen door. And suddenly he started talking about the block plane he was using . . .)

Blockchain addresses 3 of the most important things in the world: Time, Cost, and Risk. So pick a project and get started. Like zip-offs, the world will never be the same.


The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

technorati tags: , , ,,,,,,,,,


Written by benchmarkingblog

May 24, 2016 at 12:08 pm

Posted in Blockchain, Uncategorized

Tagged with

Oracle Meets That ’70s Show

leave a comment »

Last week I made the annual spring break pilgrimage to my childhood home in the shadows of the cherry blossoms.

What always strikes me when I visit — and you’ve probably had the same experience — is how nothing, almost nothing, has changed since I lived there four decades ago. Yes, there’s a huge TV with cable now. And a cell phone, though not so smart yet. And an iPad that always needs something done to it. But other than these few new features, the general layout and beauty of the interior is essentially the same.

Which I love. Why get new kitchen cabinets when you can take the beautiful solid wood ones and have them refinished? Why buy new cheap chairs when 50’s Danish Modern is built so well and gorgeous to boot?

But one of the best examples of this retro environment, hands down, has to be the downstairs bathroom. When entering you are transported to the time of Nixon and Sonny and Cher. The colors are tremendous – bright bright yellows and oranges. Big plaid wallpaper. And wicker accessories. A 70’s dream of a bathroom. And you know what — it still looks great. The glamour of everything from the 70’s has returned in full force in this one tiny room.

But some things are not meant to come back. And that includes the way some vendors compare systems and benchmarks.

I recently saw a comparison from Oracle comparing the SPARC T7-1 vs. the IBM Power System S824. It brought me right back to when I started blogging almost ten years ago, when we were all inundated with benchmark flaws. Let’s take a look at some of the details :

  • The tool Oracle used to compare the systems is NOT an industry standard benchmark audited by a third party. It is a tool that can be used by anyone. Oracle ran all tests themselves.
  • The tool used is adapted from the TPC-C benchmark, which Oracle themselves has stated in the past that they feel is dated.
  • The disks used in the systems compared are not the same – HDD vs. SAS.
  • The logs and database files for the IBM test were not run on the IBM system – they were run on a different Oracle system.
  • Solaris 11.3 was used for the logs and database file systems on the Oracle side; Solaris 11.2 was used for the IBM configuration.


A photo of my childhood downstairs bathroom was Instagrammed recently. It received 35 likes, over half of them from students at the best design school in the country. That makes sense. Oracle’s benchmark comparisons don’t.



Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.
TPC-C ,TPC-H, and TPC-E are trademarks of the Transaction Performance Processing Council (TPPC).

The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

technorati tags: , , ,,,,,,,,,,,,,

Written by benchmarkingblog

March 23, 2016 at 10:07 am

Posted in Oracle, POWER8, SPARC

Tagged with , ,

Embracing the Cognitive World Every Day with IBM Systems

leave a comment »

Read the full article here

OK, so it was time. I didn’t have an excuse anymore. That I had a report due at work, or that the holidays were coming, or that I had to go to the dentist.

It was finally time to do something that I had avoided for almost a year. Something that was even worse, if you can believe it, than preparing my taxes. It was time to make the dreaded updates to my insurance policy.

These were not the sort of quick changes that I could easily do online or rapidly with a phone call. These were excruciatingly detailed updates to all of my policies–home, auto and personal. They came with multiple liabilities, multiple schedules and multiple riders. I would need to block out many hours of the day for this one. And suffer the nightmare involved in these complex negotiations with my insurance agent to hedge against the risk of an ugly, contingent, uncertain loss.

As it turned out, my foray into policy updates ended up taking weeks, not hours. The complexity of the millions of arcane rules around these types of policies is mind-boggling. Are you living in the state of Ohio with 3 1/2 baths? How many boats do you own? Gosh forbid you have any male teenage drivers. Or a dog.

But this very situation is actually a typical everyday situation where cognitive computing can really shine . . .


The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

technorati tags: , , ,,,,


Written by benchmarkingblog

March 2, 2016 at 11:06 am

Posted in Cognitive, Watson

Tagged with ,

#CMG2015: Performance Paradise

leave a comment »

Do you work in Systems Performance, IT Benchmarking, or Capacity Planning ? Then (if you are not already) you definitely need to be a part of Computer Measurement Group !

Computer Measurement Group (CMG) is a not-for-profit, worldwide organization of IT professionals committed to sharing information and best practices focused on ensuring the efficiency and scalability of IT service delivery to the enterprise through measurement, quantitative analysis and forecasting.

For decades CMG has been a leading organization for the exchange of information among enterprise computing professionals. Anyone charged with the measurement and management of computer systems would benefit from membership in CMG.

We recently held our annual international technical conference in San Antonio, home of the Alamo and the amazing River Walk.

Where else can you enjoy multiple days learning from and sharing with a few hundred of the best performance and capacity people in the world ? !!!

We had a great mix of topics at this conference (Full Disclosure: I am the Program Chair of this conference) across many focus areas including Performance Engineering, Application Performance Management, Mobile and Web Performance, Mainframe Performance and Capacity Planning, Network Capacity and Performance, Storage, and much more.

Here’s just a small sample of some of the awesome presentations:

  • I Feel the Need for Speed
  • Managing the Datacenter as the Computer
  • Tackling Big Data
  • Performance Considerations for Public Cloud
  • Why is this Web App Running Slowly?

I was a speaker on two exciting panels. The first was on Hybrid Cloud. I discussed how the Fit for Purpose methodology can work when deciding on the right environmental mix of on-premise, off-premise, private, public cloud. Namely, the Best Execution Venue. The second panel was on advancing your career in the Performance area, where I had a few good stories to tell.

The key to this conference and to this group as a whole is the laser-like focus on all of the groundbreaking, state-of-the-art areas in IT — but with an extreme emphasis on how they relate to Performance and Capacity.

So we talked Cloud. But Cloud with Performance. We talked Analytics. But Analytics with Performance. We talked Testing. But Testing with Performance . . .

All of the learning is wonderful. But I would have to say, as we tend to say about all events, that the networking and sharing is the absolute best part. What a Wonderful World of a conference.

And CMG is not just an annual conference. It’s an organization that you can be part of year-round through webinars, papers, articles, journals, regional groups and even social media.

Working on this conference was like planning a wedding. They can only go off without a hitch with an outstanding team to make it happen. Now the honeymoon begins. Until next month when we start it all over again for #CMG2016 !


The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

technorati tags: , , ,,,




Written by benchmarkingblog

November 10, 2015 at 3:23 pm

Posted in CMG

Tagged with

Back in Time with Oracle

with one comment

Some of you may know that this week was a very big one for “Back to the Future” movie fans. On Wednesday, Oct. 21, 2015, at 4:29 p.m., our today caught up to the tomorrow depicted in “Back to the Future, Part II.” In that 1989 film, a DeLorean time machine appears from 30 years in the past.

To those who love time travel, this is a really big deal. Some towns even went so far as to rename themselves to the featured city in the film. Ceremonies worldwide were performed at exactly 4:29PM.

And this reminded me of a benchmark result that was just published today by Oracle on the SAP SD benchmark.

As we move into newer digital workloads, some of the older industry benchmarks have gone by the wayside. Many of us have spent a lot of time analyzing these newer workloads and developing new metrics for them. But one classic benchmark is still extremely appropriate for many of today’s applications – and that is the suite of SAP benchmarks.

But this new Oracle result just published is clearly dated — even though it is a brand new result on a brand new Oracle SPARC system. The IBM Power Systems result with DB2 from over 1 year ago is over 2X better performance per core than this new Oracle SPARC result. (1)

What’s really exciting, unlike this new benchmark result, is that many of the predictions of the future in the “Back to the Future” movie were right on. But I am still waiting for the dog-walking drone.


The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

(1)IBM Power Enterprise System E870 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 8 processors / 80 cores / 640 threads, POWER8; 4.19GHz, 2048 GB memory, 79,750 SD benchmark users, running AIX® 7.1 and DB2® 10.5, dialog response: 0.97 seconds, order line items/hour: 8,722,000, dialog steps/hour: 26,166,000, SAPS: 436,100, Database response time (dialog/update): 0.013 sec / 0.026 sec, CPU utilization: 99%, Cert #2014034 vs. Oracle SPARC T7-2 result of 30,800 users, Average dialog response time: 0.96 seconds, Fully processed order line items/hour: 3,372,000, Dialog steps/hour: 10,116,000, SAPS: 168,600, Average database request time (dialog/update):0.022 sec / 0.047 sec, CPU utilization of central server:98%, Operating system, central server: Solaris 11, RDBMS: Oracle 12c, SAP Business Suite software:SAP enhancement package 5 for SAP ERP 6.0, Certification number: #2015050, SPARC T7-2, 2 processors / 64 cores / 512 threads,SPARC M7 4.133 GHz, 16 KB (D) and 16 KB (I) L1 cache per core, 256 KB (D) L2 cache per 2 cores and 256KB (I) per 4 cores, 64 MB L3 cache per processor, 1024 GB main memory

SAP and all SAP logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries. All other product and service names mentioned are the trademarks of their respective companies.

technorati tags: , , ,,,,,,,,,,,

Written by benchmarkingblog

October 23, 2015 at 12:59 pm

Posted in Oracle, SAP

Tagged with , , , , , ,

Amazon, Don’t Be A Performance Amateur

leave a comment »

I read just this morning that La Guardia airport in New York, with its dilapidated terminals and long delays, will be at long last rebuilt by 2021.

The plans look promising and work has already started. With new taxiways, a train and a grand entryway, it will finally be something to be proud of. Major infrastructure certainly needed for one of the major big league cities in the world.

And to play in the big league, you need to have the right plans to study and analyze, and you need to know what you are talking about. Which is why I was so disappointed this morning to also read about some new performance claims from Amazon Web Services (AWS).

In an announcement of a new relational database offering, Amazon made claims that simply had me confused. Let’s take a look:

  • The claims mix up performance with price performance. Obviously this difference is pretty basic. And important — but especially important in this environment where AWS charges extra for database instances, storage, and I/O.
  • The claims mix up speed and throughput. This difference can be very important because in this environment there are only 3 AWS regions right now offering these services and network performance can be key.
  • The claims mix up general comparisons with other “existing solutions” with a comparison using one particular tool, SysBench, to one particular release of one particular database, MySQL 5.6.
  • The claims mix up whether any improvement is due to software or hardware while stating that special techniques were used on both. Need I say more.

To play in the big league majors you have the understand the complexities of the subject. By attempting to address performance of this new offering, AWS is clearly exhibiting minor stripes.

Have you ever been at that gate at La Guardia, I think it’s A1A, where you have to carry your suitcase down two flights of stairs to a small waiting room with no air?


The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.

Amazon Web Services and the “Powered by Amazon Web Services” logo are trademarks of, Inc. or its affiliates in the United States and/or other countries.

technorati tags: , , ,,,,,,,,,


Written by benchmarkingblog

July 28, 2015 at 11:41 am

Posted in Amazon, Cloud

Tagged with ,

%d bloggers like this: