Come on Oracle, Get “With It” Benchmarking
I admit that many weekends this time of year you will find me (when I’m not enslaved by the leaf blower) curled up with a good old book on the old couch with my thankfully not so old dog.
But this weekend I truly was “with it.”
On Saturday night I attended one of the most sought-after sold out concert events ever to hit this town. I got to see a Pink concert that included not only 17 of her best songs but Pink flying through the air doing acrobatics that you simply would not believe. A rock concert rolled right into the circus, truly amazing.
And then to top it all off, on Sunday night I attended one of the most sought-after sold out movie events of the year. I got to see the latest Hunger Games, Catching Fire, second in this awesome trilogy which could be even more popular than the first.
So on Monday when I saw the latest Oracle SPARC T5-4 benchmark result on the TPC-H decision support benchmark (1), all I could think was how so “not with it.”
Like Gangnam Style this year. Or What Does the Fox Say this month.
Hey, I’m the first one to like legacy. My closet is filled with vintage looks. I love retro — just not when it comes to benchmarks.
Here is what you need to know.
- First of all, this is TPC-H. Yawn. We’re ready for something new here.
- Most of the TPC-H results are grayed out in this category, considered “historic.” This result is right next to a result from IBM — from 2007 (yes you heard that right).
- Total Storage to Database Size ratio is a massive 60.80. Talk about overkill on storage to achieve performance. This number is many many times the ratio we’ve seen from other results.
- Load time is a whopping 9.63 hours.
- 128 query streams are needed. Most results use many, many fewer. That’s because TPC-H has a limited number of query variations; so when you run a lot of streams, you have a high probability that the same queries will be requested more than once. Oracle is greatly increasing the probability that they will have the results of the queries stored in their cache — which may not be representative of how their product would perform in a truly ad hoc query environment.
- Oracle once again included extremely minimal support in their pricing. Does $2300 a year sound like what you are paying for software support?
(1) Oracle TPC-H of 377,594 QphH@10000GB,$4.65 per QphH,Availability 11/25/13,Oracle Database 11g R2 Enterprise Edition w/Partitioning,SPARC T5 3.6 GHz; Total # of Processors: 4,Total # of Cores: 64,Total # of Threads: 512.
Source: http://www.tpc.org. Results current as of 11/25/13.
TPC-C ,TPC-H, and TPC-E are trademarks of the Transaction Performance Processing Council (TPPC).
The postings on this site solely reflect the personal views of the author and do not necessarily represent the views, positions, strategies or opinions of IBM or IBM management.