Frank Hayes's picture
Frank Hayes

Frankly Blogging

And the winner is...just who you'd expect

I love vendor performance benchmarks. I always have. They're the IT industry's answer to professional wrestling -- the results are always predetermined, but it's still fun to watch the boasting, the posturing and the crowd reaction.

This week it was Microsoft who booked the match, pitting the not-quite-ready Internet Explorer 8 RC 1 against the already-outdated Firefox 3.0.5 and the version-masked Chrome 1.0 in a best-of-25-falls cage match.

The winner, in a shocker: IE 8.

Last month, Apple was the booker and amazingly the Safari 4 beta won the Battle Royale, defeating Chrome, Firefox and IE 7. Last year, when Mozilla did the booking, Firefox beat Safari and IE. When Google booked the matches, Chrome beat everybody in sight.

Look, let's get real: No vendor publishes a benchmark comparison that it's going to lose. When a vendor doesn't like the benchmarks its competitors are using, it comes up with a new one -- which it invariably claims is more meaningful. The vendor picks who to challenge, too. And -- surprise! -- the vendor's product always comes out on top.

Then the winner struts and preens, the crowd cheers or boos, and in the end it all means...well, pretty much nothing.

Testing Web browsers isn't rocket science. You know roughly how your users use them and what your real-world considerations are. Set them up, test them and draw your own conclusions.

As for the vendor benchmarks, just sit back and enjoy the show. And remember, it isn't really rigged if we all know who's going to win.

 

What is Tech Briefcase?
TechBriefcase is a new, free service where IT Professionals can Search, Store and Share IT white papers and content like this. Learn more
Bookmark content
Speed up your research efforts with content across the web.
Search and Store
Find the white papers you need. Create folders for any topic.
View Anywhere
Open your briefcase on your iPhone, tablet or desktop. Share with colleagues.
Don't have an account yet?