Lies, Damn Lies and Benchmarks
|
|
Rickard Oberg dissects the latest Pet Store "benchmarks", Graham Glass weighs in with Glue benchmarks that cream .NET. and Clinton Begin takes on the challenge and is now ready to rock!
Rickard notes "while the J2EE PetStore code goes through some serious hoops to store parts of a category product list in the user session, the .Net code simply caches the entire category product listing in an application-level cache.". Clearly, it took Rickard just a few minutes to spot the obvious and unfair difference between the code bases. You really need to seriously question the objectivity of the report. The simple fact that a beta version of the .NET server was compared to outdated versions of J2EE servers leads one to wonder about the fairness of the benchmarks.
Question now remains, will The Middleware Company (TMC) come clean by telling us the source of the funding for this report? As I write this www.theserverside.com forums seem to be "down for regular maintenance".
The upside in all this is that we may now have a reference implementation from Microsoft to benchmark against. Furthermore, comparison with the J2EE version of Pet Store from TMC, gives you a good idea of how well your implementation will perform against .NET.

