The jetlag has kicked in and I’m sat in my hotel room in Santa Clara wide awake at 4am so I figured I might as well do some more performance testing!
I wanted to do a quick “proof of concept” test of a larger study I want to do comparing different web performance timing methods but for now I wanted to compare Webpagetest (a browser plugin) with Atomic Lab’s Pion (promiscuous-mode network level).
I have a aiCache test environment running on EC2 testing acceleration of aicache.applicationperformance.com so I thought I would use that for my tests. I used Webpagetest.org Canadian IE8 node to test (just a random choice as I was testing some other stuff at the time).
I tested the URL 5x (first view only) and the results were very interesting.
Pion’s network level timings were within 300 – 500ms of the Webpagetest.org timings, which is impressive given that Pion can measure EVERY visit to your website, not just be used a manual test tool a la WPT.
To be fair, there are a number of caveats here – the test page is fairly straightforward HTML without any fancy onLoad AJAX requests etc but as a proof of concept I am happy with that
|Document Complete||Fully Loaded||Pion Timing|
|Test Number||Time||Requests||Time||Requests||Requests||Time||Difference (seconds)|
This shows the raw data in Pion (using Pion’s Monitor Events view)