Acid3 test results for IE8 and its competitors
Posted 14 April 2009 by Russ in Other stuff. Tags: browsers, Web Standards.
Microsoft’s IE8 has launched and purports to be a great leap forward from version 7. But how does it fair against it’s competitors in the Acid3 standards test devised by the Web Standards Project?
To quote The Web Standards Project, Acid3 is the third in a series of test pages written to help browser vendors ensure proper support for web standards in their products. Acid3 is primarily testing specifications for “Web 2.0″ dynamic Web applications. Also there
are some visual rendering tests, including webfonts.
The term ‘Web 2.0′ has been around for a few years, but I think it’s fair to say that browser vendors have been struggling with the gauntlet of standards compliance thrown down by the web development industry. So Acid3 – launched in October 2008 – is going to be a bar that in fairness, is going to be too high for most current browsers to pass. With IE8 now launched however, it’s not a bad time to stop and see how it fairs against its competitors in the latest Acid3 test.
The Acid3 test reference
The Acid3 test performs a number tests using JavaScript to try and provide some kind of indication of the level of support for a whole host of functions, including support for CSS2.1 and CSS3 specifications, DOM2, data handling and SVG support and you can find a full list of test details here.
I’m not going into detail about the test results here, I’m merely showing how the automated tests for each browser stack up. I’m also not testing on a multitude of platforms – just Mac OSX (Leopard 10.5.6) and Windows XP. As Lars Gunther explains, simply achieving 100 out of 100 is not a pass as such as there are other, less absolute measures of success, so treat this as an early indication of how the big vendors are fairing.
Ready then? OK let’s go. For a browser to pass the Acid3 test, they should render the test exactly as per the reference image below* – pixel perfect – with the browser’s default settings. The rendering progress should also be smooth, which perhaps is a little subjective but the X/100 is the basic benchmark we’ll be looking at for these tests.

* This is scaled down slightly so the test fits the width of this page’s content column but the results are still accurate.
Microsoft Internet Explorer
With version 6, 7 and now 8 taking the lion’s share of the browser market, you might hope that the latest version of IE scores well, especially as the IE developers succeeded in passing the Acid2 test in December 2007, but sadly it’s not looking too good for Acid3.
IE version 8
The test below is from version 8.0, build 6001.18702 on Windows XP and the summary score is 20/100. (This isn’t running compatibility mode – in that mode the test returns 12/100, which is the same as the IE7 test below.)

IE version 7
The test below is from version 7.0, build 5730.13 on Windows XP and the summary score is the same as version 8: 12/100.

IE version 6
The test below is from version 6.0, build 9200.5512 on Windows XP and the summary score is the same as versions 7 and 8: 12/100.

Mozilla Firefox
Firefox has steadily eroded Microsoft’s monopoly of the browser market and has already arrived at version 3. As IE comes pre-installed in Windows and Firefox is something you need to know about, download and install yourself, it’s probably fair to say that Firefox users tend to be early adopters and more tech-savvy than your average IE user. At the Arcadia Group we are seeing Firefox 3 users accounting for around 15% of visits (as of 3 April 2009), and Firefox 2 is around 1%, so legacy versions of Firefox seem less prevalent than IE, I guess partly because these users are more tech-savvy but probably more due to the way Firefox alerts you when a new version is available to download. So for this basic summary, I’m only showing Firefox 3.
Firefox 3
The test below is from version 3.0.8 on Mac OSX 10.5.6 (Leaopard) and shows a summary score 71/100.

Apple Safari
There are two tests here – the current version 3.2 (both Mac OS and Windows XP), and the public beta of version 4 that’s available from the Apple site. The public beta is included because a benchmark score of 100/100 is achieved.
Safari 3.2
The test below is from version 3.2.1, build 5525.27.1 on Mac OSX 10.5.6 (Leopard) and shows a summary score 74/100.

The test below is from version 3.2.2, build 525.28.1 on Windows XP and shows the same summary score as 3.2.1 on Mac OSX: 74/100.

Safari 4 (beta)
The test below is from the public beta of version 4, build 525.16 on Windows XP and shows a summary score of 100/100.

Opera
Although Opera has been around longer than Firefox and is already at version 9, it hasn’t eroded Microsoft’s market share as much as
Firefox. However it’s popular with some users who appreciate some of its features and its scores show that it’s keen to tick the standards boxes that Microsoft have failed to achieve.
Opera 9.6
The test below is from version 9.64, build 10487 on Windows XP and shows a summary score of 85/100.

Opera 10 (alpha)
The test below is from version 10, build 1129 on Windows XP and shows a summary score of 100/100.

Google Chrome
When Google Chrome launched many of us expected Chrome to become big pretty quickly but as of 3 April 2009, we’re seeing less than 1% of visitors on Chrome over at the Arcadia Group.
Google Chrome 1.0
The test below is from version 1, build 154.53 on Windows XP and shows a summary score of 78/100.

So why do we care?
I’ve worked with younger developers who haven’t had much exposure to legacy browsers and stories of working with Netscape 4.01, 4.7 and IE 4 and 5 pretty much fall on deaf ears for those guys. But for those of us who have worked with these early browsers, standards can only be a good thing.
With the advent of Firefox, Safari and Chrome and the continuing efforts of Opera, Microsoft has had no choice but to sit up and take notice of the calls to improve their browser product and although the tests above appear poor, the level of standards built into IE8 is far better than IE6. Will IE ever be at the bleeding edge of support for technology like CSS3 and HTML5? Probably not, but with the majority of market share, most of us need to develop our sites to work with the lower standards compatibility of IE, so seeing any improvements to these scores can only be a good thing.
And who knows, in a rapidly changing environment (Apple recently announcing that Safari has achieved a full pass that extends beyond the automated test), maybe we’ll start to see more pressure applied on Microsoft from businesses striving to deliver the best sites without having to conditionally code for browsers that aren’t up to the job.


Crossbrowser » Internet Explorer: Always One Step Behind
22. Jun, 2009
[...] Yep, IE8 is better at supporting something that exists since 2005. While good support for CSS 2.1 is a very good point, IE8 just can’t follow the rest of the pack. That’s right, IE8 scores far less on the Acid 3 test than the other browsers. [...]
Deeply Intertwingled | Noah Read
09. Jul, 2009
[...] things further browser incompatibilities further gum up the web development process, thanks to Microsoft’s refusal to apply widely accepted web standards into its browsers, and perpetuate competing file formats in images, video and more. In short, the process of [...]
Siôn
19. Aug, 2009
Safari 4.0.3 is 100/100 ACID 3.0 compliant