Halo

Halo represents both a curse and a blessing among possible titles to benchmark. As one of the first FPSs to make good use of SM 2.0 and a very popular title on both the PC and Xbox, it's an important title to use to see what ATI could do with the newest feature of the 9700 Pro; but at the same time, it was still a console port that was in many ways mediocre. While we would have liked to test Gearbox's "Custom Edition" that implements properly optimized shaders, the lack of single player support in that version has limited us to the less optimized original version of the game. The lack of AA support has also limited us to only benchmarking Halo without any advanced features turned on.

Halo

First of all, the 0 next to the Catalyst 3.00 drivers is not a typo; with the 3.00 drivers, Halo suffers from a massive stuttering problem that caused the time demo to play at unequal speeds and otherwise returned senseless benchmark results, and was excluded as a result. Beginning with the 3.04 drivers then, we see Halo receive a significant performance boost late in to the life of the 9700 Pro, rather than in the beginning where we'd expect it. ATI has attributed this to z-buffer optimizations in their driver for dealing with this game; this optimization was good for a nearly a whopping 25% improvement in performance, and it's a shame that ATI didn't do this earlier. Otherwise, we see a drop off between the 3.04 and 3.06 drivers, and then a slow increase of 10% through the 5.05 drivers; the drop off is not significant at less than 11%, but it's still noteworthy that the game actually got a bit slower before its release around the time of the 3.06 drivers.



Catalyst 4.02 versus 3.09 (mouse over to see 3.09)

Looking at the screenshots, there is a very noticeable IQ difference, but not one that correlates between any of the performance changes. The above is a comparison between the Catalyst 3.09 drivers and the 4.02 drivers, with a focus on the flashlight. With the 3.09 drivers, the light has a very noticeable hard edge, while this becomes a soft edge under the 4.02 drivers. This is something that we mentioned previously in our Fall 2003 IQ Analysis, where with the 3.09 drivers, our 9800 Pro was doing hard edges while NVIDIA's 5900 was doing the proper and more complex soft edges. ATI fixed this problem after the 3.09 drivers - the flashlight was working correctly without a performance hit. While we'll never know if it was a bug or an intentional way to improve frame rates (as ATI never mentioned this in any of their release notes), it's good to know that they could get it right without a performance hit.

As all the other pre-3.09 shots are indistinguishable from our 3.09 shot, and all post-4.02 shots are just like our 4.02 shot, there appears to be no other IQ change other than the flashlight fix. Overall, Halo stands apart as a game that received a constant (if small) improvement in performance, and the second game to receive an IQ-related fix.

Warcraft 3: The Frozen Throne 3dMark 2003
Comments Locked

58 Comments

View All Comments

  • ksherman - Friday, December 16, 2005 - link

    Any chance for a nVidia comparison? Ive ehear that some older drivers were better...
  • semiconductorslave - Tuesday, December 13, 2005 - link

    Great, I'll tell the person that bought my videocard three cards ago! Maybe next we could see an article about how adding 3 extra 16k memory cards to the Atari 800 improves games.
  • HWAddict77 - Tuesday, December 13, 2005 - link

    [lecture]
    Guess what? There is real value in the fact that the people writing these articles actually interact with us to find out what we think. In publishing, web-based or otherwise, that's rare and valuable, and it puts us in a pretty cool position if you ask me. So I think being a smartass is particularly lame. It's not like there are only 20 people reading the articles. Hell, it's not like there are only 1000 people reading them.
    [/lecture]

    My .02: I would also like to see a similar article with an Nvidia card.
  • semiconductorslave - Wednesday, December 14, 2005 - link

    So your saying we can't use sarcasim to voice our opinions? I totally appreciate this site and all of the reviews, and hope the editors can handle a little bit of facetiousness every now and then. It is my attempt at humor and way of saying that I think this article, being more of a research piece into the history of driver support on an older card, is more academic and not very pragmatic. I'm not saying the author made the following assumtion, but it would be a logical fallacy for a person to assume the future will happen like the past. ATI could have better driver releases in the future, put more resources into it, hire more talented programers, also the hardware is always changing, like dual core CPUs and ring bus memory architectures on graphics cards. So I personaly don't think how the drivers perform on the old 9700pro make much difference to anyone but a person running the old 9700pro. This in turn will limit what games they can run since the newer games take a bit more power, especially with AA enabled, AS filtering, and HDR, so now--once again in my opinion--the article is most helpful to the person running old games on an old card.
    Still I read it.
  • jeffrey - Monday, December 12, 2005 - link

    Ryan Smith,

    Thank you for publishing this article! The whole idea of the article itself is what makes me so happy. It was not another "product release -> generate review" type article. This article stepped-out of that mold and required thinking of an idea and then testing to find the result. Kudos!

    What made the article an A+ was that the results were not there. To clarify, I should say expected results. ATI has been promising increase after increase, but after several generations, there just was not a whole lot there.

    ATI has impressed with monthly driver releases, but performance gains are limited. I am NOT disapointed with the results. ATI's claims for driver improvements are rarely across the board. More often than not, the claim of a gain is focused on a particular generation, segment, or resolution.

    One important fact that was left out of the review was compatibility. A central focus of each Catalyst release is fixing bugs to make the drivers more stable. The commitment from the Catalyst crew to providing incremental optimizations has mainly been secondary this year to resolving driver issues. The graphs might show an image that looks like not a whole lot has been done. However, if you included a total of bug fixes from Catalyst 3.0 to 5.12 the image of that graph would be impressive indeed.

    ATI's monthly Catalyst updates have been invaluable to their reputation as a provider of graphics solutions. How many companies have checked-in and checked-out within a couple of years due to drivers never "maturing". ATI has a positive image today in regards to drivers and that alone is a barrier to entry for new competition.

    I could go on and on, but if by chance you get down to my post please feel free to pat yourself on the back and share this with Anand.

    Thanks again,
    Jeffrey
  • timmiser - Tuesday, December 13, 2005 - link

    I agree. This article was definitely outside the mold and nothing like this had been done before. (To see driver improvements over years instead of months.)

  • Nighteye2 - Monday, December 12, 2005 - link

    Nice article. Now I want to see the same test for Nvidia drivers :)
  • MrJim - Monday, December 12, 2005 - link

    Mr Ryan Smith>It would be nice to see a flightsim or a racing sim! Maybe a newer one with impressive graphics like Lock-On/Lo-Mac(Flightsim) for example. Interesting article!
  • ShadowVlican - Monday, December 12, 2005 - link

    now to anyone that still says ATi has bad drivers... i will refer them to this review (6)
  • bldckstark - Monday, December 12, 2005 - link

    I don't see where this proves they have GOOD drivers either. They had on average some minor improvements in FPS and fixed some IQ issues. Yes there were some nuggets of enlightenment, but overall the greatest increase was in eventually eliminating a huge IQ flaw in soft lighting.

Log in

Don't have an account? Sign up now