Daylight: Main Camera HDR

We talked a lot about the optics and the different auxiliary sensors on the various phones, but kept the comments limited in regards to the main sensor as well as the general image processing characteristics of the various phones, so let’s go dive in a little more depth in that regard. In general, most of the phones’ main camera sensors should be quite competent nowadays as it’s the one module that usually doesn’t get to suffer from design compromises. Nevertheless, there are clearly some phones which offer quite superior hardware, such as the Mi 11 Ultra’s relatively giant 1/1.12” sensor – with the compromise here coming in the device’s huge camera bump instead.

Image processing is also extremely important even on such large sensors; while some phones have larger pixels, it’s still nowhere near large enough for the sensors to have a sufficient pixel full well capacity to enable the natural dynamic range information extraction in well lit scenarios while still maintaining detailed highlights as well as shadows. Most sensors still only have 10-bit ADCs and we’re only now seeing some newer 12-bit models, while almost all dedicated cameras out there 14-bit is the standard and new sensor generations in the coming years now feature 16-bit depth. The solution to this is to use multi-frame HDR processing, where the phone cameras will capture multiple successive images and merge them together to get to a higher dynamic range image. This year, we’ve seen the introduction of staggered HDR sensors which help out enabling this feature in a faster manner with less movement ghosting, the HM3 sensor on the S21 Ultra or the GN2 on the Mi 11 Ultra feature this new advancement.

Click for full image
[ X-T30 ( ) ]
[ S21U(S) ] [ S21U(E) ] [ Mi 11 Ultra ] [ Axon 30 Ultra ]
[ OnePlus 9 Pro ] [ Mi 11 ] [ S21(E) ] [ iPhone 12 Pro ] [ Pixel 5 ]

Starting off with this bike scene, it’s pretty obvious what the intended subject is meant to be, however the metering of most smartphones will still want to balance out the extremely bright highlight in the background sky, which in turn means the HDR processing will have a harder time in trying to recover shadows in the foreground even though it’s not a dark scene at all, which is in general why the look on the phones is quite different than what I captured on the X-T30 – the colour temperature was also quite off on all the phones.

The S21 Ultras pictures is a good example of the metering, the Exynos preferred to go brighter with the HDR and retain a bit more detail in the background highlight, while the Snapdragon preferred to go for more detailed shadows on the main subject. In terms of details, it seems this scene went the opposite of what we saw until now, and it’s the Snapdragon which employs a visible structure enhancement throughout the scene, giving it a bit more of an artificial look. The regular S21 doesn’t look very different to the S21 Ultra at all – if anything I prefer the S21’s slightly better colours, and I do see some improved shadow detail.

The Mi 11 Ultra excels in dynamic range here, showcasing much better shadows whilst also having more highlights maintained in the background compared to the S21 Ultra. The detail structure is also more natural without any heavy processing. The regular Mi 11 on the other hand looks completely washed out in comparison, with very little detail retention, as if the phone was primarily capturing using the ultra-wide and sensor fusing some details from the wide-angle – I’m a bit perplexed by the result.

While the OnePlus 9 Pro image appears eye-catching, it’s not a technically great result as the shadows are forced towards black. I actually remember when OnePlus introduced this image processing with a firmware update on the OnePlus 7 Pro following the devices’ releases, based on user feedback, with the company trying to mimic the “contrasty” Pixel look. That Pixel look was actually a negative side-effect of the HDR processing incapable of dealing with shadows, which was fixed and resolved with the latest HDR+ algorithm on the Pixel 5. OnePlus devices today are still left with what I consider a self-induced handicap.

The Axon 30 Ultra is a bit flat in the foreground highlights, producing a generally dark picture. The iPhone is also having surprising trouble with the metering here, as the Pixel 5 does quite a bit better.

Click for full image
[ X-T30 ( ) ]
[ S21U(S) ] [ S21U(E) ] [ Mi 11 Ultra ]
[ Axon 30 Ultra [ OnePlus 9 Pro ] [ Mi 11 ]
[ S21(E) ] [ iPhone 12 Pro ] [ Pixel 5 ]

In this landscape, the Mi 11 Ultra and the Pixel 5 did best in terms of colours. The S21’s did well in the overall representative brightness of the scene, however I feel like they didn’t have the dynamic range in the highlights to give out natural graduations, and thus it feels a bit flat. The Axon 30 Ultra feels it like has over-sharpening going on, and also while the overall brightness is correct it struggles to graduate the highlights correctly.

The over-processing on the OnePlus 9 Pro is quite horrible and makes a huge mess of the colour tones as well as details of the scene.

Click for full image
[ X-T30 ( ) ]
[ S21U(S) ] [ S21U(E) ][ Mi 11 Ultra ]
[ Axon 30 Ultra ] [ OnePlus 9 Pro ] [ Mi 11 ]
[ S21(E) ] [ iPhone 12 Pro ] [ Pixel 5 ]

In general colour tones and balance, the Pixel 5 has I think the best results, closest to being accurate, generally followed by the iPhone 12 Pro. The iPhone is generally the only one being able properly pick up the highlight textures, while the Pixel 5 is the only one being able to pick up extreme shadow detail.

The S21’s again had very good overall scene exposure, however lack detail retention in the highlights, probably going too far beyond what the sensors were capable. The Xiaomi phones are both generally good but their HDR processing really isn’t as strong in recovering information here. The Axon 30 Ultra does well except for what I would consider a bit too warm colour. The OnePlus 9 Pro struggles with highlight textures, and again has this extreme digital look due to structure enhancing.

Click for full image
[ X-T30 ( ) ]
[ S21U(S) ] [ S21U(E) ] [ Mi 11 Ultra ]
[ Axon 30 Ultra ] [ OnePlus 9 Pro ] [ Mi 11 ]
[ S21(E) ] [ iPhone 12 Pro ] [ Pixel 5 ]

This was also more an artificial scene to see what the HDR algorithms would do on the various phones. The Pixel 5 is again generally the best in terms of correctly maintaining colours in the extremes. The usual problem is that when you have highlights nearing dynamic range saturation and clipping, they should be desaturating their colours towards white, which some phones camera algorithms just don’t do as they attempt to recover details. This ends up in a very unnatural looking images where colours can go haywire.

Overall Main Camera HDR Processing & Natural Dynamic Range

In general, when it comes to the algorithms that are able to behave the best in terms of demanding high dynamic range scenarios, Google’s Pixel 5 and Apple’s iPhone 12 Pro appear to behave the best in terms of handling the tone curves correctly. The Samsung phones also have good HDR but sometimes don’t handle their highlights as well, going beyond what their sensors are capable of handling.

Xiaomi’s HDR processing doesn’t appear to be the strongest in recovering dynamic range, however the giant Mi 11 Ultra sensor still does well in terms of raw natural dynamic range, and also natural detail retention. OnePlus’s 9 Pro I found to be lacking in colour accuracy of highlights a lot, but most importantly I found the excessive sharpening and structure enhancement to be very detrimental to the images. The Axon 30 Ultra had quite good HDR in terms of returning the dynamic range, but also lots of times struggled with getting the colours tone mapped correctly.

I’d be curious to see what Google and Apple would be capable of given an actually technically competent image sensor, as most of the other vendors are really hit & miss in regards to their image processing in demanding lighting conditions.

Daylight: Intermediate Focal Lengths, Ultra-Wide Low-light: Large Sensors & Computational Night Modes
POST A COMMENT

60 Comments

View All Comments

  • 5j3rul3 - Monday, June 21, 2021 - link

    mm²

    The best way to show real sensor size, and prevent any unit convert difference.

    IMX600 -> 1/1.73"?
    NO, IT'S 1" = 18mm rather than 16mm
    So IMX600 is 1/1.95", and IMX586 is 1/1.92"

    Same AS GN2, GN1, HM3, HM1, OV48C, IMX700...

    Just 1/XX" ÷ 1.125, so you can get real sensor size
    Reply
  • Andrei Frumusanu - Monday, June 21, 2021 - link

    This is complete nonsense, please read the article. I explain the optical format diagonal size as well as list the actual physical sensor sizes in mm / mm². Reply
  • 5j3rul3 - Monday, June 21, 2021 - link

    Thks for your correction :} Reply
  • melgross - Tuesday, June 29, 2021 - link

    How come the iPhone 12 Max Pro isn’t there? It has a longer tele lens, plus some other differences. I notice two Samsung models. Reply
  • shabby - Monday, June 21, 2021 - link

    ~37% smaller is the answer. Reply
  • 5j3rul3 - Monday, June 21, 2021 - link

    Anandtech's camera spec comprasion is great, this is what we expect

    I my point of view, Adobe LrC / Lr are better choice, because they are crossed platform software with great popularity.

    About DCI-P3 shot, vivo X60 Pro+, Find X3 Pro, Mi 11 Ultra, Pixel 5 have this function.
    Reply
  • Andrei Frumusanu - Monday, June 21, 2021 - link

    Lightroom has bad support for Fuji X-Trans sensors demosaicing and isn't able to read out RAW metadata on the colour profiles, so it's not an option for me. Reply
  • 5j3rul3 - Monday, June 21, 2021 - link

    Thank you

    I hope people can see the ultra wide angle photo of XT-30 for comparison, it’s a good reference.
    Reply
  • s.yu - Wednesday, June 23, 2021 - link

    Andrei needs to buy another lens then :) Reply
  • Reflex - Monday, June 21, 2021 - link

    Capture One announced they will be on iPad next year for those that want the option. Reply

Log in

Don't have an account? Sign up now