Nikon D5000 Imatest Results

We routinely use Norman Koren's excellent "Imatest" analysis program for quantitative, thoroughly objective analysis of digicam test images. I highly recommend it to our technically-oriented readers, as it's far and away the best, most comprehensive analysis program I've found to date.

My comments below are just brief observations of what we see in the Imatest results. A full discussion of all the data Imatest produces is really beyond the scope of this review: Visit the Imatest web site for a full discussion of what the program measures, how it performs its computations, and how to interpret its output.

Here's some of the results produced by Imatest for the Nikon D5000:


sRGB Accuracy Comparison

The Nikon D5000 showed very good color accuracy overall. Hue accuracy was also excellent, with most of the hue shift occurring in the cyans, sky blues, and reds. Average saturation was 105.3% (oversaturated by only 5.3%, mostly in the blues, and dark greens). Average "delta-C" color error was an unusually low 4.21 after correction for saturation, which is excellent. All in all, a very good color response for an SLR. Mouse over the links below the illustration above to compare results with competing models.


Adobe RGB Accuracy Comparison

Using the Adobe RGB color space (which provides a much wider gamut, or range of colors that can be expressed), the Nikon D5000 delivers more highly saturated color, as is usually the case. The average saturation was 111.9% and average saturation-corrected hue error of 4.64 "delta-C" units, which in this case is slightly more accurate than most of the competition here. Again, mouse over the links below the illustration above to compare results with competing models.

 

Color Analysis

This image shows how the Nikon D5000 actually rendered the colors of the MacBeth chart, compared to a numerically ideal treatment. In each color swatch, the outer perimeter shows the color as actually captured by the camera, the inner square shows the numerically ideal color, after correcting for the luminance of the photographed chart (as determined by a second-order curve fit to the values of the gray swatches), and the small rectangle inside the inner square shows the numerically ideal color, without any luminance correction. This image shows the D5000's excellent hue accuracy, as well as a contrast curve that results in moderate overexposure of some highly saturated colors. (We've seen this in most cameras, increasing the "punch" of images by lightening bright colors a little, while actually keeping both the hue and saturation level very close to technically accurate values.)

 

Noise Analysis


There's a lot in this particular graph, a lot more than we have room to go into here. (This set of plots has also changed a little in the more recent versions of Imatest. Some of the plots that were shown here previously are now shown in other Imatest output. Since we largely focus on the Noise Spectrum plot, we'll only show the graphic above, which includes that plot.)

In comparing these graphs with those from competing cameras, I've found that the Noise Spectrum graph at lower right is the most important. Cameras that manage to shift their noise spectrum to higher frequencies have much finer-grained noise structures, making their noise less visually objectionable. In the graph above, this would show up as a noise spectrum curve that remained higher on the right side, representing higher noise frequencies. The champion at this was (and still is) the Canon EOS-1Ds Mark II, which produced remarkably fine-grained image noise, even at very high ISOs.

ABOVE, we see the results at ISO 100, which is as a low extension of the normal ISO range for the D5000. The luminance curve is reasonably flat except for the lowest frequencies, however the red and blue color channels exhibit higher noise values, especially at lower frequencies. While the overall noise levels are very low, the dominance of low frequencies in the red and blue channels point to low-level blotchiness.


Here we see a slight increase in overall noise levels at the D5000's base ISO of 200 (although still very low), although the red and blue low-frequency noise doesn't reach quite such high levels as at ISO 100. The the graph is still skewed to the left, however, indicating a coarser "grain" in the small amount of noise that is present. The blue and red channels follow the green and luminance channels more closely than at ISO 100, but still show more noise energy, especially at lower frequencies.

Above is the same set of noise data at ISO 3,200. Here, we can see the overall noise energy has gone up somewhat (the area under the curves is larger), and the Noise Spectrum graph is still shifted toward the left-hand, lower-frequency side. This time, the red channel has slightly more noise energy at lowest frequencies, though the channels are more closely matched than at ISOs 100 and 200, an effect of the D5000's default high ISO noise reduction.

 

Here's the same set of noise data at ISO 6,400. Very similar to ISO 3,200, with a slightly larger area under the curve, indicating higher noise levels overall. There's also a significant shift to the left, indicating a coarser grain pattern.

 

This chart compares the Nikon D5000's noise performance over a range of ISOs against that of other competing cameras, using default settings. While we continue to show noise plots of this sort because readers ask for them, we each time point out that the noise magnitude is only a small part of the story, the grain pattern being much more important. In the case of the Nikon D5000, the magnitude of the image noise starts out slightly below most of the competition at ISO 100, and remains lower than all the competition except for the Canon XSi, up to ISO 800. At ISO 1,600, the D5000's default high ISO noise reduction kicks in more aggressively than most, keeping noise magnitude almost level out to 3,200, after which is climbs again at a higher rate to ISO 6400. Not surprisingly, the D5000 follows the noise curve of the D90 fairly closely, since they use very similar, if not the same sensors. Keep in mind these are at default settings, so the shape and positions of the curves will be influenced by your settings.

 

Nikon D5000 Dynamic Range Analysis

A key parameter in a digital camera is its Dynamic Range, the range of brightness that can be faithfully recorded. At the upper end of the tonal scale, dynamic range is dictated by the point at which the RGB data "saturates" at values of 255, 255, 255. At the lower end of the tonal scale, dynamic range is determined by the point at which there ceases to be any useful difference between adjacent tonal steps. Note the use of the qualifier "useful" in there: While it's tempting to evaluate dynamic range as the maximum number of tonal steps that can be discerned at all, that measure of dynamic range has very little relevance to real-world photography. What we care about as photographers is how much detail we can pull out of the shadows before image noise becomes too objectionable. This, of course, is a very subjective matter, and will vary with the application and even the subject matter in question. (Noise will be much more visible in subjects with large areas of flat tints and subtle shading than it would in subjects with strong, highly contrasting surface texture.)

What makes most sense then, is to specify useful dynamic range in terms of the point at which image noise reaches some agreed-upon threshold. To this end, Imatest computes a number of different dynamic range measurements, based on a variety of image noise thresholds. The noise thresholds are specified in terms of f-stops of equivalent luminance variation in the final image file, and dynamic range is computed for noise thresholds of 1.0 (low image quality), 0.5 (medium image quality), 0.25 (medium-high image quality) and 0.1 (high image quality). For most photographers and most applications, the noise thresholds of 0.5 and 0.25 f-stops are probably the most relevant to the production of acceptable-quality finished images, but many noise-sensitive shooters will insist on the 0.1 f-stop limit for their most critical work.

The image below shows the test results from Imatest for an in-camera JPEG file from the Nikon D5000 with a nominally-exposed density step target (Stouffer 4110), and the D5000's settings at their default positions, where Active D-Lighting is set to Off.

These are very good results for in-camera JPEGs, among the top performers in the high quality category (7.65 f-stops). The tone curve shows excellent gradation in highlights but tails-off very abruptly in the shadow end. This can be seen when closely inspecting shots captured by the D5000, where detail is held very nicely in strong highlights, but somewhat less so in the deepest shadows.


The results with Active D-Lighting set to Low are a bit higher at the highest quality level, increasing from 7.65 to 7.75 f-stops. The total dynamic range figure (irrespective of noise levels) has increased a full stop, from 8.99 to 9.99 f-stops. This is unusual in our experience: Camera features like Active D-Lighting that are intended to improve the visual dynamic range of photographs almost never increase the actual dynamic range, as they mainly just shift the tone curve to bring out shadow detail or make minor variations in highlights more visible.


The Active D-Lighting Normal setting had slightly better results than with it set to Off, but slightly worse results than the Low setting. Dynamic range at the highest quality was 7.66 f-stops, and the total dynamic range to 10.3 f-stops.


It's interesting that the High setting actually reduced both dynamic range figures. This is because it's really just redistributing the available tonal scale, which involves boosting brightness levels in the shadows pretty substantially. This also boosts the noise, so the useful dynamic range is reduced.


Not surprisingly, the Extra High setting took another step back in both the high-quality (7.55 f-stops) and total (9.90 f-stops) scores.


Processing the Nikon D5000's ISO200 RAW (NEF) file through Adobe Camera Raw (ACR) version 5.4 beta improved dynamic range by over 1-3/4 stops to 9.5 at the best quality level, and by almost 3 stops total, to 12.1 f-stops. ACR's automatic settings were used. Tweaking the sliders manually may result in slightly better results. Worth noting here is that ACR's default noise reduction settings reduced the pixel noise quite a bit overall, contributing to the score at the highest quality level. These are the best results from RAW that we've seen from any DSLR with a sub-frame sensor.

 

Dynamic Range, the bottom line:

The net result was that the Nikon D5000 JPEGs came in above most other DSLR models we've tested recently at the highest quality level, including the D300. Results with Adobe Camera Raw converted NEF files were excellent, placing the D5000 at the top of the APS-C sized models, besting the more expensive Nikon D90.

To get some perspective, here's a summary of the Nikon D5000's dynamic range performance, and how it compares to other digital SLRs that we also have Imatest dynamic range data for. (Results are arranged in order of decreasing dynamic range at the "High" quality level.):

Dynamic Range (in f-stops) vs Image Quality
(At camera's base ISO)

(Blue = RAW via ACR, Yellow=Camera JPEG, Green=Current Camera)
Model 1.0
(Low)
0.5
(Medium)
0.25
(Med-High)
0.1
(High)
Nikon D3X
(Adobe Camera Raw 5.3b)
-- -- 11.1 9.64
Nikon D700
(Adobe Camera Raw 4.5)
12.1 11.6 10.6 9.51
Nikon D5000
(Adobe Camera Raw 5.4b)
-- 11.6 10.8 9.50
Sony A900
(Adobe Camera Raw 4.6b)
-- 12.1 10.7 9.36
Nikon D90
(Adobe Camera Raw 4.6b)
12.1 11.8 10.7 9.27
Fujifilm S3 Pro
(Adobe Camera Raw 2)
12.1 11.7 10.7 9.00
Nikon D40x
(Adobe Camera Raw 4.1)
12.0 10.9 10.3 8.90
Canon 5D Mark II
(Adobe Camera Raw 5.2)
-- 10.8 10.0 8.89
Canon EOS-1Ds Mark III
(Adobe Camera Raw 4.5)
11.5 10.7 9.96 8.84
Nikon D3
(Adobe Camera Raw 4.5)
11.7 11.0 10.0 8.75
Canon EOS-1D Mark III
(Adobe Camera Raw 4.5)
11.7 10.7 9.99 8.73
Pentax K20D
(Adobe Camera Raw 4.5)
11.4 10.6 9.82 8.56
8.5 Stops
Nikon D300
(Adobe Camera Raw 4.3.1)
11.4 10.9 9.87 8.45
Sony A200
(Adobe Camera Raw 4.3.1)
11.6 10.4 9.82 8.43
Nikon D60
(Adobe Camera Raw 4.4.1)
11.6 10.5 9.74 8.31
Nikon D40
(Adobe Camera Raw 4.1)
11.9 10.9 9.89 8.30
Canon EOS-1Ds Mark III
(Camera JPEG)
10.9 10.2 9.71 8.23
Pentax K100D
(Adobe Camera Raw 3.6)
11.3 10.3 9.51 8.23
Pentax K200D
(Adobe Camera Raw 4.4.1)
-- 10.5 9.54 8.19
Pentax K10D
(Adobe Camera Raw 3.7)
10.6 10.0 9.29 8.19
Sony A100
(Adobe Camera Raw 3.4)
11.3 10.5 9.69 8.16
Canon EOS-1Ds Mark II
(Adobe Camera Raw 3)
11.2 10.3 9.40 8.14
Canon EOS 50D
(Adobe Camera Raw 4.6)
11.2 10.5 9.49 8.06
Nikon D40x
(Camera JPEG)
10.8 10.0 9.42 8.04
Canon Rebel XSi
(Camera JPEG)
(ALO on by default)
11.3 10.1 9.34 8.01
8.0 Stops
Fujifilm S3 Pro
(Camera JPEG)
-- 9.90 9.40 7.94
Nikon D3X
(Camera JPEG)
Advanced D-Lighting=Low)
-- -- -- 7.91
Sony A350
(Adobe Camera Raw 4.4)
11.6 10.5 9.61 7.89
Canon EOS-1D Mark III
(Camera JPEG)
-- 10.2 9.70 7.88
Canon Rebel XS
(Adobe Camera Raw 4.5)
-- 10.3 9.27 7.88
Nikon D3
(Camera JPEG)
-- -- -- 7.87
Canon Digital Rebel XTi
(Adobe Camera Raw 3.6)
10.8 9.88 9.18 7.84
Canon EOS 5D
(Adobe Camera Raw 3)
11.0 10.4 9.21 7.83
Canon EOS 50D
(Camera JPEG)
(ALO Off )
-- 9.64 9.17 7.83
Nikon D90
(Camera JPEG)
-- -- -- 7.77
Panasonic DMC-GH1
(Adobe Camera Raw 5.4b)
9.88 -- 9.30 7.76
Panasonic DMC-GH1
(Camera JPEG
iExposure=Standard)
8.76 -- -- 7.76
Nikon D5000
(Camera JPEG),
(Advanced D-Lighting=Low )
-- -- 9.28 7.75
Canon Rebel T1i
(Adobe Camera Raw 5.4b)
11.2 10.2 9.16 7.73
Canon EOS 40D
(Adobe Camera Raw 4.2)
11.2 10.1 9.26 7.72
Canon Rebel XSi
(Adobe Camera Raw 4.4.1)
10.6 9.95 9.10 7.68
Canon EOS 50D
(Camera JPEG)
(ALO STD by default)
-- -- 8.90 7.68
Nikon D700
(Camera JPEG)
-- -- 9.05 7.67
Canon 5D Mark II
(Camera JPEG)
(ALO STD)
10.6 9.68 8.98 7.66
Nikon D5000
(Camera JPEG),
(Advanced D-Lighting=Off)
-- -- 8.96 7.65
Canon EOS-5D
(Camera JPEG)
10.2 9.68 8.82 7.65
Olympus E-3
(Adobe Camera Raw 4.3)
10.3 10.1 9.29 7.64
Canon 5D Mark II
(Camera JPEG)
(ALO Off)
-- 9.67 8.96 7.62
Nikon D60
(Camera JPEG)
10.5 9.62 8.89 7.62
Nikon D200
(Adobe Camera Raw 3)
10.6 9.65 8.96 7.61
Nikon D80
(Adobe Camera Raw 3.6)
11.1 10.4 9.42 7.51
7.5 Stops
Olympus E-500
(Adobe Camera Raw 3)
10.7 9.97 8.90 7.46
Olympus E-510
(Adobe Camera Raw 4.1)
10.0 9.43 8.64 7.46
Pentax K10D
(Camera JPEG)
-- 9.49 8.88 7.44
Nikon D300
(Camera JPEG)
-- -- 8.70 7.44
Olympus E-420
(Adobe Camera Raw 4.1.1)
10.0 9.61 8.65 7.44
Canon Rebel T1i
(Camera JPEG)
(ALO=STD by default)
11.3 10.1 9.34 7.43
Nikon D2Xs
(Adobe Camera Raw 3.6)
10.6 9.90 8.93 7.42
Canon EOS 40D
(Camera JPEG)
10.6 9.52 8.78 7.42
Nikon D3X
(Camera JPEG)
(Advanced D-Lighting=Off)
-- -- -- 7.37
Nikon D50
(Camera JPEG)
10.7 9.93 8.70 7.36
Panasonic DMC-G1
(Adobe Camera Raw 5.2)
10.7 9.78 8.70 7.32
Sony A900
(Camera JPEG)
(DRO off by default )
10.2 9.75 8.49 7.31
Sony A200
(Camera JPEG)
(DRO on by default)
10.4 9.43 8.91 7.29
Canon EOS 20D
(Camera JPEG)
10.3 9.66 8.85 7.29
Canon EOS 30D
(Camera JPEG)
10.3 9.50 8.57 7.29
Nikon D40
(Camera JPEG)
10.4 9.80 8.89 7.28
Sony A900
(Camera JPEG)
(DRO on)
10.1 9.76 8.47 7.26
Canon Rebel XS
(Camera JPEG)
10.3 9.4 8.61 7.22
Olympus E-520
(Adobe Camera Raw 4.5)
11.0 9.46 8.70 7.20
Sony A350
(Camera JPEG)
(DRO on by default)
10.3 9.55 8.85 7.19
Nikon D80
(Camera JPEG)
10.1 9.43 8.48 7.12
Canon Digital Rebel XT
(Camera JPEG)
10.3 9.51 8.61 7.11
Nikon D200
(Camera JPEG)
-- 9.07 8.36 7.11
Panasonic DMC-G1
(Camera JPEG,
iExposure = Low)
-- 9.29 8.50 7.09
Panasonic DMC-G1
(Camera JPEG,
iExposure = Standard)
-- 9.30 8.54 7.07
Olympus E-300
(Camera JPEG)
10.8 9.26 8.48 7.07
Olympus E-410
(Adobe Camera Raw 4.1)
10.2 9.40 8.24 7.05
Olympus E-500
(Camera JPEG)
10.0 9.14 8.16 7.05
Canon Digital Rebel XTi
(Camera JPEG)
9.83 9.10 8.27 7.04
Canon EOS-1Ds Mark II
(Camera JPEG)
10.3 9.38 8.60 7.04
Panasonic DMC-G1
(Camera JPEG,
iExposure = High)
10.3 9.23 8.54 7.04
Panasonic DMC-G1
(Camera JPEG,
iExposure = Off)
-- 9.33 8.52 7.03
Pentax K200D
(Camera JPEG)
-- 9.50 8.30 7.01
7.0 Stops
Canon Digital Rebel
(Camera JPEG)
10.1 9.11 8.47 6.97
Nikon D2Xs
(Camera JPEG)
9.82 8.98 8.23 6.97
Panasonic DMC-L10
(Adobe Camera Raw 4.2)
10.4 9.34 8.48 6.91
Sigma DP1
(Camera JPEG)
-- 8.95 8.13 6.91
Pentax *istDs
(Camera JPEG)
10.2 10.0 8.87 6.90
Sony A100
(Camera JPEG)
10.2 9.24 8.39 6.89
Pentax K100D
(Camera JPEG)
10.3 9.30 8.39 6.73
Pentax K20D
(Camera JPEG)
10.2 9.21 8.09 6.66
6.5 Stops
Nikon D2x
(Camera JPEG)
-- 8.93 7.75 6.43
Olympus E-3
(Camera JPEG)
9.32 9.06 8.50 6.42
Panasonic DMC-L10
(Camera JPEG)
-- 8.94 8.00 6.38
Olympus E-420
(Camera JPEG)
9.18 8.82 7.93 6.37
6.0 Stops
Olympus E-410
(Camera JPEG)
-- -- 7.60 5.99
Nikon D70s
(Camera JPEG)
9.84 8.69 7.46 5.85
Nikon D70
(Camera JPEG)
9.81 8.76 7.58 5.84
Olympus E-520
(Camera JPEG)
9.32 8.68 7.74 5.74
< 5.0 Stops
Olympus E-510
(Camera JPEG)
7.70 7.16 5.87 3.55

The results shown in the table are interesting. One of the first things that struck me when I initially looked at test data for a wide range of DSLRs, was that here again, purely analytical measurements don't necessarily correlate all that well with actual photographic experience. There's no question that the Fuji S3 Pro deserved its original place atop the list, as its unique "SR" technology did indeed deliver a very obvious improvement in tonal range in the highlight portion of the tonal scale relative to competing models of its day. (Amazing that it's now surpassed by even consumer-level models using today's technology.) I was also surprised to see the analytical results place the original Olympus E-300 as highly as they did, given that our sense of that camera's images was that they were in fact noisier than those of many other DSLRs that we looked at. In the other direction, I was quite surprised to see the Nikon D2x place as low on the listings as it did, given that we found that camera's shadow detail to be little short of amazing.

One thing that's going on here though, is that we tested each camera at its lowest (base) ISO setting, which should produce best-case noise levels. This is in fact what many photographers will be most interested in, but it does perhaps place some of the Nikons (like the D40 and D5000) at a disadvantage, as their base ISO setting is 200, as compared to the ISO 100 settings available on most other models.

All that said, the Nikon D5000 delivers excellent dynamic range performance, clearly one of the leading cameras currently on the market in this regard.

 

Nikon D5000 Resolution Chart Test Results

The chart above shows consolidated results from spatial frequency response measurements in both the horizontal and vertical axes. The "MTF 50" numbers tend to correlate best with visual perceptions of sharpness, so those are what I focus on here. The uncorrected resolution figures are 1,543 line widths per picture height in the horizontal direction (corresponding to the vertically-oriented edge), and 1,576 lines along the vertical axis (corresponding to the horizontally-oriented edge), for a combined average of 1,559 LW/PH. Correcting to a "standardized" sharpening with a one-pixel radius increased both vertical and horizontal resolution significantly, resulting in an average of 2,002 LW/PH, slightly below what we'd expect from a 12-megapixel DSLR.

To see what's going on, refer to the plots below, which show the actual edge profiles for both horizontal and vertical edges, in both their original and corrected forms. Here, you can see that the D5000's default in-camera sharpening is fairly conservative (only a slight bump at the top ends, and no noticeable bump at the bottom ends of the black edge profile curves). Imatest reports that the horizontal direction (vertical edge) is "undersharpened" by 18.7% while the vertical direction (horizontal edge) is undersharpened by 17.6%. Professionals and serious amateurs prefer this to oversharpening, and the D5000's images respond very well to the use of strong/tight sharpening post-exposure in Photoshop or other image editors. (That said, you should be able to extract still more fine detail if you begin with a RAW file, rather than a JPEG.)
.


 

Buy the Nikon D5000

Your purchases support this site

Buy the Nikon D5000


Editor's Picks