Build complex toys and simple tools
by Tony Karp

How to test a camera
< Previous May 22, 2007 Next >

Hobbitt and the far-up lens - - Hobbitt and the far-up lens - Olympus C-2100UZ - Tony Karp, design, art, photography, techno-impressionist, techno-impressionism, aerial photography , drone , drones , dji , mavic pro , video , 3D printing - Books -
Hobbitt and the far-up lens - Olympus C-2100UZ

Forty-five years ago, I wrote camera reviews for Modern Photography Magazine. Testing a camera was a lot harder in those days, as our equipment was quite limited. It placed heavy demands on the experience and skill of the people doing the testing.

For instance, to test the resolution of a lens, we had to shoot pictures of the test charts on high-resolution film and then examine the results through a microscope. Although you could blow up the negative on an enlarger, this introduced the faults of the enlarger and its lens into the process.

Testing a digital camera is a lot easier. There is no film, so results can be seen immediately. The need for making prints is eliminated as we can examine the image in detail on the computer's monitor.

What brought all of this to mind is my recent experience with the Sony DSC-H9. As I took more and more pictures with it, I could see that there were problems with image quality. I exchanged the camera for another, hoping to eliminate the possibility that the first one was defective. In the end, I reverted to my camera-testing persona, spending hours examining images from the DSC-H9, hoping to identify the faults.

So I went to the online forums to see how others were faring with this camera. What I found, for the most part, was close-ups and nature photography, all of them quite striking. Pictures of birds, bees, bugs, beetles, and buds

Now I'm going to tell you a secret.

Macrophotgraphy is a very undemanding test of a camera's performance. All you need to produce "striking" close-ups is a camera whose focusing system lets you get close enough to the subject, and the ability to produce an image that's reasonably sharp in the center of the frame. In the end, this type of photography is more of a test of the photographer's skill than how well a camera performs. That's why most reviews just mention this facility in passing.

What this sort of image fails to locate is the very faults that plague the DSC-H9 -- the softness at the sides and corners of the image, the strange loss of detail in many parts of the picture, heavy color fringing, and the poor rendering of subjects, like portraits, that require the proper handling of skin tones with subtle gradations.

Here's a far more demanding test of a camera's image quality, and it's surprisingly easy to do.

Go outside with your camera, in daytime, when there's plenty of light. Set the ISO value at 200 or less. Leave the zoom at or near its widest setting. With today's compact zooms, this should give you a high shutter speed and near-infinite depth of field. In theory, this setup should be capable of filling the frame with a high-quality image, having the same sort of image quality at the sides and corners as in the center.

Now find a scene that will fill the frame with the same sort of detail in all parts of the image. Perhaps a large grove of trees, or maybe an urban scene with lots of buildings. The important thing is that the scene at the center of the image be the same as at the sides and corners.

Now take lots of pictures in this and similar situations. Play with the camera's settings for things like sharpness, contrast, and color rendition. No need to keep notes about which settings you used, as we had to in the good old days. The camera will record all this data for you in its EXIF data that it attaches to every picture.

Try this in more than one setting, and try to find settings that are filled with lots of detail. Shoot from at least twenty or thirty feet away. No close-ups!

Now load the image files into your computer and examine them on the monitor. You should look at them both scaled down to get an overall impression, and at full size (100%) to examine the image quality. An easy way to do this is to open a web browser then just drag an image file from its folder into the browser window.

Carefully examine the center of the picture first, as this will show you the best image quality that the camera can deliver. Now move to the edges and the corners of the image and compare the image quality there. Look for sharpness and the handling of detail, which should be fairly uniform across the entire picture. If it's different, note the difference. Does the detail at the sides and corners become unsharp with an out-of-focus appearance? Does it look smeared? Does it simply vanish into a "watercolor" look, similar to the detail in a painting? How about color rendition -- is it the same everywhere? Are there color fringes around the boundaries between light and dark areas?

For a further test, shoot some portraits. These should be done outdoors, but in the shade, so that the light is bright and fairly uniform. Get in close, or use the zoom so that the face fills a good part of the frame. As before, try lots of variations at different settings.

The result should be a pleasant rendering. Look for a smooth rendering of skin tones rather than a blotchy effect. Look for accentuated reds that give the subject a "drunken" appearance. Examine the rendering in the hair and eyelashes.

If you have another digital camera, it's a simple matter to compare the images from both. This will give you a better frame of reference for your comparisons, and it should demonstrate that your new camera has image quality at least as good as your old one.

As a final part of this exercise, you should post your results in the online forums so that others, considering the purchase of this camera, will be able to get a better idea of its overall image quality.

Even though we had lots of fancy equipment and did lots of tests at Modern Photography, the final test for any camera was pretty much the ordinary photography I described above. If the camera didn't perform well at the simple tasks I've outlined, all the fancy numbers and charts would not redeem it.

In addition, we tried to devise simple tests that anyone could use to evaluate a camera's performance. We couldn't test every camera/lens/film combination, not to mention the variability between individual cameras. These tests gave anyone a chance to get some idea of how well their own camera performed.

< Previous May 22, 2007 Next >

Copyright 1957-2023 Tony & Marilyn Karp
Web Site Design
Systems Design
The Future
About
Recent Entries
Cine-Simulator Samples * T-Zoom
Cine-Simulator Samples * The Muse's Eyes
Geeks vs Gurus * The cinematography edition
The Zen of Zooming
Why smartwatches failed, and how to fix it - Part 3
Why smartwatches failed, and how to fix it - Part 2
Why smartwatches failed, and how to fix it - Part 1
Some pictures from my smartphone
My fix for bird strikes on my window
Goodbye, Columbus
At an old curiosity shop in Purcellville
Smartphone vs camera -- Why you need both
Raw vs JPEG with the P30 Pro's super-wide camera
At the Air and Space Museum with a Huawei P30 Pro
A tribute to the architect, I.M. Pei
A blast from the past - Music's golden age
Green eggs and ham. And onions. And cheddar.
A blast from the past
Hidden views -- Discoveries from my drone
Will the FAA stop regulating hobby drones?
Here's a panorama from my Mavic, and two more
A quadcopter is a totally new kind of aircraft
Taking to the air -- First flights
Let's talk about the Mavic Pro's camera
A different viewpoint
The value of time in the creative process
Variations on a skink
Andy shoots raw. Ann always shoots JPEG
A butterfly in Havana -- From start to finish
Recovering highlight detail in JPEG images
A tribute to Paris on November 14, 2015
Some black and white pictures from long ago
Panasonic DMC-ZS40 pictures - Part 2
Panasonic DMC-ZS40 pictures - Part 1
Art in the 3rd Dimension -- A butterfly takes wing
Shooting for NBC
What's new at the zoo?
On being a photojournalist
Some pictures of Manassas
Finishing a picture
Watching the sunset in Adams Morgan
A night at the circus - 1966
Fortune Qwerkies (tm) -- Fortune cookies for the smartphone user
Art in the 3rd Dimension -- The evolution from flat to solid
Art in the 3rd Dimension -- Showing how the pieces fit together
Getting a grip on the Panasonic DMC-LF1
Some random thoughts about the Panasonic DMC-LF1
The Panasonic DMC-LF1 is a game-changer
Art and the Zen of QR Codes -- Making QaRt
A new process for printing art in the 3rd dimension
Bubbles! Bubbles! Bubbles!
Photographing the Perry Como Show
Hiking at Sky Meadows with my Panasonic DMC-ZS20
Working for the union
A new take on JPEG vs raw - Panasonic DMC-ZS20
Some pictures from my Panasonic DMC-ZS20 - Part 2
Some pictures from my Panasonic DMC-ZS20 - Part 1
My new go-everywhere camera - Panasonic DMC-ZS20
My brief life in the studio
Shooting Shakespeare - The Tempest - NBC, 1960
Impressionist bees
In the studio with Roz Kelly
At the Peppermint Lounge - 1962
An evening with Gene Kelly
A portrait of Donna Mitchell - Variations on a theme
The "Sky Dream Ultimate" plug-in from Wilkington-Smythe
Post-processing: Going from good to great
Winter pictures from my Panasonic DMC-FZ150
Using the Panasonic DMC-FZ150's "Photo Style" Menu
A valentine for the Artist's Muse
The Panasonic DMC-FZ150's controls
Some thoughts on the Panasonic DMC-FZ150 - Part 2
The Panasonic DMC-FZ150 - A cure for DSLR envy?
Some thoughts about my Panasonic DMC-FZ150 - Part 1
The Panasonic DMC-FZ150 -- Best camera ever?
Sunglasses - What can you add to a picture?
Hey, camera makers. If my smartphone can do this
The Artmuse Variations - a look inside my new book
A tribute to George Washington on Veterans Day
A visit to the White House
The little farmhouse, the tractor, and the interesting tree
Buckminster, the baby buckeye butterfly
Memories of September 11
Happy Corporation Day!
A trip to Monterey and San Francisco
The first battle of the American Civil War -- 150 years ago
The end of an era -- The last American manned mission
Growing an Italian stone pine tree
Random thoughts on art and other stuff - From my new book
Playing with a classic - Sony DSC-R1 - Part 3, Warrenton
Playing with a classic - Sony DSC-R1 - Part 2, In the house
Playing with a classic - Sony DSC-R1 - Part 1, Winter
Some recent pictures
Fixing a Panasonic DMC-FZ18/FZ28/FZ35 problem
Into the world of shadows
Snowbound!
A walk through Warrenton
Partly moony with my Panasonic DMC-FZ35
My new Panasonic DMC-FZ35 - Part 3 - Video
Some pictures from my Panasonic DMC-FZ35 - Part 2
Happy birthday to muse...
Pixels and parking lots -- The Panasonic FZ35
Some pictures from my Panasonic DMC-FZ35
My new Panasonic DMC-FZ35 - Part 2
My new Panasonic DMC-FZ35 - Part 1
On our way to Warrenton
Evolution of an Iris
A new feature in Adobe Camera Raw 5.4
A tribute to the Apollo 11 astronauts
The pole dancer - Variations on a theme
Restoring lost highlight detail in JPEG images
A short course in photography in ten easy lessons
Kodachrome memories
A walk in the woods on my birthday
Mythbusters - More raw vs JPEG myths
Restoring lost shadow detail in JPEG images
Action!!
Expose for the highlights, develop for the shadows
Something new -- Interchangeable cameras
Honey, I shrunk the newspaper - The "Nano" NY Times
Mistaking evolution for revolution
Some pictures from the artist's muse
Photography becomes art -- Daibutsu Buddha at Kamakura
Happy House-i-versary
25 random things about the artist's muse
It happened at the Met
Some pictures and some settings - Part 4 - DMC-FZ28
Some pictures and some settings - Part 3 - DMC-FZ28
Some pictures and some settings - Part 2 - DMC-FZ28
Some pictures and some settings - Panasonic DMC-FZ28
Noiseography -- A new photographic technique
Shooting infrared with the Panasonic DMC-FZ28
You're never too young
One month with the Panasonic DMC-FZ28
A trip to Berryville - Panasonic DMC-FZ28
It's the Hobbitt's birthday
On September 11th
Shooting Tri-X with the Panasonic DMC-FZ28
A shot in the dark - Panasonic DMC-FZ28
Sunset and the far-up lens -- Panasonic DMC-FZ18
Further musings on the Panasonic DMC-FZ28
Customizing your camera for high-ISO photography
Panasonic DMC-FZ28 vs DMC-FZ18 at high ISO
Some musings about the Panasonic DMC-FZ28
Hummers, SUVs, DSLRs, and my DMC-FZ28
Panasonic DMC-FZ28 -- At the Flying Circus
Panasonic DMC-FZ28 -- The journey begins
Farewell, my Panasonic DMC-FZ18
More about the settings for the DMC-FZ18
Dealing with the modes and settings of the DMC-FZ18
Photography becomes art - Bird on a wire
The artist's muse at sunset -- DMC-FZ18
Do you need fancy equipment?
Now here's my plan
Good cookie, bad cookie
But seriously, folks...
Post-processing Mr. Squirrel
A museum of one's own
We need new words to describe what's happening
Going over to the dark side
Shooting the moon
Happy Anniversary, Hobbitt
The view from my window - DMC-FZ18
My favorite museum
A toast to the artist's muse
The DMC-FZ18, a sunset, and a glass of beer
Remembering Herbert Keppler
Shooting abstracts with the Panasonic DMC-FZ18
Fixing a Panasonic DMC-FZ18 problem
More pictures from my Panasonic DMC-FZ18
The journey of a thousand Melvins
Stairway to the stars -- Extreme post processing
DMC-FZ18 - Raw vs JPEG - The JPEG Manifesto
Chromatic aberration and the DMC-FZ18
Raw vs JPEG, the DMC-FZ18, and a mystery
Some pictures from my Kodak P880 - Part 2
Some pictures from my Panasonic DMC-FZ18
Some pictures from my Kodak P880 - Part 1
DMC-FZ18 - Don't be afraid of the dark
Shooting in "Medium" - DMC-FZ18 - The right exposure
Shooting in "Medium" and the Panasonic DMC-FZ18
In-use review -- Panasonic DMC-FZ18 - Part 2
In-use review -- Panasonic DMC-FZ18 - Part 1
Photography becomes art - Fantasy at Ida Lee
Photography becomes art - The chefs at Little Washington
My new old camera - the Kodak Easyshare P880
Photography becomes art - Variations on a theme
All the (art) news that's fit to print
The museum becomes art - #1
Photography becomes art - Making an angel
How to test a camera
Hitting the wall
Extreme post-processing - Working with infrared
Blogging 2.0 - A new interface
A funny thing happened on my way to the blog
In the beginning...