Home | Contact Us | FAQ | Search & Site Map | Link to Us
Sign In | Join | Other 45 Sites in Network
PhotoKB Home
Discussion Groups
Digital Photography
Digital PhotoDSLR CamerasZLR CamerasPoint & Shoot Cameras
Film Photography
35 mmLarge FormatMedium formatDarkroomFilm and LabsOther Equipment
Photo Technique
Nature PhotographyPeople PhotographyTechnique General
General Photo Topics
General TopicsAustralian PhotographyUK Photography
DirectoryPhoto Clubs

Photo Forum / Digital Photography / DSLR Cameras / April 2006

Tip: Looking for answers? Try searching our database.

ACR 16 bit raw photo conversion

Thread view: 
Enable EMail Alerts  Start New Thread
Thread rating: 
Paul Furman - 14 Apr 2006 00:03 GMT
[x-posted to alt.graphics.photoshop & rec.photo.digital.slr-systems]

I discovered (perhaps misguided?) that if I zero out all the adjustments
in ACR (Adobe Camera Raw) except white balance, and save as 16 bit, the
result has enough information to do anything that ACR will do for
contrast, saturation, etc. I'm using CS (not CS2).

For high contrast images, I used to do two conversions for highlights &
shadows & mask those together but it can be done with one straight 16
bit conversion & masking adjustment layers with a lot more flexibility.

I had thought that the ACR adjustments were working on some magical RAW
level of high bit math but in fact, 16 bit (vs 8 bit) holds everything
there is to get. I'm familiar with holding down the alt key in ACR while
sliding exposure and shadows and that's a nifty tool but why didn't they
just put it in the core PS adjustments and why these new terms like
shadows & brightness?

On a related note, ImagePlus http://www.mlunsold.com/ is a program used
for astrophotography which features a higher bit math, which is reported
to perform cleaner conversions.

From their descriptions:
"- Read and write 8, 16, and 32 bit integer or 32 bit float RAW images
with one or 3 color channels. Interleaved or non-interleaved channels
are also an option.
- Read and write 8, 16, and 32 bit integer or 32 bit float and 64 bit
double FITS image formats."

The argument I heard is photoshop *only* does 15 bit math and this does
64 bit math so there is less rounding error and cleaner results,
especially in the shadows where the amount of information is minimal.
Then I hear that camera files are really only have 12 bits so 15 should
be plenty, right? I'm not clear what 32 bit or 64 bit even means.

One issue may be that RAW data is linear, not gamma adjusted, so when
you do the gamma adjustment to 2.2 that stretches the data compressing
highlights and expanding shadows but expanding won't damage anything and
the highlights can usually afford to be compressed some. Strictly
speaking this expands from 4096 levels to about 13000 levels or about 3x
if you don't do any compression.

I've also read that photoshop has limitations to what can be done with
high bit images such as 16 bit & 32 bit like no adjustment layers. I
think this is outdated and not an issue in CS. I don't see any option
for 32 bit files though.

Any insights on these isssues?
Mike Russell - 14 Apr 2006 00:12 GMT
> [x-posted to alt.graphics.photoshop & rec.photo.digital.slr-systems]
>
> I discovered (perhaps misguided?) that if I zero out all the adjustments
> in ACR (Adobe Camera Raw) except white balance, and save as 16 bit, the
> result has enough information to do anything that ACR will do for
> contrast, saturation, etc. I'm using CS (not CS2).
...
> Any insights on these isssues?

IMHO 8 bits has plenty of headroom for editing, and I have yet to see any
exceptions to this in images using "normal" colorspaces.

That said, it's a fairly complex issue, and reasonable people differ.  The
question is becoming moot as processors get faster and memory gets cheaper.
Here are some more insights that you might find interesting.

http://mike.russell-home.net/tmp/DanMargulis16Bit/
Signature

Mike Russell
www.curvemeister.com

Siggy - 14 Apr 2006 13:32 GMT
8<

> Here are some more insights that you might find interesting.
>
> http://mike.russell-home.net/tmp/DanMargulis16Bit/

Wonderful read that, Mike. Many thanks! Wooohoooo. I feel L I B E R A T E D!
Those 76Mb 16 bit ProPhotoRGB TIFFS are now history. :-)

Nigel
Johan W. Elzenga - 14 Apr 2006 15:57 GMT
> 8<
>
[quoted text clipped - 4 lines]
> Wonderful read that, Mike. Many thanks! Wooohoooo. I feel L I B E R A T E D!
> Those 76Mb 16 bit ProPhotoRGB TIFFS are now history. :-)

ProPhoto is *not* one of those 'normal' color spaces Mike is talking
about. If you use ProPhoto in 8 bits, you will risk banding.

Signature

Johan W. Elzenga           johan<<at>>johanfoto.nl
Editor / Photographer      http://www.johanfoto.nl

Siggy - 15 Apr 2006 02:18 GMT
> ProPhoto is *not* one of those 'normal' color spaces Mike is talking
> about. If you use ProPhoto in 8 bits, you will risk banding.

Yes, I realise that. I was persuaded once to archive my images in 16bit
ProPhoto, but have never really been convinced of the relevance to my
shooting needs. I don't shoot skies in earnest, and my serious photography
is studio based. This article just gave me the push I needed to stand up for
my own instincts! 8 Bit AdobeRGB for me now, alongside the original RAW, for
archiving. :-)
Mike Russell - 14 Apr 2006 20:07 GMT
>> Here are some more insights that you might find interesting.
>> http://mike.russell-home.net/tmp/DanMargulis16Bit/
>
> Wonderful read that, Mike. Many thanks! Wooohoooo. I feel L I B E R A T E
> D!
> Those 76Mb 16 bit ProPhotoRGB TIFFS are now history. :-)

Hi Nigel,

Yes, Dave Cardinal's article was particularly informative for me.

Mike
Pete Mitchell - 15 Apr 2006 02:13 GMT
>>> Here are some more insights that you might find interesting.
>>> http://mike.russell-home.net/tmp/DanMargulis16Bit/
[quoted text clipped - 6 lines]
>
> Yes, Dave Cardinal's article was particularly informative for me.

It's an interesting read all around - my thoughts are ...

(a)    It's obviously an emotive point for Dan. I'm reminded or court room
scenarios where the prosecution first outlines their case, and at the end of
it you're left thinking "shoot the giulty basterd now" - and then when the
defence has finished you think "hang on - that's very plausable too -
definately two sides to that story". In this case we heard from a somewhat
pissed off Dan, but haven't heard "the other side", so who knows what their
response would be?

(b)    It's even conceded by Dan that 16 bit can produce a superior result
with computer-generated graphics in wide colourspaces (which I would
interpret to be something like a graduated fill (eg replacement sky) whilst
in something like LAB colour?

In my case I do use LAP colour a lot - I often do large gradient fills - the
size of the files aren't an issue, and I've got the horsepower to crunch
them.

In summary it appears that in most situations 16 bit doesn't appear to offer
an apparent advantage (but may under some circumstances) whereas (assuming
that size isn't an issue) nor does it offer any disadvantage.

Truth be known, I prefer a 16 bit workflow for my images, but am often
presented with 8 bit images for processing by clients - so I work in both.
It seems that the lesson to be learned from all of this is that in most
situations it really doesn't make any difference?
Mike Russell - 15 Apr 2006 02:39 GMT
>>>> Here are some more insights that you might find interesting.
>>>> http://mike.russell-home.net/tmp/DanMargulis16Bit/
[quoted text clipped - 34 lines]
> It seems that the lesson to be learned from all of this is that in most
> situations it really doesn't make any difference?

I happen to enjoy Dan's style.  He's the most entertaining and literary
personalities in the Photoshop world, and if he's a bit testy about 16 bit
versus 8 bit, I think it's understandable.

It's true that the march of technology is providing us with an embarrassment
of riches.  Just as a rich man does not concern himself with whether a car
costs 50 thousand euros or 100 thousand, perhaps many of us need not worry
whether we work in 8 or 16 bits.  This is at least part of the point you are
making.

OTOH, a factor of two is still a factor of two.  No matter how rich I might
be, I would enquire whether the 100 thousand Euro car had *any* demonstrable
advantage over the 50 thousand Euro car.  By the same token, I ask for
evidence, in the form of an example, that editing in 16 bits would provide
me with a demonstrable advantage over editing in 8 bits.

I have not seen, as of April 14, 2006, a color photograph, in a "normal"
color space, that demonstrates this. Even in psychedelic color spaces like
ProPhoto RGB, examples are very rare, which should be the clue that it makes
no difference to those of us who are content to work in sRGB, Adobe RGB,
Colormatch, or Apple RGB.

Got image?  Anything else is hand waving that is as meaningful to a blind
man as a sighted person.
---
Mike Russell
www.curvemeister.com
Pete Mitchell - 15 Apr 2006 02:51 GMT
> OTOH, a factor of two is still a factor of two.  No matter how rich I
> might be, I would enquire whether the 100 thousand Euro car had *any*
> demonstrable advantage over the 50 thousand Euro car.  By the same token,
> I ask for evidence, in the form of an example, that editing in 16 bits
> would provide me with a demonstrable advantage over editing in 8 bits.

Perhaps this is a difference in human psyche?

I was recently faced with the prospect of buying a wide-format printer.
Canon had the W6400 - HP had their offerings - and Epson had the 7800. After
much soul searching I was left with the thought that the Canon could
PROBABLY do the job (I spoke with the local rep - I met with the national
rep - we had sample prints done - I grilled them in diverse areas such as
onsite and tech support etc) - the difference was I KNEW that the Epson
could do the job - and that's what I bought.

I feel the same about 8 -v- 16 bit. I THINK that 8 can probably do the job
most (all?) of the time - but I KNOW 16 bit can. And for me, all other
things are equal - so that's why I use it for my images.
Mike Russell - 15 Apr 2006 04:22 GMT
>> OTOH, a factor of two is still a factor of two.  No matter how rich I
>> might be, I would enquire whether the 100 thousand Euro car had *any*
[quoted text clipped - 3 lines]
>
> Perhaps this is a difference in human psyche?

I agree.  If there are no images to demonstrate that 16 bit edits are
superior, what other explanation is there?

> I was recently faced with the prospect of buying a wide-format printer.
> Canon had the W6400 - HP had their offerings - and Epson had the 7800.
[quoted text clipped - 3 lines]
> onsite and tech support etc) - the difference was I KNEW that the Epson
> could do the job - and that's what I bought.

You thought about the right things, and I believe you came up with a good
decision.  Would you have felt confident of your choice had you not looked
at any printed images from the printers you were considering, and seen
differences between them?

> I feel the same about 8 -v- 16 bit. I THINK that 8 can probably do the job
> most (all?) of the time - but I KNOW 16 bit can. And for me, all other
> things are equal - so that's why I use it for my images.

Most of us do not have the time to do our own research, and must rely on
conventional wisdom and authorities we trust to make these determinations
for us.  Given the depths of time, the absence of any actual images that
demonstrate the superiority of 16 bit editing should raise some interest
among at least some people.

April 14th, 2006 has all but passed, but there is a chance that April 15th,
2006 will be the day that, out of the millions of photographs taken every
day, an image that edits better in 16 bits than 8 bits finally turns up.
Signature

Mike Russell
www.curvemeister.com

Pete Mitchell - 15 Apr 2006 08:32 GMT
>> I was recently faced with the prospect of buying a wide-format printer.
>> Canon had the W6400 - HP had their offerings - and Epson had the 7800.
[quoted text clipped - 8 lines]
> at any printed images from the printers you were considering, and seen
> differences between them?

Funnily enough I'd never seen an image from the one I ended up buying, but I
did see some from it's predecessor - I also relied heavily on reviews -
in-depth reviews. The Canon sales rep printed off one of my images using a
local customers machine, but he presented it with quite a few creases in the
paper - and it didn't reproduce some of the colours accurately. They kept
saying things like "I'm sure these things can be tweaked" - but the message
I was getting was that they really didn't understand the game, and were more
interested in making a sale that selling me something that would meet my
needs.

> April 14th, 2006 has all but passed, but there is a chance that April
> 15th, 2006 will be the day that, out of the millions of photographs taken
> every day, an image that edits better in 16 bits than 8 bits finally turns
> up.

Yeah - what we REALLY need is 64 bit editing - that'll make a difference as
noticeable as night and day ;)
Mike Russell - 15 Apr 2006 08:48 GMT
[re choosing between printers by (not) looking at images]

> Funnily enough I'd never seen an image from the one I ended up buying, but
> I did see some from it's predecessor - I also relied heavily on reviews -
[quoted text clipped - 5 lines]
> were more interested in making a sale that selling me something that would
> meet my needs.

Well, then kudos for at least making the right decision.  Perhaps your
leanings toward 16 bit image superiority have a similar incisive and
intuitive validity.  I myself must rely on more prosaic evidence.

> Yeah - what we REALLY need is 64 bit editing - that'll make a difference
> as noticeable as night and day ;)

LOL.  32 bit cameras, anyway, may not be far away.  Then we can take this
discussion to a new plane.  Photoshop already supports HDR images, floating
point pixel representations with 23 bits of  mantissa and 8 bits of
exponent.  The hardware is exerting its own pressure on our thinking, and
the types of things we do with our images.
Signature

Mike Russell
www.curvemeister.com

Johan W. Elzenga - 15 Apr 2006 13:16 GMT
> > Yeah - what we REALLY need is 64 bit editing - that'll make a difference
> > as noticeable as night and day ;)
>
> LOL.  32 bit cameras, anyway, may not be far away.

I think 32 bit cameras are quite far away. Right now, most cameras are
only 12 bits, not even 14 bits or 16 bits. Why? Because a 16 bits A/D
converter is too costly or too difficult to make? No, because the ANALOG
sensor in front of it doesn't have a signal to noise ratio that
justifies more than 12 bits.

Signature

Johan W. Elzenga           johan<<at>>johanfoto.nl
Editor / Photographer      http://www.johanfoto.nl

Timo Autiokari - 15 Apr 2006 11:35 GMT
> April 14th, 2006 has all but passed, but there is a chance that April 15th,
> 2006 will be the day that, out of the millions of photographs taken every
> day, an image that edits better in 16 bits than 8 bits finally turns up.

Editing in 16-bit/c absolutely has benefits, always. As a simple test
try editing in 1-bit/c, 2-bit/c, 3-bit/c etc. You will notice that the
image quality does get improved as you increase the bit-depth. (use
Image/Adjustment/Posterize to decrease the bit-depth).

The benefit tends to get lesser and lesser as you increase the
bit-depth. Is 8-bit/c enough then? Look at the difference of R=G=B=127
and R=G=B=128 (create such large patches side by side) in AdobeRGB, you
will be able to visually differentiate them on the CRT. So 8-bit is very
coarse. Then using the Curves, increase the contrast of that test graph
(similarly like you increase the contrast of normal images, apply a
slight s-shape using the Curves) now the the these patches are very
easily differentiated visually.

And as you continue to apply the basic editing steps the 8-bit/c
quantization will happen at each of the steps, making the image more an
more coarse (the quantization noise is added by each of the editing steps).

Mr. Margulis expressly acknowledged the superiority of 16-bit editing in
his tragi-comic 16-bit challenge (was it in 2002), in the rules of his
challenge he insisted that he will fist convert the raw 16-bit/c image
down to 8-bit/c, and then immediately back to 16-bit/c and the very
reason for this was the 8-bit/c quantization errors (although he did
express that with more "colorful" vocabulary).

So 16-bit editing is always beneficial, even if the original data was
only 8-bit/c. Simply convert the 8-bit/c image data to 16-bit/c mode and
do editing there and you will often, if not always, see benefits.
Depends of course on the "strength" of the editing that you do.

Now, there are still two other questions:

1) does the 16-bit/c image data contain more useful/relevant image
information than what the 8-bit/c version of that same image contain?

2) If there are more useful/relevant image information in the 16-bit/c
image data then in what situations will this benefit bee seen in the
normal photographic images? And in what way it will be seen.

The current high end digital cameras (and scanners) have typically
12-bit analog-to-digital converters. The role of these ADC devices is to
convert the (analog) signal from the sensor into the digital world. The
bit-depth of the ADC is _not_ the (equivalent) bit-depth of signal that
the imaging sensor provides. It is the dynamic range of the sensor that
define the (equivalent) bit-depth of signal. This (equivalent) bit-depth
 is then further reduced slightly/somewhat by the nonlinearities and
noise that the ADC produce.

The current high end digital cameras (and scanners) have sensors that
have less than 9 f/stops dynamic range (so less than 9 bits). Such
12-bit ADC will properly digitize that signal and since the dynamic
range is limited by the noise the 3 to 4 lower most ADC bits will
contain just noise.

So, when considering the dynamic range there is not much benefit in
having image data from the less than 9-bit sensor that was digitized by
an 12-bit ADC and finally scaled by the acquire device (or the raw
converter) to the 16-bit/c Photoshop space (that truthfully is just
15-bit/c) compared to the case where we have image data from the less
than 9-bit sensor that was digitized by an 12-bit ADC and finllay scaled
by the acquire device (or the raw converter) to 8-bit/c Photoshops
space. The extra noise that there is in the 16-bit/c workflow is a small
benefit here, it will smooth the quantization steps somewhat, however it
is possible to add similar noise in the 8-bit/c workflow in the
post-processing.

The above however is simplification since the signal/noise ratio is not
constant over the whole tonal range. In other words the (overall)
dynamic range is not the only quality measure. The signal to noise ratio
generally is the worst in the dark end of the range and improves all the
way up to the light end. A sensor that has 9-bit dynamic range can have
somewhat better signal/noise ratio (locally) in the lighter portions of
the tonal range, from the midtones to highlights, could be one or even
two bits more.  Therefore the 16-bit/c image from high end imaging
devices inherently do have better quality than what the 8-bit/c version
of such images have. This is especially so when working in non-linear
(gamma 1.8 or 2.2. or 2.5) RGB working-spaces where the tonal range from
the midtones to highlights and severely compressed (by 2 to 3 bits).

So when is this 16-bit/c quality benefit seen then? In the case where
the acquire device image is accepted nearly as it is (only very weak
editing is applied) then there will not be much, if at all, visible
benefit on the CRT. On the flat panels some slight benefit could
possible be seen since they are profiled by far mode complex and coarse
ICC profiles than what the CRTs are. An ICC profile conversion can be
very rude on the data, equivalent to a series of very severe editing
steps and in the path to the monitor the ICC conversions are performed
internally in 8-bit/c. More benefits will often be seen on prints,
printer profiles are always extremely rude on the image data. However
Photoshop allows to perform printer profiling internally in the 16-bit/c
space so the final 8-bit/c data that is sent to the printer will be
notably more more smooth compared to data that can be had from the
8-bit/c version.

Mainly the 16-bit/c benefit is seen (and it is easily seen already on
the CRT) after the image data has been more strongly edited. Such
editing steps include strong Curves, density masking (or "opening up the
shadows"), strong USM etc. With more elaborated techniques the 16-bit/c
the benefits are glaringly seen, e.g in my work I shoot rather high
dynamic range still objects and the detail in the shadows must be
clearly visible with low noise so I shoot either 8 or 16 images, then
average them and finally use strong density masking to open up the
shadows. Another typical example is when I need to enhance a faint
surface anomaly that is not visible for the unaided-eye, from the
16-bit/c average it can be enhanced amazingly well. Also in the common
photography the 16-bit/c benefits are usually seen such situations,
lesser noise in the shadow areas that have been "opened up" and in large
smooth areas like the blue sky and smooth surfaces like body of the car
etc, as the lack of banding and less noisier appearance.

Timo Autiokari
http://www.aim-dtp.net
Mike Russell - 15 Apr 2006 11:43 GMT
...
> Editing in 16-bit/c absolutely has benefits, always.
...
> Mainly the 16-bit/c benefit is seen (and it is easily seen already on the
> CRT) after the image data has been more strongly edited.
...
If this is the case, it should be easy to provide an image.

Remember, stick with the common working spaces - Adobe RGB, etc. No fancy
gamma or wide gamut color spaces.
Signature


Mike Russell
www.curvemeister.com

Johan W. Elzenga - 15 Apr 2006 14:05 GMT
> > Editing in 16-bit/c absolutely has benefits, always.
> ...
[quoted text clipped - 5 lines]
> Remember, stick with the common working spaces - Adobe RGB, etc. No fancy
> gamma or wide gamut color spaces.

Color spaces (and conversions between them) are part of our work,
whether we like it or not. I've seen quite a few images where the 16
bits version gives a better conversion to my Epson 7600 printer spaces
(seen in soft proof) than the 8 bits version. Especially the 'matt
black' ink spaces seem to benefit. The shadows block less quickly in the
16 bits conversion. That may not prove that there is a benifit in
*editting* in 16 bits, but it does mean there can be a benefit in
*working* in 16 bits.

Signature

Johan W. Elzenga           johan<<at>>johanfoto.nl
Editor / Photographer      http://www.johanfoto.nl

Mike Russell - 15 Apr 2006 20:07 GMT
>> > Editing in 16-bit/c absolutely has benefits, always.
>> ...
[quoted text clipped - 15 lines]
> *editting* in 16 bits, but it does mean there can be a benefit in
> *working* in 16 bits.

Again - got image?
Signature


Mike Russell
www.mike.russell-home.net

Johan W. Elzenga - 15 Apr 2006 23:30 GMT
> > Color spaces (and conversions between them) are part of our work,
> > whether we like it or not. I've seen quite a few images where the 16
[quoted text clipped - 6 lines]
>
> Again - got image?

Of course. How could I see this if I didn't have the image?

Signature

Johan W. Elzenga           johan<<at>>johanfoto.nl
Editor / Photographer      http://www.johanfoto.nl

Pete Mitchell - 15 Apr 2006 11:50 GMT
** Waits for Mike's reply ** :)
Siggy - 15 Apr 2006 12:44 GMT
> ** Waits for Mike's reply ** :)

I can't see whose post you are referring to, but don't you mean Timo's. :-?
Mike Russell - 15 Apr 2006 12:50 GMT
>> ** Waits for Mike's reply ** :)
>
> I can't see whose post you are referring to, but don't you mean Timo's.
> :-?

I think he's poking fun at me for responding so quickly to posts.  What can
I say - it's true.  :-)

Timo is likely to come up with some images, and my guess is they'll be
interesting ones.
Signature

Mike Russell
www.curvemeister.com

Pete Mitchell - 15 Apr 2006 12:56 GMT
> I think he's poking fun at me for responding so quickly to posts.  What
> can I say - it's true.  :-)

No no - not at all. I just thought his post would be like waving a red flag
to a bull :) (plus the chap knows more than I'll ever know about the topic -
damn - and just when I thought I had it all sorted in my head too :(
Pete Mitchell - 15 Apr 2006 12:58 GMT
>> ** Waits for Mike's reply ** :)
>
> I can't see whose post you are referring to, but don't you mean Timo's.
> :-?

(Unfortunately, whilst I was typing my cheeky reply, Mike was also posting -
and he beat me to it - which made it a  bit confusing. Sorry about that).
Siggy - 15 Apr 2006 13:15 GMT
>>> ** Waits for Mike's reply ** :)
>>
[quoted text clipped - 4 lines]
> posting - and he beat me to it - which made it a  bit confusing. Sorry
> about that).

Ah so! ;-)
Siggy - 15 Apr 2006 11:43 GMT
> I happen to enjoy Dan's style.  He's the most entertaining and literary
> personalities in the Photoshop world, and if he's a bit testy about 16 bit
> versus 8 bit, I think it's understandable.

8<

Yes, I forgot to add that I had a good chuckle. Very engaging stuff, not to
mention courageous, especially when you look at the 'names' he is up
against. I actually became quite shocked at how patronising they were to him
and was in no small way reminded of the once very British attitude of some
(nay most?) of our medical profession. Everything once was to be taken on
trust and nothing should be questioned. It is very good to see there are
still some who are steadfastly and politely prepared to stand their ground
and bring these types down a peg or two. Far more liberating for
technologies sake too, IMO.

I may be completely wide of the mark here, but isn't there something about
this in your own product, Mike?
I kind of sense Wide Gamut CMYK has met with some 'resistance' too?
Pete Mitchell - 15 Apr 2006 12:13 GMT
> I actually became quite shocked at how patronising they were to him

Keeping in mind though that that was only Dan's record of what took place.
In a court of law they don't send the jury out for their deliberations after
hearing from only the prosecution.
Mike Russell - 15 Apr 2006 12:31 GMT
>> I actually became quite shocked at how patronising they were to him
>
> Keeping in mind though that that was only Dan's record of what took place.
> In a court of law they don't send the jury out for their deliberations
> after hearing from only the prosecution.

It is not accurate to characterize this simply as a controversy, or as an
adversarial clash of authorities.

If 16 bits is better, there should be some images to demonstrate this that
will be plain to a 6 year old.

Signature

Mike Russell
www.curvemeister.com

Pete Mitchell - 15 Apr 2006 12:53 GMT
>>> I actually became quite shocked at how patronising they were to him
>>
[quoted text clipped - 4 lines]
> It is not accurate to characterize this simply as a controversy, or as an
> adversarial clash of authorities.

I'm not - I'm just politely suggesting that it's unfair to discount one
group of experts in favour of another without appreciating that they may
well have a different story to tell, especially when it's at a level that's
waaaaay over my head.

It's obvious to me that it's a pretty emotive topic for him - and in such
situations it's pretty rare to have someone say "Actually, the other guy has
been fair and reasonable at all times and has presented fair and reasonable
arguments".

If you've got a few spare moments do a Google on Gary North and have a read
of how we're all doomed come "year 2000" - many of his arguments appeared
well researched - authoritive - believeable - and no-one was able to
disprove what he said. He also turned out to be totally wrong (not to
mention a fruitcake). [eg: The y2k crisis is systemic. It cannot possibly be
fixed. I think it will wipe out every national government in the West. Not
just modify them- destroy them. I honestly think the Federal government will
go under. I think the U.S.A. will break up the way the U.S.S.R. did. Call me
a dreamer. Call me an optimist. That's what I think. ]
Mike Russell - 15 Apr 2006 20:20 GMT
From: "Pete Mitchell" <unsubscribe@hotmail.com>

>>>> I actually became quite shocked at how patronising they were to him
>>>
[quoted text clipped - 9 lines]
> well have a different story to tell, especially when it's at a level
> that's waaaaay over my head.

I'm suggesting that whether the emperor has clothes or not is not over
anyone's head at all - if there is a difference there should be an example.

> It's obvious to me that it's a pretty emotive topic for him - and in such
> situations it's pretty rare to have someone say "Actually, the other guy
> has been fair and reasonable at all times and has presented fair and
> reasonable arguments".

Stepping back from the personalities, it should be possible to come up with
an image that proves, once and for all that the difference between 16 and 8
bits per channel is, say as noticeable as the difference between an
uncompressed image and a jpeg.  No such example exists, and whatever the
emotions involved, this strikes me as the bedrock of any discussion
involving image manipulation and quality.

> If you've got a few spare moments do a Google on Gary North and have a
> read of how we're all doomed come "year 2000" - many of his arguments
[quoted text clipped - 6 lines]
> U.S.S.R. did. Call me a dreamer. Call me an optimist. That's what I
> think. ]

I sat in on one of these presentations in 1999 or so, and it was very
convincing indeed.  As a member of the software community, I witnessed this
from both sides, and I remain appalled at the fearmongering that went on.

Your example of y2k is an intersting one that boils down to the same thing
as the 8 vs 16 bit discussion.  Both involve the well-known  impossibility
of proving the negative.

It is not possible to prove that there is no advantage, ever, to editing an
image in 16 bits per channel.  All that can be said is that no one, after
several years, has an example image to offer.

Likewise, it was impossible to prove that there would be no y2k disaster
until y2k had passed.
---
Mike Russell
www.curvemeister.com
Paul Furman - 15 Apr 2006 22:27 GMT
> Stepping back from the personalities, it should be possible to come up with
> an image that proves, once and for all that the difference between 16 and 8
> bits per channel is, say as noticeable as the difference between an
> uncompressed image and a jpeg.  No such example exists, and whatever the
> emotions involved, this strikes me as the bedrock of any discussion
> involving image manipulation and quality.

This is not exactly the can of worms I was originally opening, but
similar. With regards to high bit *processing*, Roger Clark's example is
rather dramatic.
http://www.clarkvision.com/imagedetail/raw.converter.shadow.detail
Roger N. Clark (change username to rnclark) - 15 Apr 2006 23:53 GMT
>> Stepping back from the personalities, it should be possible to come up
>> with an image that proves, once and for all that the difference
[quoted text clipped - 7 lines]
> rather dramatic.
> http://www.clarkvision.com/imagedetail/raw.converter.shadow.detail

While my work is extremely busy right now, I did do a couple
of experiments and will add the results to the web page in a couple
of weeks (maybe sooner).  I also read the Dan Margulis thing.
I didn't know there was such a controversy going on!

The interesting thing I did was go back to my
raw image and converted it to an 8-bit tif using photoshop
CS2.  Then did the same stretching to show shadow
detail.  Guess what?  Look at Figure 8 on the above page.
I got the same result!!!!  Actually, one might even pick the
8-bit tif as some of the darker parts are clipped to
lower values giving the impression of more range.
Then I did the same thing with the camera generated
jpeg.  Guess what?  It LOOKS BETTER than the 8-bit or 16-bit
tif that was photoshop processed!  But neither comes close
to the ImagesPlus 64-bit processing.

Like I've said in other posts, photoshop does 15-bit processing
and I believe that is causing some issues with the "16-bit"
processed data.  I've been experimenting doing more and more
processing in ImagesPlus as it does scientifically correct
math (64-bit processing, but I don't believe that 64 or even 32
bits are really warranted-it's more the math).

I think this experiment shows that the main reason people have been
having trouble with Margulis' challenge is not that 16-bits is not
better, but the funny way photoshop processes data.

I would use ImagesPlus for all processing but it doesn't have
selections, let alone feathered selections, nor does it do
color management.  But mathematically, it does levels, upsizing,
saturation correctly and has many great filters and image restoration
tools not available at all in photoshop.  So I do the major processing steps
in ImagesPlus then to photoshop for minor tweaks and color
management and ICC profiles for output.  I did that on this image:
http://www.clarkvision.com/galleries/gallery.bird/web/great.blue.herons.the.kiss
.JZ3F8149.f-700.html

and was amazed how simple my work flow became and that I had so
little work to do in noise suppression of the background (none,
when I normally have had to do a lot).  I need to go back and
work the image using photoshop only and show the resulting difference,
which I believe will be significant.

Now, on Margulis' side, I agree that many images do not need 16-bits,
and you can produce good images with 8-bits.  I have. In fact
most of my images are 8-bit, even 8-bit jpegs!  I have
placed in Natures Best international competitions with 8-bit
jpegs.  Most of my bear images are 8-bit jpegs, and
I make 16x24 inch prints from them:
http://www.clarkvision.com/galleries/gallery.bear

But now that I've found the differences in photoshop's 15-bit
math versus real image processing, I find I can produce
better images from true 16+ bit processing.

Scientifically this makes sense.  The argument for 16 versus
8 bit processing is well established in the scientific image
processing community (of which I am a member).  I don't
use photoshop for any scientific image processing, and some
photoshop tools do scientifically incorrect math, like
addition when they should be doing a multiply (like
the contrast tool).  Then add the 15-bit trick, which, I think,
is to avoid negative numbers, and speed processing, it compromises
high signal-to-noise data like we are seeing from modern DSLRs.
The fact that it hasn't become too much of an issue is that
the gamma encoding scheme is really pretty good and enable a
high dynamic range sufficient precision to not show artifacts
very often.

But some of Margulis' rants are wrong (as are some of the posts
by others).  The signal to noise and dynamic range discussions
are generally incorrect.  This is partly because people are analyzing
data after going through the gamma correction and these
raw converters that are doing funny things to the data
as shown on my page above.  The raw conversion is averaging
adjacent pixels in the Bayer pattern, but the sensor/camera does
not do this in the raw data, on either Canon or Nikon cameras
that I have tested.

True dynamic range is shown on these two pages (and greater than
11 stops is common on better DSLRs; the 1D Mark II gets 11.6 stops):

 Procedures for Evaluating Digital Camera Noise and
 Full Well Capacities; Canon 1D Mark II Analysis
 http://www.clarkvision.com/imagedetail/evaluation-1d2

 The Signal-to-Noise of Digital Camera images
 and Comparison to Film
 http://www.clarkvision.com/imagedetail/digital.signal.to.noise

Roger
Roger N. Clark (change username to rnclark) - 16 Apr 2006 07:34 GMT
>> http://www.clarkvision.com/imagedetail/raw.converter.shadow.detail

I updated the page to include 8-bit tif processing and 8-bit
jpeg processing.  The 8-bit tif photoshop processing
produces almost identical results to 16-bit tif photoshop
processing (really 15-bit).  the 8-bit in camera generated
raw showed better shadow detail than the photoshop CS2 8 or 16-bit
raw converter.  But ImagesPlus with better math and
64-bit processing produces much better shadow details and color
in the shadows.

Roger
C J Southern - 16 Apr 2006 09:14 GMT
Can you believe that Google has indexed that page already!

Quick question - can you point me to the imagesplus 2.5 website? I've never
heard of it, and can't seem to find a link to them.
Paul Furman - 16 Apr 2006 09:28 GMT
> Quick question - can you point me to the imagesplus 2.5 website? I've never
> heard of it, and can't seem to find a link to them.

http://www.mlunsold.com/
Pete Mitchell - 16 Apr 2006 01:33 GMT
>> I'm not - I'm just politely suggesting that it's unfair to discount one
>> group of experts in favour of another without appreciating that they may
[quoted text clipped - 4 lines]
> anyone's head at all - if there is a difference there should be an
> example.

But that's still the danger when people read one article from Dan (pointing
out how badly he's been treated by the others), without hearing what the
others have to say.

How would you feel about Dan's "poor treatment" if the likes of Bruce Fraser
came back and said "I've sent the guy LOTS of images, but he keeps
disqualifying them for one reason or another - did he not mention that?"? of
if Thomas Knoll pops up and says "doing 50 conversions between RGB and LAB
and back is meaningless unless you restart photoshop between conversions
because it's smart enough to simply revert to a previously saved state
rather than re-converting the image"?

Dan may well be right - or he may well be wrong - there may well be
thousands of photos floating around that illustrate the point - MY point is
that I don't know and I'm not qualified to judge. As a member of the jury
though I want to be fair - and for me that means waiting until I've heard
from the defence as well as the prosecution.
Mike Russell - 16 Apr 2006 02:08 GMT
>>> I'm not - I'm just politely suggesting that it's unfair to discount one
>>> group of experts in favour of another without appreciating that they may
[quoted text clipped - 8 lines]
> (pointing out how badly he's been treated by the others), without hearing
> what the others have to say.

Again, you appear to be couching this in terms of a verbal argument, and not
one of seeing for yourself.

> How would you feel about Dan's "poor treatment" if the likes of Bruce
> Fraser came back and said "I've sent the guy LOTS of images, but he keeps
> disqualifying them for one reason or another - did he not mention that?"?

I've seen a number of examples from Bruce Fraser.  Most, if not all of them,
involve artificial gradients and not photographs and are therefore of zero
interest to photographers.

>  of if Thomas Knoll pops up and says "doing 50 conversions between RGB and
> LAB and back is meaningless unless you restart photoshop between
> conversions because it's smart enough to simply revert to a previously
> saved state rather than re-converting the image"?

If you care about the truth or falsity of Dan's statement, why not try it
yourself?  It takes less than a minute.  What Thomas Knoll, or anyone else,
says is irrelevant because you have the means to recreate the experiment.

> Dan may well be right - or he may well be wrong - there may well be
> thousands of photos floating around that illustrate the point - MY point
> is that I don't know and I'm not qualified to judge. As a member of the
> jury though I want to be fair - and for me that means waiting until I've
> heard from the defence as well as the prosecution.

This is a poor analogy.  A court proceeding is an adversarial, verbal
exercise that has almost no relevance to scientific determination.

I suggest that each of us is well capable of deciding, on our own, whether
we can see the difference between editing in 8 versus 16 bit per channel.
Take one of your images, edit it in 16 bits - then convert the original to 8
bits and repeat the same thing.  Can you see the difference?

So far there have been examples of photographs that do better in hibit -
monochrome images, gamma 1.0 images, and images that are in highly stretched
color spaces such as ProPhoto RGB.  I have seen no examples of actual color
images in the usual color spaces that benefit from hibit editing.

I'm reminded of the fact that the patent office no longer requires models,
except in one category - perpetual motion.  Taking my cue from this, I'll
let any further hand waving about hibit simply stand, hoping that people
will recognize whether talk is backed up by images or not, and reserve my
comments only when they are illustrated by actual example images.
Signature


Mike Russell
www.curvemeister.com

Pete Mitchell - 16 Apr 2006 02:43 GMT
Mike, I think you've slipped off on a tangent - if you go back a few posts
you'll see that I was only commenting on Siggy comment of "being shocked at
how the others treated Dan" - with my response being (paraphrasing) "you
need to hear both sides - how Dan says he's been treated by the others may
well be different from the others recollection of the events".
Siggy - 16 Apr 2006 11:27 GMT
> Mike, I think you've slipped off on a tangent - if you go back a few posts
> you'll see that I was only commenting on Siggy comment of "being shocked
> at how the others treated Dan" - with my response being (paraphrasing)
> "you need to hear both sides - how Dan says he's been treated by the
> others may well be different from the others recollection of the events".

When I said I was 'shocked', I did not wish to necessarily imply I had
reached a 'verdict' on the substantive issue. ;-)

I guess my emotional response (because I have no scientific background
whatsoever in this area) was that I now realise I had been beguiled by all
the hype about 16bit and wide gamut working spaces. Now that it is clear
that only some images can derive *apparant* benefit from this technology at
the output stage, based on my shooting needs I can now save myself some
considerable workflow time and digital real-estate by sticking with 8bit
'finals' in future. As long as I have the original RAW, then I should also
keep myself future-proof.

Nigel
Paul Furman - 16 Apr 2006 03:17 GMT
> So far there have been examples of photographs that do better in hibit -
> monochrome images, gamma 1.0 images, and images that are in highly stretched
> color spaces such as ProPhoto RGB.  I have seen no examples of actual color
> images in the usual color spaces that benefit from hibit editing.

"images that are in highly stretched color spaces such as ProPhoto RGB"

So there are disadvantges to large color spaces? I guess that you need
to use 16 bit with them.
Pete Mitchell - 16 Apr 2006 03:25 GMT
>> So far there have been examples of photographs that do better in hibit -
>> monochrome images, gamma 1.0 images, and images that are in highly
[quoted text clipped - 6 lines]
> So there are disadvantges to large color spaces? I guess that you need to
> use 16 bit with them.

For me it's pretty much a moot point - I've got enough CPU grunt to make
changes in both 8 or 16 bit appear virtually instantaniously - the extra
size or a 16 bit is file isn't an issue as the images are written to CD when
I'm finished and then deleted - the few filters that are 8 bit only aren't
ones that I ever use - and general consensus is that, as you quote, there
can be an issue with some aspects of large spaces (when I open some images I
have no idea if, for example, I'll have to replace a sky with a graduated
fill) - so, for me anyway, I'd be quite happy if Adobe were to hard-code a
16 bit working environment.

For me, 16 bit is the safer option, with zero downside.
Dave - 16 Apr 2006 10:19 GMT
>For me, 16 bit is the safer option, with zero downside.

Mike made is as easy as:

>This is a poor analogy.  A court proceeding is an adversarial, verbal
>exercise that has almost no relevance to scientific determination.

>I suggest that each of us is well capable of deciding, on our own, whether
>we can see the difference between editing in 8 versus 16 bit per channel.
>Take one of your images, edit it in 16 bits - then convert the original to 8
>bits and repeat the same thing.  Can you see the difference?

and all our novices are awaiting the first one to take up Mike's
reasonable challenge:-)

Dave
Mike Russell - 16 Apr 2006 13:05 GMT
>> So far there have been examples of photographs that do better in hibit -
>> monochrome images, gamma 1.0 images, and images that are in highly
[quoted text clipped - 6 lines]
> So there are disadvantges to large color spaces? I guess that you need to
> use 16 bit with them.

Yes - though examples are rare, there are images where editing ProPhoto in
16 bits gives superior results to editing in 8 bit.

There's some interesting history here.  ProPhoto was originally called ROMM
RGB, for Reference Output Medium Metric, and was used by Kodak in its early
film digitizing efforts.

Later, it's name was changed to ProPhoto RGB, and Kodak has been promoting
ProPhoto as a color space for manipulating film and digital images.
http://www.scarse.org/docs/kodak/ProPhoto.pdf

I don't advocate using ProPhoto, and I think that people who do use it will
be at a slight disadvantage, but the choice is yours to make.
Signature

Mike Russell
www.curvemeister.com

Johan W. Elzenga - 16 Apr 2006 10:12 GMT
> > How would you feel about Dan's "poor treatment" if the likes of Bruce
> > Fraser came back and said "I've sent the guy LOTS of images, but he keeps
[quoted text clipped - 3 lines]
> involve artificial gradients and not photographs and are therefore of zero
> interest to photographers.

On page 24-25 of his RAW book, Bruce Fraser gives an example of 8 bits
versus 16 bits that seems to qualify all your requirements. It's a
normal photograph, and the corrections seem not to be excessive at all.
Of course I do not know whether he secretly manipulated much more than
he says, but if you would suggest that he did so just to make a point,
you would treat Fraser the same way Dan says he's been treated. Quite
frankly I don't see the point in this controversy. If you don't see a
difference, then don't use 16 bits. If you do see it, do use it. No big
deal. I don't need Bruce's or Dan's permission to make my workflow the
way I prefer it.

Signature

Johan W. Elzenga           johan<<at>>johanfoto.nl
Editor / Photographer      http://www.johanfoto.nl

Philip Homburg - 16 Apr 2006 10:47 GMT
>On page 24-25 of his RAW book, Bruce Fraser gives an example of 8 bits
>versus 16 bits that seems to qualify all your requirements. It's a
>normal photograph, and the corrections seem not to be excessive at all.
>Of course I do not know whether he secretly manipulated much more than
>he says, but if you would suggest that he did so just to make a point,
>you would treat Fraser the same way Dan says he's been treated.

I think for easy verification of his claim, the images would have to be
on-line.

>Quite
>frankly I don't see the point in this controversy. If you don't see a
>difference, then don't use 16 bits. If you do see it, do use it. No big
>deal. I don't need Bruce's or Dan's permission to make my workflow the
>way I prefer it.

I don't think that Dan's point was about giving permission. It was about
verifying the claim that 16-bit is somehow better. If 16-bit processing is
good for B/W images, for computer generated images, and for extreme color
space than it is good idea to avoid 8-bit programs (such a gimp) for those
applications. If 8-bit/ch is good enough for anything else, there is no
need to restrict yourself to programs that can handle 16-bit/ch.

For my own software I simply use 32-bit floating point. And I use 16-bit
mode in Photoshop. But I have to admit, that whenever there is such a
discussion I am often tempted to 'prove' that 16-bit is better, and I
usually fail.

Signature

That was it. Done. The faulty Monk was turned out into the desert where it
could believe what it liked, including the idea that it had been hard done
by. It was allowed to keep its horse, since horses were so cheap to make.
    -- Douglas Adams in Dirk Gently's Holistic Detective Agency

Mike Russell - 16 Apr 2006 11:38 GMT
...
> On page 24-25 of his RAW book, Bruce Fraser gives an example of 8 bits
> versus 16 bits that seems to qualify all your requirements. It's a
> normal photograph, and the corrections seem not to be excessive at all.

This is the owl picture. in "Camera Raw with Adobe Photoshop CS2", pp 24-25.

These images were created differently, one completely in Camera Raw, and the
other exported as an 8 bit image to Photoshop, using unspecified
manipulations.  The original image, as far as I know, is not available.
This is not enough of a comparison for me, or anyone else, to recreate what
he did.

> Of course I do not know whether he secretly manipulated much more than
> he says, but if you would suggest that he did so just to make a point,
> you would treat Fraser the same way Dan says he's been treated.

I consider Bruce Fraser to be one of the great people in color correction.
That said, I cannot recreate what he has done, based on the four images in
the book, and I doubt anyone else here can either.

> Quite
> frankly I don't see the point in this controversy. If you don't see a
> difference, then don't use 16 bits. If you do see it, do use it. No big
> deal. I don't need Bruce's or Dan's permission to make my workflow the
> way I prefer it.

Here we are in 100 percent agreement.  I think everyone has the capability
to make these determinations, and not rely on any authority to do so, and I
think you have advocated this consistently in your previous writings here.
Signature

Mike Russell
www.curvemeister.com

Siggy - 16 Apr 2006 15:30 GMT
8<

> Quite frankly I don't see the point in this controversy. If you don't see
> a
> difference, then don't use 16 bits. If you do see it, do use it. No big
> deal. I don't need Bruce's or Dan's permission to make my workflow the
> way I prefer it.

I wish it were that simple. Some of us, me included, need to be able to take
a lead. I simply don't have the time (or probably even the nouse!) to make
the qualitative and somewhat exhaustive comparative assessments necessary to
build an ideal workflow and start being productive.
We-pays-the-money-to-buy-the-books-that-pays-for-the-experiments-conducted-by-'experts'.
If someone, considered as an authority, tells me the Emporer is wearing new
clothes, I won't necessarily decide to go out into the street and look at
him to see if he is naked. After having done all that, only to be told later
by *a witness* that I had just wasted my money, is a little galling. Still,
Caveat Emptor, and all that jazz.

Nigel
Johan W. Elzenga - 16 Apr 2006 17:32 GMT
> I wish it were that simple. Some of us, me included, need to be able to
> take a lead. I simply don't have the time (or probably even the nouse!) to
[quoted text clipped - 6 lines]
> that, only to be told later by *a witness* that I had just wasted my
> money, is a little galling. Still, Caveat Emptor, and all that jazz.

In that case, use 16 bits. Even if nobody has ever proven beyond any
doubt that 16 bits is better than 8 bits, it certainly hasn't been
suggested that it's the other way around.

Signature

Johan W. Elzenga           johan<<at>>johanfoto.nl
Editor / Photographer      http://www.johanfoto.nl

Pete Mitchell - 16 Apr 2006 23:07 GMT
> In that case, use 16 bits. Even if nobody has ever proven beyond any
> doubt that 16 bits is better than 8 bits, it certainly hasn't been
> suggested that it's the other way around.

That's been my take on it as well. If one suspects that 8 bit would do the
job, but one KNOWS that 16 will do it - and the side effects of size and
(possibly) speed are non-issues, why not just go with the one thats got all
the bases covered? In terms of my own images it's one of those "set and
forget" type things.
Roger N. Clark (change username to rnclark) - 17 Apr 2006 02:59 GMT
>>In that case, use 16 bits. Even if nobody has ever proven beyond any
>>doubt that 16 bits is better than 8 bits, it certainly hasn't been
[quoted text clipped - 5 lines]
> the bases covered? In terms of my own images it's one of those "set and
> forget" type things.

Well, here is a counter example:  Compare Figures 8, 13 and 14 at:
http://www.clarkvision.com/imagedetail/raw.converter.shadow.detail

The in camera generated jpeg shows more shadow detail than the
8 or 16-bit tif generated files using Photoshop CS2 (from ACR
raw conversion).  The jed also shows better colors in the
shadows than the Rawshooter essentials 2005 16-bit generated tif.

Roger
Mike Russell - 17 Apr 2006 03:14 GMT
...
> http://www.clarkvision.com/imagedetail/raw.converter.shadow.detail
...
Roger,

Thanks for adding some new information to the mix.  This does not happen
often.

and with example images!
Signature

Mike Russell
www.curvemeister.com

Johan W. Elzenga - 17 Apr 2006 10:03 GMT
> > That's been my take on it as well. If one suspects that 8 bit would do the
> > job, but one KNOWS that 16 will do it - and the side effects of size and
[quoted text clipped - 9 lines]
> raw conversion).  The jed also shows better colors in the
> shadows than the Rawshooter essentials 2005 16-bit generated tif.

That may well be, but that is not an 8 bits versus 16 bits issue. It's a
Canon internal software versus Adobe ACR or Raw Shooters issue.

Signature

Johan W. Elzenga           johan<<at>>johanfoto.nl
Editor / Photographer      http://www.johanfoto.nl

Roger N. Clark (change username to rnclark) - 17 Apr 2006 14:08 GMT
>>>That's been my take on it as well. If one suspects that 8 bit would do the
>>>job, but one KNOWS that 16 will do it - and the side effects of size and
[quoted text clipped - 12 lines]
> That may well be, but that is not an 8 bits versus 16 bits issue. It's a
> Canon internal software versus Adobe ACR or Raw Shooters issue.

Yes, and that is the point.  But one has to wonder why ACR or
RawShooter can't at least equal an 8-bit jpeg.  It seriously
calls into question the effectiveness of the software, and
has implications for the 8 versus 16-bit discussion that
has become quite controversial.

Roger
Johan W. Elzenga - 17 Apr 2006 17:11 GMT
> >>The in camera generated jpeg shows more shadow detail than the
> >>8 or 16-bit tif generated files using Photoshop CS2 (from ACR
[quoted text clipped - 9 lines]
> has implications for the 8 versus 16-bit discussion that
> has become quite controversial.

No, I don't think it has any implications for the 8 bits/16 bits
discussion, unless Canon's own Digital Photo Professional would not get
the same amount of detail out of its RAW files. As long as that has not
been proven, all it means is that Canon knows its own RAW files better
than Adobe or Pixmantics does, which comes as no surprise to me.

Signature

Johan W. Elzenga           johan<<at>>johanfoto.nl
Editor / Photographer      http://www.johanfoto.nl

Roger N. Clark (change username to rnclark) - 18 Apr 2006 02:58 GMT
>>>>The in camera generated jpeg shows more shadow detail than the
>>>>8 or 16-bit tif generated files using Photoshop CS2 (from ACR
[quoted text clipped - 15 lines]
> been proven, all it means is that Canon knows its own RAW files better
> than Adobe or Pixmantics does, which comes as no surprise to me.

I do believe that it does have implications for the 8 versus 16 bit
discussion.  There has been a challenge to produce a 16-bit flow
that shows images clearly better than an 8-bit work flow.  It hasn't
been done.   Perhaps the reason is that the 16-bit software really
isn't getting and maintaining the information, thus limiting
the test.  That is what the data on that page shows.  Did you read the
whole page?  People are trying to use specific software to get
certain processing but if that software has hidden issues, the results
and comparisons may not be what they believe.

Roger
Paul Furman - 18 Apr 2006 05:48 GMT
>>>>> The in camera generated jpeg shows more shadow detail than the
>>>>> 8 or 16-bit tif generated files using Photoshop CS2 (from ACR
[quoted text clipped - 26 lines]
> certain processing but if that software has hidden issues, the results
> and comparisons may not be what they believe.

Johan has a point. The camera's internal processing probably uses 32 bit
or whatever it is to convert the raw file. The question of 8-vs-16 is
about additional processing after getting it out of raw. Do we even know
how ACR processes? Not the same as core photoshop probably. Once the raw
converter is done it doesn't matter wheter it's output in 8 or 16 unless
you plan to more heavy stretching.
Philip Homburg - 18 Apr 2006 08:49 GMT
>I do believe that it does have implications for the 8 versus 16 bit
>discussion.  There has been a challenge to produce a 16-bit flow
[quoted text clipped - 5 lines]
>certain processing but if that software has hidden issues, the results
>and comparisons may not be what they believe.

That doesn't make sense. The discussion started when somebody claimed that
16-bit was so much better in the average case, that it would be 'amateurish'
to use 8-bit processing.

Now obviously, you would expect those people to have some software that
actually shows those benefits.

Apparently, the benefits of 16-bit processing have been shown for gray
scale and computer generated images, and for large gamut spaces such as
ProPhoto RGB.

So, to demonstrate that Adobe Photoshop makes a mess of things, you only
have to put a 16-bit/ch file online together with some instructions for
processing that demonstrate the effects.

That different raw converters give different results should not surprise
anybody.

Signature

That was it. Done. The faulty Monk was turned out into the desert where it
could believe what it liked, including the idea that it had been hard done
by. It was allowed to keep its horse, since horses were so cheap to make.
    -- Douglas Adams in Dirk Gently's Holistic Detective Agency

timo.autiokari@aim-dtp.net - 18 Apr 2006 12:17 GMT
> There has been a challenge to produce a 16-bit flow
> that shows images clearly better than an 8-bit work flow.

If you refer to the "challenge" laid down by Mr. Margulis some years
ago then the above is not correct.

Mr. Margulis insisted himself that he will first do conversion to
8-bit/c that is immediately followed by conversion to 16-bit/c, in
order to avoid the cumulating 8-bit/c quantization errors.

So his challenge is not at all about 8-bit/c versus 16-bit/c
_workflow_, by the above requirement in his challenge he indeed agrees
that the 16-bit/c workflow is superior, as it definitely is. He is only
challenging the capture capabilities of the acquire devices.

> Perhaps the reason is that the 16-bit software really
> isn't getting and maintaining the information, thus limiting
> the test.  That is what the data on that page shows.

That is not what your page perhaps shows. Photoshop has a range of
15bits + 1 level (so 32769 levels alltogether, from level 0 to level
32768)  and it does maintain what ever image information you put into
that range.

But with the curent high end digital cameras you only get 9 bits (or
less) of (useful) image data (even if the analog to digital converter
in them is 12-bit or 14 bit deep) so you are correct in that Photoshop
is not getting such data that would show benefit in the above mentioned
challenge.

> People are trying to use specific software to get certain processing
> but if that software has hidden issues, the results and comparisons
> may not be what they believe.

That is indeed so and Photoshop truly has several hidden (or not well
known) issues. But not maintaining the image information in the higher
bit-depth mode is not among them.

Also the internal processing in the digital cameras have hidden issues
and even the raw camera data is rather strongly processed data, people
who are trying e.g. to measure the dynamic range of these devices get
results and comparisons that are not what they believe them to be.

Timo Autiokari
http://www.aim-dtp.net
Roger N. Clark (change username to rnclark) - 19 Apr 2006 00:42 GMT
>>Perhaps the reason is that the 16-bit software really
>>isn't getting and maintaining the information, thus limiting
[quoted text clipped - 4 lines]
> 32768)  and it does maintain what ever image information you put into
> that range.

I disagree with this.  For my work I do scientific imaging
(NASA aircraft and spacecraft) and work with true 16, 32, and
64-bit processing systems.  I have processed some of my
photographs in 64-bit systems and do see a difference
with what photoshop produces.  After a number of corrections
in photoshop, the images begin to take on a "pasty"
look.  The result is subtle but obvious the more work
I do in real high bit systems.  For example, see Figure 7
on this page:
http://www.clarkvision.com/imagedetail/image-restoration1
and examine the fox's fur to the upper left of the eye.
Compare the left most image of the figure (not done in
photoshop) with the middle (photoshop).  Note that the
fine detail in the mid tones are smooth in the photoshop
version.  With noisy data this pasty look is hidden, but with
high signal-to-noise ratio data from DSLRs, the problem
is showing.

> But with the curent high end digital cameras you only get 9 bits (or
> less) of (useful) image data (even if the analog to digital converter
> in them is 12-bit or 14 bit deep) so you are correct in that Photoshop
> is not getting such data that would show benefit in the above mentioned
> challenge.

Perhaps with some cameras, but not the ones I have tested or
those tested and used by other astronomers.  The Canon 1D Mark II
has a measured dynamic range of 3190 = 11.6 stops at ISO 100.
See Table 1, column G at:
 Procedures for Evaluating Digital Camera Noise and Full
 Well Capacities; Canon 1D Mark II Analysis
 http://www.clarkvision.com/imagedetail/evaluation-1d2

This page shows data and references for other cameras:
http://www.clarkvision.com/imagedetail/digital.signal.to.noise

This page shows an image where the intensity ranges over
10 stops within a single scene; see Figure 6b:
 Dynamic Range of an Image
 http://www.clarkvision.com/imagedetail/dynamicrange

Another pages with test data that shows over 10 stops of dynamic
range:
 Dynamic Range and Transfer Functions of Digital Images
 and Comparison to Film
 http://www.clarkvision.com/imagedetail/dynamicrange2

>>People are trying to use specific software to get certain processing
>>but if that software has hidden issues, the results and comparisons
[quoted text clipped - 8 lines]
> who are trying e.g. to measure the dynamic range of these devices get
> results and comparisons that are not what they believe them to be.

I agree with the issues of measuring dynamic range, and signal-to-noise
ratios.  Most people are doing so on raw converted data that has
been massaged by the raw converter they used.  But you can extract
the true raw data before any Bayer interpolation artifacts
are introduced with the correct software.  The Canon raw
data is truly raw.  Nikon raw data appears to be raw
except it has been quantized to something like 663
levels (I forget the exact number), but it is still
linear and representative of the sensor noise and linearity.

Roger
Timo Autiokari - 19 Apr 2006 17:32 GMT
I took the liberty of changing the subject line since the content has
changed.

> For example, see Figure 7 on this page:
> http://www.clarkvision.com/imagedetail/image-restoration1

So, you present the above as a proof that the Photoshop 15-bit/c space
is somehow faulty. But the Photoshopped version is damaged by the use of
a huge radius.

Below I show how it is done properly in Photoshop, the result is equal
or even better than your Adaptive Richardson-Lucey version.

Step by step instructions so you can test it yourself:

1) downloaded your fox.c01.06.2004.JZ3F3731.frmraw-crop1a.b.tif, it is
16-bit data in the sadRGB profile. (it is btw a failure to store better
than 8-bit/c data as sadRGB since the sadRGB has lookup table transfer
function that has only 1024 points)

2) Converted it to 'CIE 1931 d65 gamma 1.0' profile using AdobeACE
engine, Relative Colorimetry intent, no blackpoint compensation.

3) Scaled it up by 200%, using Bicubic interpolation. (2x interpolation
is required per your page).

4) Applied USM with A=500, R=0.5 and T=0

5) Converted it to sadRGB profile using AdobeACE engine, Relative
Colorimetry intent, no blackpoint compensation, no dither.

6) Converted it to 8-bit/c

7) Saved it as JPG, quality 12

8) uploaded as:
http://www.aim-dtp.net/aim/temp/fox.c01.06.2004.JZ3F3731.frmraw-crop1a.b_timo.jpg

Timo Autiokari
Mike Russell - 19 Apr 2006 18:11 GMT
...
> Step by step instructions so you can test it yourself:
>
[quoted text clipped - 13 lines]
> 8) uploaded as:
> <http://www.aim-dtp.net/aim/temp/fox.c01.06.2004.JZ3F3731.frmraw-crop1a.b_timo.jpg>

Very nice, Timo!  It's not that often that I see something here that I have
to immediately go and experiment with.  This is one of them.

Thanks!
Signature

Mike Russell
www.curvemeister.com

Roger N. Clark (change username to rnclark) - 20 Apr 2006 03:03 GMT
> I took the liberty of changing the subject line since the content has
> changed.
[quoted text clipped - 8 lines]
> Below I show how it is done properly in Photoshop, the result is equal
> or even better than your Adaptive Richardson-Lucey version.

I disagree that it is even equal.  Its is very good compared to what most
others have submitted to me.  (Bill Hilton submitted one that is equal
using a Bill Atkinson action that uses edge detection).  In your
sample, the hairs are slightly greater in width than the RL image,
but pretty close.  Also, look at the iris of the eye which
shows a clear difference.  Then a huge difference with Figure 8
which combines bot RL and unsharp mask.

Photoshop unsharp mask is not the only processing that gives pasty
results.  I plan to do a more rigorous study but work demands
too much time right now.  When I do get it done, I'll post
results.

Roger

> Step by step instructions so you can test it yourself:
>
[quoted text clipped - 22 lines]
>
> Timo Autiokari
Rich - 20 Apr 2006 16:09 GMT
>> I took the liberty of changing the subject line since the content has
>> changed.
[quoted text clipped - 23 lines]
>
>Roger

Where would you like images sent to?
Thanks
-Rich
Rich - 20 Apr 2006 15:48 GMT
>I took the liberty of changing the subject line since the content has
>changed.
[quoted text clipped - 21 lines]
>3) Scaled it up by 200%, using Bicubic interpolation. (2x interpolation
>is required per your page).

One thing I can't figure out.  If you scale-up the image he provides
in order to work on it, the pixel size on-screen is twice that if his
previously scaled-up image.  Therefore, it is impossible to make it
as sharp.  How is the image scaled (bicubic, etc, all produce the same
result) so that the pixel count increases by a factor of 4 and the
pixels remain the same size?
Despite this problem, I got "close" to what he did using
Pixel Magic.
Thanks
-Rich

Timo Autiokari - 19 Apr 2006 17:59 GMT
I took the liberty of changing the subject line for this since the
content does not match with the original subject line.

> The Canon 1D Mark II has a measured dynamic range of
> 3190 = 11.6 stops at ISO 100. See Table 1, column G at:
> Procedures for Evaluating Digital Camera Noise and Full
> Well Capacities; Canon 1D Mark II Analysis
> http://www.clarkvision.com/imagedetail/evaluation-1d2

The two image method simply does not give correct results. The
blackpoint of the camera is not steady from shot to shot and it does per
shot noise reduction at the sensor level, minimal differences in the
dark end between the two shots will result very large errors with this
technique.

The dynamic range can only be evaluated from a single shot.

I to use the Mark II, I have measured the DR to be about 8.5 f/stops at
ISO=100 (so about 362:1). I have two Q60 color input targets under even
soft illumination and I place a neutral density filter in between, half
way so that the gray range of the other target is imaged through the ND
filter, it is rather easy to calculate the DR from this.

Timo Autiokari
http://www.aim-dtp.net
eawckyegcy@yahoo.com - 19 Apr 2006 19:00 GMT
>  > The Canon 1D Mark II has a measured dynamic range of
>  > 3190 = 11.6 stops at ISO 100. See Table 1, column G at:
[quoted text clipped - 3 lines]
>
> The two image method simply does not give correct results.

It's not "two image", it's more like "20 image" (or more, and this is
per ISO setting).

Also note that I have data that matches Clark's more or less exactly.

> The blackpoint of the camera is not steady from shot to shot and it does per
> shot noise reduction at the sensor level, minimal differences in the
> dark end between the two shots will result very large errors with this
> technique.

Clark lays out his apparatus and method clearly.  Did you read them?
Where is this "two shot" business coming from?

> The dynamic range can only be evaluated from a single shot.

The exposure control via shutter and aperture (while holding scene
illumination fixed) is vastly more precise and repeatable than
attempting to modulate the scene.  Even worse, we have the problem:

> I to use the Mark II, I have measured the DR to be about 8.5 f/stops at
> ISO=100 (so about 362:1). I have two Q60 color input targets under even
> soft illumination and I place a neutral density filter in between, half
> way so that the gray range of the other target is imaged through the ND
> filter, it is rather easy to calculate the DR from this.

You've probably measured the DR of your target + filter, not the
camera.  Even an infinite DR camera would probably end up being
measured as "8.5 stops" here.

I suggest you repeat Clark's experiment as he describes -- it takes an
hour or so to collect the data and another to make the plots and fit
some lines.  What is he doing wrong?  Can your model explain his data?
Roger N. Clark (change username to rnclark) - 20 Apr 2006 03:16 GMT
> I took the liberty of changing the subject line for this since the
> content does not match with the original subject line.
[quoted text clipped - 21 lines]
> Timo Autiokari
> http://www.aim-dtp.net

Hmm, what is wrong with this picture?  Your data says 8.5 stops
maximum dynamic range at ISO 100, and my data shows 11.6 stops.
But you say my method produces produces large errors.  The errors
you cite would increase the noise and make my determination
of dynamic range too low.  Thus, by your argument my range of
11.6 should be even higher.

Second, the two image method is not dependent on level shifts
between the two images.  When you subtract two images, you get
two things: an average level and noise about that average.
I analyze the noise, not the average difference.  So your assertion
is incorrect.  You can prove this yourself by taking two
images, adding a constant, subtract them and analyze the
standard deviation from pixel to pixel.  Add a different
constant and analyze again.  You get the same standard
deviation.

Third, this method is the standard method developed years ago
by electronic engineers to study CCD properties, and is
the preferred method in use today.  If you checked the
references, you would have found that.

Fourth, you ignored two other test pages where data from
a single image shows over 10 stops of dynamic range.

Your 8.5 stops maximum is in error.

Roger
timo.autiokari@aim-dtp.net - 20 Apr 2006 08:39 GMT
> Hmm, what is wrong with this picture?

Actually what is wrong is your definition: "Column G = maximum signal /
read noise" that you label as the "Dynamic Range".

Sure, this is one of the definitions of DR and sure it is a very good
definition for the DR for many other sensing systems (like of
microphones, pressure sensors, temperature sensors etc) but it does not
properly characterize sensors that are sensing light. Light has a
particular kind of noise itself, the Poisson noise (Photon noise, Shot
Noise).

So, your maximum_signal / read_noise tells you only what kind of
quality you will get at the proximity of the saturation level of the
sensor (for the most light/bright surfaces). It does not _at all_
characterize the capture range of the digital camera.

Since the Poisson noise is squarely related to the signal your column H
does quite accurately estimate the capture range of the camera, you
state S/N ratio of 230:1 that equals to 7.85 f/stops. In the reality,
from a single shot evalation, the Mark II does a little better, about
8.5 f/stops.

> Second, the two image method is not dependent on level shifts
> between the two images.  When you subtract two images, you get
> two things: an average level and noise about that average.
> I analyze the noise, not the average difference.

The two shot method is only usable with acquire devices that give you
true sensor data, e.g. more than 10 year old scanners. Evaluation from
a single shot is always much more reliable.

Yes, you do analyze the noise, but you need to factor in the
characteristics of the light, either by experiment or by theory.

And even when you area analyzing the noise at the proximity of the
saturation level of the sensor your 11.6 f/stops can not be correct
given the 12-bit analog-to-digital converter in the camera. What you
see is the effect of the noise reduction that the camera does by
hardware.

Timo Autiokari
Don - 20 Apr 2006 12:36 GMT
Come on Roger, your turn.   I am enjoying this thread and learning lots.
This type of measured discussion and argument is a great way to learn.

regards to both Roger and Timo

Don from Down Under

>> Hmm, what is wrong with this picture?
>
[quoted text clipped - 38 lines]
>
> Timo Autiokari
RiceHigh - 20 Apr 2006 14:33 GMT
If one want to measure the DR in EVs, a test chart of adjacent patterns
with reflectance which are doubled/halved in values along the chart
should be shot and then one could see how many stops the DSLR can
actually record.

However, the Exposure Value (it's again EV) chosen, i.e., the mid-gr