Home | Contact Us | FAQ | Search & Site Map | Link to Us
Sign In | Join | Other 45 Sites in Network
PhotoKB Home
Discussion Groups
Digital Photography
Digital PhotoDSLR CamerasZLR CamerasPoint & Shoot Cameras
Film Photography
35 mmLarge FormatMedium formatDarkroomFilm and LabsOther Equipment
Photo Technique
Nature PhotographyPeople PhotographyTechnique General
General Photo Topics
General TopicsAustralian PhotographyUK Photography
DirectoryPhoto Clubs

Photo Forum / Digital Photography / DSLR Cameras / February 2006

Tip: Looking for answers? Try searching our database.

Back-up/Archive of Digital Photographs...Suggestions?

Thread view: 
Enable EMail Alerts  Start New Thread
Thread rating: 
pgrogan@gmail.com - 29 Jan 2006 06:06 GMT
What are people doing for the long term storage of digital photos?

CDs/DVDs have a life of about 2-5 years
Hard Drives 3-5 years

Am I supposed to back up my personal photos to tape?
C J Southern - 29 Jan 2006 07:56 GMT
I write mine to CD - not sure where you get 2 - 5 years from - my research
suggests quality brands are rated somewhere in the region of 75 years (if
cared for properly), with a new range rated at 300 years.

DVDs on the other hand I'm a bit more weary of.
nrh - 29 Jan 2006 11:06 GMT
<snipped>

> DVDs on the other hand I'm a bit more weary of.

More sleep needed then, perhaps? ;-)

Nigel
Peter - 29 Jan 2006 19:20 GMT
>I write mine to CD - not sure where you get 2 - 5 years from - my research
>suggests quality brands are rated somewhere in the region of 75 years (if
>cared for properly), with a new range rated at 300 years.

Really? I'd seriously doubt these figures. No CD-R has lasted more than
couple of years on me.

Peter
C J Southern - 29 Jan 2006 20:34 GMT
> >I write mine to CD - not sure where you get 2 - 5 years from - my
> >research suggests quality brands are rated somewhere in the region of 75
> >years (if cared for properly), with a new range rated at 300 years.
>
> Really? I'd seriously doubt these figures. No CD-R has lasted more than
> couple of years on me.

Perhaps you've got an undiagnosed issue with your writer? I can't say I've
ever had an issue with even the cheap brands.

I accept that the published figures are usually maximum figures, but
none-the-less I would expect that something thats designed to last 300 years
shouldn't have an issue lasting the next 30 or 40 years I've got left on
this planet.
Jeremy Nixon - 29 Jan 2006 23:14 GMT
> Really? I'd seriously doubt these figures. No CD-R has lasted more than
> couple of years on me.

I have CD-Rs that have been sitting in my car, undergoing the extreme
temperature changes of a car interior, longer than that.  In fact, I have
yet to have a CD-R go bad on me.  For some reason, I still don't really
trust them as a long-term backup solution.

But the real problem with them (and with DVDs) is that they don't store
enough data to be useful for backing up images.  I'd need a pretty big
stack of DVDs to make a single backup of my image library.  Hard drives
are the only practical solution.

Signature

Jeremy  |  jeremy@exit109.com

David Dyer-Bennet - 30 Jan 2006 05:35 GMT
> >I write mine to CD - not sure where you get 2 - 5 years from - my research
> >suggests quality brands are rated somewhere in the region of 75 years (if
> >cared for properly), with a new range rated at 300 years.
>
> Really? I'd seriously doubt these figures. No CD-R has lasted more than
> couple of years on me.

Then something really weird is going on.  My oldes CD-Rs are over 10
years old, and I haven't had a single one go bad on me yet.
Signature

David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/>
RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/>
Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/>
Dragaera/Steven Brust: <http://dragaera.info/>

pgrogan@gmail.com - 30 Jan 2006 06:25 GMT
Are your CD-Rs music, pics or data?  And what brand did you use?  I
hear that Verbatim discs are best for long term survival
David Dyer-Bennet - 30 Jan 2006 16:32 GMT
> Are your CD-Rs music, pics or data?  And what brand did you use?  I
> hear that Verbatim discs are best for long term survival

Entirely data -- but data includes music and pictures, in my
parlance.  They're disks intended to be read by computers, containing
computer files.  

I've used a wide variety of CD-R media, with the most important files
going on Kodak Gold Ultima disks.  I know I've used Imation disks, and
Memorex, and Verbatim, and K Hypermedia, and various generics.  
Signature

David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/>
RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/>
Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/>
Dragaera/Steven Brust: <http://dragaera.info/>

pgrogan@gmail.com - 30 Jan 2006 06:28 GMT
Are your CD-Rs music, pics or data?  And what brand did you use?  I
hear that Verbatim discs are best for long term survival
Dana H. Myers - 30 Jan 2006 08:05 GMT
>> I write mine to CD - not sure where you get 2 - 5 years from - my research
>> suggests quality brands are rated somewhere in the region of 75 years (if
>> cared for properly), with a new range rated at 300 years.
>
> Really? I'd seriously doubt these figures. No CD-R has lasted more than
> couple of years on me.

While I might question a 300-year permanence for current CD-R media,
I do have more than a few CD-Rs here that I wrote 5+ years ago, and
read without detectable error.  Sounds like you might be getting
especially poor permanence - how are you storing your CD-Rs?

Dana
C J Southern - 30 Jan 2006 20:00 GMT
> While I might question a 300-year permanence for current CD-R media,
> I do have more than a few CD-Rs here that I wrote 5+ years ago, and
> read without detectable error.  Sounds like you might be getting
> especially poor permanence - how are you storing your CD-Rs?

The 300 year variety are a new product coming out in the next couple of
months - 75 years seems to be the figure most often mentioned for the better
brands today.
pgrogan@gmail.com - 30 Jan 2006 02:25 GMT
Here is my source:

http://computerworld.com/hardwaretopics/storage/story/0,10801,107607,00.html

I doubt seriously that any CD/DVD burnt on a home computer is going to
last 75 years.
Proconsul - 30 Jan 2006 02:34 GMT
> Here is my source:
>
> http://computerworld.com/hardwaretopics/storage/story/0,10801,107607,00.html
>
> I doubt seriously that any CD/DVD burnt on a home computer is going to
> last 75 years.

The "expert" who wrote that article is braindead....and wrong.....

I've got CDs that are older than five years that are still perfect....

Nothing lasts forever, but I don't buy the "short life" described in
the article.....

PC
Robert R Kircher, Jr. - 30 Jan 2006 13:59 GMT
> Here is my source:
>
> http://computerworld.com/hardwaretopics/storage/story/0,10801,107607,00.html
>
> I doubt seriously that any CD/DVD burnt on a home computer is going to
> last 75 years.

This one article has caused such a stir in the media world it's
unbelievable.  I wouldn't be surprised if we don't find out that our Mr.
Gerecke has some stake it a new media format about to hit the market.

When every I'm asked about this from my clients I point to this article
http://www.popphoto.com/article.asp?section_id=4&article_id=1492&page_number=1

Also, I point to work  I've done for the US Library of Congress related to
their image archiving in which they use CD for storage.

Lastly, if you go out to the NIST and LoC websites and do a search you will
find guidelines on the use of CD as a storage/archival media.

Here are the facts as I see them.  Just like any media, tape, hard drive,
vinyl records, if not handled properly it will fail.  As already pointed
out, I have CD's burned years ago both data and music that work today and
I've taken no extraordinary steps to keep these CDs.  On the other hand I've
had CDs that simply don't work after time.  BUT, I've had the same issue
with what is widely excepted as the only archival media TAPE.

Lastly, since media and file formats are bound to change over time the idea
of long term storage of you images is sort of misguided.  Eventually we'll
all have to migrate our data to the latest file system/technology.  As long
as your media of choice still works at this point you're in good shape.  My
solution is redundancy.  I have multiple copies of my images on multiple
media including USB drives and DVD.  My main storage is a RAID-5 on my
server (this can be done on the desktop as well).  This gives me 3+
opportunities to recover from storage disasters.  The chances of not
recovering data with such redundancy is slim to none.

Signature

Rob
"A disturbing new study finds that studies are disturbing"

Roger N. Clark (change username to rnclark) - 30 Jan 2006 15:08 GMT
> When every I'm asked about this from my clients I point to this article
> http://www.popphoto.com/article.asp?section_id=4&article_id=1492&page_number=1
[quoted text clipped - 8 lines]
> opportunities to recover from storage disasters.  The chances of not
> recovering data with such redundancy is slim to none.

Robert,
Good advice.  But a warning on raid 5: it CAN fail.  At work I
had a raid 5 box with fifteen 250 GByte hard drives configured as
2 raid 5 arrays.  The fan went out and the hard drives cooked,
with complete failure on multiple drives, losing all data.
Fortunately, we had them backed up to raid 5 arrays in another
building.  I also had critical components on DVD (the raid arrays
were not full, but more than I would copy to DVD, so only part
was on DVD).

It just illustrates, backup backup backup.

Roger
Robert R Kircher, Jr. - 30 Jan 2006 16:11 GMT
>> When every I'm asked about this from my clients I point to this article
>> http://www.popphoto.com/article.asp?section_id=4&article_id=1492&page_number=1
[quoted text clipped - 20 lines]
>
> It just illustrates, backup backup backup.

No doubt as any storage device can fail but the key is to reduce you chances
of data loss.  As you point out in your example, the chances of all you
storage methods going belly up at the same time are nil so when your RAID
did crash you were able to recreate it and the data.  Same in my enviornemt
as I have my data on USB drive and DVD in the event that the RAID or server
crashes.  As a mater of fact I have two USB drives that are "mirrored".
(using MS's Synctool power toy.

Signature

Rob
"A disturbing new study finds that studies are disturbing"

> Roger
Richard - 11 Feb 2006 00:30 GMT
He could well be right.

I've just discovered that quite a few of my photographic CDs burned 4
years ago are now corrupted and partly unreadable.

All the affected CDs are roughly half OK and half dud, and all of them
PNY make.

I've been running a recovery utility for over a week now on two CDs on
two PCs, with little success.

I could tear my hair out, but it wouldn't help!

Richard.

>Here is my source:
>
>http://computerworld.com/hardwaretopics/storage/story/0,10801,107607,00.html
>
>I doubt seriously that any CD/DVD burnt on a home computer is going to
>last 75 years.
John Tserkezis - 29 Jan 2006 09:26 GMT
> What are people doing for the long term storage of digital photos?
>
> CDs/DVDs have a life of about 2-5 years
> Hard Drives 3-5 years
>
> Am I supposed to back up my personal photos to tape?

 Tape would be a good albeit expensive option.

 For small operations, I use and suggest a USB drive case to keep a duplicate
of sensitive data.  Don't rely on the drive holding all your stuff without it
being stored elsewhere too.

 The drive gets plugged in every week or so, so even though it gets power
cycled often in relation to its life, overall, it'll last longer than leaving
it in all the time.

 I never bought into the CD/DVD life expectancies of many years, I wouldn't
trust them past several years.  If it's any more, it's an unexpected bonus.
Sure they're probably getting better, but I'm not going to trust them just to
find out that disk fails at the most inopportune moment.

 Personally, I have a raid-5 redundant setup.  Every time a drive fails, I
replace it.  No data loss, with no downtime.  (well, there's two days of
background re-syncronising to restore the raid setup though) So as long as
they keep selling SATA drives over the years, I can keep my data intact.
Signature

Linux Registered User # 302622
<http://counter.li.org>

C J Southern - 29 Jan 2006 09:34 GMT
> So as long as they keep selling SATA drives over the years, I can keep my
> data intact.

It's still a risky proposition, unless you're also taking other precautions.
Have you considered ...

- Fire?
- Theft?
- Malfunction (software? controller?) that scrambles some/all critical data
areas?
- Power spike / PSU Malfunction - fries all drives in 1 foul swoop.

I've had clients who have lost data through all of these means.
nrh - 29 Jan 2006 11:05 GMT
<snipped>

>  - Power spike / PSU Malfunction - fries all drives in 1 foul swoop.

Bird flu, perhaps? ;-)

Nigel.
Peter - 29 Jan 2006 19:20 GMT
>>  - Power spike / PSU Malfunction - fries all drives in 1 foul swoop.
>
> Bird flu, perhaps? ;-)

Or even worse... fish flu! 8-D
Tom - 30 Jan 2006 05:33 GMT
>>> - Power spike / PSU Malfunction - fries all drives in 1 foul swoop.
>>>      
[quoted text clipped - 5 lines]
>
>  

just watch out for chimney flu..  when that one burns out it could take
everything.

:-O

Does anyone use a remote backup service?  If so do you encrypt your
stuff first? Cost?
wilt - 30 Jan 2006 16:57 GMT
>> So as long as they keep selling SATA drives over the years, I can keep my data intact. <<

I have been around computing since the 70's when 8K of core memory was
$10k.  If you have been involved in personal computing since the early
80's as I have, the many drive types that have come and gone will make
you know about the eventual obsolescence of a particular interface
and/or drive technology is inevitable (although admittedly SCSI has
been around a very long time).   So when SATA disappears, do you have
envision how data will migrate form your RAID with SATA drives to a new
RAID with LATESTTECH drives?

I've not been confident about burnable anythings, and right now I use a
USB harddrive, so I'm not up to date on RAID that is available today,
which is why I'm curious.
David Dyer-Bennet - 30 Jan 2006 17:17 GMT
> >> So as long as they keep selling SATA drives over the years, I can keep my data intact. <<
>
[quoted text clipped - 6 lines]
> envision how data will migrate form your RAID with SATA drives to a new
> RAID with LATESTTECH drives?

Just the same way I migrated it from PATA to SATA last November.
Which was the same way I went from a 116GB drive to a 160GB drive the
year or so before that.  

(The RAID is irrelevant, really, so long as your computer can suppport
both devices at once.)

> I've not been confident about burnable anythings, and right now I use a
> USB harddrive, so I'm not up to date on RAID that is available today,
> which is why I'm curious.

Variety is good.  I currently have my online working copy on SATA,
backups on two different Firewwire external drives, local CD or DVD
copies, and off-site CD or DVD copies.  
Signature

David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/>
RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/>
Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/>
Dragaera/Steven Brust: <http://dragaera.info/>

Philip Homburg - 29 Jan 2006 12:17 GMT
>What are people doing for the long term storage of digital photos?
>
>CDs/DVDs have a life of about 2-5 years
>Hard Drives 3-5 years
>
>Am I supposed to back up my personal photos to tape?

I use three removable harddisks.
- One is off site, and gets replaced with a more up-to-date version every
 month.
- One is in the safe, and gets replaces with a more up-to-date version
 every week.
- One is in my computer and gets an update at night (my computer is always
 on for e-mail, web, etc. Otherwise, you have to remember to sync the
 disk before you to turn off the computer).

Of course, Murphy will figure out a way to destroy all 4 copies of my data.
So making enough prints is probably a good idea too.

Signature

That was it. Done. The faulty Monk was turned out into the desert where it
could believe what it liked, including the idea that it had been hard done
by. It was allowed to keep its horse, since horses were so cheap to make.
    -- Douglas Adams in Dirk Gently's Holistic Detective Agency

nrh - 29 Jan 2006 12:53 GMT
> I use three removable harddisks.
> - One is off site, and gets replaced with a more up-to-date version every
>   month.
> - One is in the safe, and gets replaces with a more up-to-date version
>   every week.
<snipped>

Wow! Can I have all the discarded one's please! I have to make mine last
around 3 YEARS! ;-)

Nigel
Jim Redelfs - 29 Jan 2006 17:27 GMT
> What are people doing for the long term storage of digital photos?

I use two, 250gb hard-disk drives, each partitioned in thirds.

> CDs/DVDs have a life of about 2-5 years

Huh?  I'd like to see your reference on that.  While it is generally accepted
that optical media has a finite life span, I understand it is MUCH longer than
that.

I believe that the TECHNOLOGY to access data from an optical disk created
TODAY will be nonexistent well before the data becomes corrupt.

> Hard Drives 3-5 years

Magnetic technology.  I'll buy that.

> Am I supposed to back up my personal photos to tape?

Nah.  That's just more magnetic media, albeit OLD and slow.

In any case, one should UPGRADE their archives to current technology AT LEAST
every 5-7 years.
Signature

           :)
JR

Michael Johnson, PE - 29 Jan 2006 17:52 GMT
>> What are people doing for the long term storage of digital photos?
>
[quoted text clipped - 5 lines]
> that optical media has a finite life span, I understand it is MUCH longer than
> that.

I have RW DVD's that I used for archiving 5+ years ago that are
perfectly fine.  If they are stored properly and handled with care they
will last a very long time, IMO.

> I believe that the TECHNOLOGY to access data from an optical disk created
> TODAY will be nonexistent well before the data becomes corrupt.
>
>> Hard Drives 3-5 years
>
> Magnetic technology.  I'll buy that.

I have old 2-3 gigabyte IDE hard drives that are nearly 10 years old
that still have there original files.  All that is needed is to hook
them up to an IDE connection and they even boot up to the old Windows
3.11 operating system (severely driver impaired though). :)

>> Am I supposed to back up my personal photos to tape?
>
> Nah.  That's just more magnetic media, albeit OLD and slow.

You got that right.  I HATED tape backup drives.  Talk about unreliable,
they were by far the worst backup system I every used.

> In any case, one should UPGRADE their archives to current technology AT LEAST
> every 5-7 years.

I think any backup system that utilizes a USB connection will be good
for a number of years.  I think this means of data transfer will be
around for years and years with very good backwards compatibility for
current USB connections built into future computer systems.
Michael Johnson, PE - 29 Jan 2006 17:56 GMT
> I have RW DVD's that I used for archiving 5+ years ago that are
> perfectly fine.  If they are stored properly and handled with care they
> will last a very long time, IMO.

I meant to say RW CD's.
Father Kodak - 30 Jan 2006 05:34 GMT
>> Nah.  That's just more magnetic media, albeit OLD and slow.
>
>You got that right.  I HATED tape backup drives.  Talk about unreliable,
>they were by far the worst backup system I every used.

If tape is that unreliable, then why is tape the technology standard
for corporate data backup?  Of course, corporate data centers aren't
using "toy" tape drives like Travans.  

A good tape backup solution is going to cost you, for both the drives
AND the media.  But tape will last easily 20 years before going bad.
Recorded CDs?  Perhaps?  Recorded DVDs at today's state of the art?
No.

The big crisis in photography will come when people discover that all
their carefully Photoshopped images are no longer retrievable from CDs
and DVDs.  

If you were willing to spend money and effort to ensure that you
stored your negatives and slides under good conditions, why do
anything less for digital images?  

Father Kodak
Michael Johnson, PE - 30 Jan 2006 06:25 GMT
>>> Nah.  That's just more magnetic media, albeit OLD and slow.
>> You got that right.  I HATED tape backup drives.  Talk about unreliable,
[quoted text clipped - 3 lines]
> for corporate data backup?  Of course, corporate data centers aren't
> using "toy" tape drives like Travans.  

For my small consulting firm using the tape backup systems that large
corporations used wasn't practical as it was with nearly all small
businesses in general.  What I used was slow and unreliable.  The best
thing tape had going for it was cheap media cost and storage capacity.
Beyond that it totally sucked.  The first system that was truly user
friendly and fast while being affordable was hot-swappable hard disks.

> A good tape backup solution is going to cost you, for both the drives
> AND the media.  But tape will last easily 20 years before going bad.
> Recorded CDs?  Perhaps?  Recorded DVDs at today's state of the art?
> No.

I don't know how someone can say this since the technology hasn't been
around for 20+ years.  I have music CDs that are nearly 20 years old and
not one has gone bad, ever.  I have never had a DVD go bad.  I do think
one should avoid the bargain basement discs though but even they will
likely last a good while if stored and handled properly.

> The big crisis in photography will come when people discover that all
> their carefully Photoshopped images are no longer retrievable from CDs
> and DVDs.

If someone doesn't bother to update their stored data to newer
technologies when they become available, then they shouldn't complain
when their data is irretrievable.  It must not have been that important
then.  This is why I said storage devices that use the USB interface
looks to be a good backup choice for long term compatibility.  Heck, the
floppy drive is still around after how many years?

> If you were willing to spend money and effort to ensure that you
> stored your negatives and slides under good conditions, why do
> anything less for digital images?  

I personally don't think the brand of storage media is as critical as
the storage conditions and handling during retrieval.
pgrogan@gmail.com - 30 Jan 2006 06:40 GMT
I have been doing some research on this & yes, there is a difference in
the brands that are used for DVD and CD burning.  Manufacturers use
differnet types of dyes with different characteristics. Some last
longer than others, some withstand heat better, some withstand light
better....etc etc. Also, remember that the store bought CDs and DVDs
are very differnet than what you burn on your computer.
Michael Johnson, PE - 30 Jan 2006 17:34 GMT
> I have been doing some research on this & yes, there is a difference in
> the brands that are used for DVD and CD burning.  Manufacturers use
> differnet types of dyes with different characteristics. Some last
> longer than others, some withstand heat better, some withstand light
> better....etc etc. Also, remember that the store bought CDs and DVDs
> are very differnet than what you burn on your computer.

I have noticed that some of the really cheap discs are very sensitive to
scratching.  A minor abrasion can actually remove the recoding media
from the disc.  The best ones appear to be those with a good, tough
coating on the side of the disc containing the recording media.
David Dyer-Bennet - 30 Jan 2006 18:02 GMT
> > I have been doing some research on this & yes, there is a difference in
> > the brands that are used for DVD and CD burning.  Manufacturers use
[quoted text clipped - 7 lines]
> media from the disc.  The best ones appear to be those with a good,
> tough coating on the side of the disc containing the recording media.

Let's keep the terminology straight, though.

The actual "recording media" is dyes embedded in the plastic.  That's
not what gets damaged or comes off.

What gets easily scratched or comes off on burnable CD and DVD disks
is the *reflective* layer, which is on top of the disk (you're writing
on it when you label your disks).

And yes, damaging the reflective layer is the easiest way to render
these disks unreadable.  The good gold archival disks also come with a
protective layer over the reflective layer, which makes such damage
harder to cause.
Signature

David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/>
RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/>
Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/>
Dragaera/Steven Brust: <http://dragaera.info/>

-hh - 30 Jan 2006 11:22 GMT
> I don't know how someone can say this since the technology hasn't been
> around for 20+ years.  I have music CDs that are nearly 20 years old and
> not one has gone bad, ever.

IIRC, commercial music CD's use a different encoding process
(technology) than what you get with a CD-R burner...as such, you're
comparing apples to oranges.

> If someone doesn't bother to update their stored data to newer
> technologies when they become available, then they shouldn't complain
> when their data is irretrievable.

The problem is twofold:

1.  The rate of change in digital technology is much higher than
traditional film, which has meant that the reliance on some specfic
solution will have a shorter effective life.

While there has been 'format'-like changes with 35mm, these were
generally limited to the scope of responsibility of the commercial
developer/printer, and were not disseminated down to every individual
photographer which creates a archive management nightmare due to this
splintering effect (You're on CD's, Aunt Mabel is on 3.5" floppies,
Uncle Bob is on ZIP 250's...good luck!).

2.  Merely having success in retaining the image data is not enough.
The process fails when any one piece of the process - - between the
original image and the printing of a physical print (or equivalent) - -
fails.

Its easy to merely say that we'll just use JPEG or TIFF for our format,
as these will "always" be readable by future image management
applications, or we'll say that we'll use Photoshop for as long as
Adobe is still around.  Regardless of the goodness of such strategies,
they're both assumptions that have to be tested *every* single time you
migrate forward your data to a new PC, new OS or new version Photoshop
(or whatever).

For the naysayers, I keep around a "perfectly preserved" data file from
an old Microsoft PowerPoint presentation.  Its an example of success in
Item #1 above, but failiure in #2.   I keep a copy on my website that I
can point you to and you can try to open the file yourself (drop me an
email).  Its a PPT version 2 file format, dating from only 1989, and
its not like Powerpoint has the excuse that its some obscure backwater
application that was discontinued years ago by its manufacturer....but
backwards-compatibility support quietly disappeared a couple of
PowerPoint revisions ago, which created this "canary in a coal mine"
example.

In summary, both of these factors each pragmatically means that digital
archiving demands that  more resources (time/money) will have to be
applied in order to maintain the same level of care as the historical
baseline.

And since the general consumer's current level of care is to throw his
negatives into a shoebox (ie, extremely low), what this means is that
there's going to be a huge number of consumers who are going to be
taken by surprise and phenominally disappointed ~10 years from now when
they discover their loss.   Since the camera companies are only
interested in selling hardware, they don't see it as their problem.

> Heck, the floppy drive is still around after how many years?

Since it lacks the needed storage capacity, its not a viable solution,
so how long its been around is a specious arguement.  In any event,
when we say "the floppy drive", just which flavor and which
hardware-driven format density are we referring to?   For example, over
the past 20 years, I'm familiar with at least 3 different variants of
floppy disks (8", 5.25" and 3.5"), and for just the 3.5" alone, there's
been 3 different format densities, plus at least 3 different vendor
proprietary formats, which has resulted in at least 7 different
variants on 3.5" floppies alone.  Granted, things did eventually
stabilize, but it pragmatically took a decade for that to occur, so we
need to  have some perspective in what our desired timelines are:  as
we looking to "Archive" for 5 years or 50?  Different consumers will
have different needs.

-hh

PS:  I'm currently using an external USB/Firewire Hard Drive with
removable trays that allows for a straightforward triple redundency
approach with minimized 'touch labor' overhead.  Cost roughly $500 to
establish 250GB of triple-redundant storage.
Roger N. Clark (change username to rnclark) - 30 Jan 2006 14:58 GMT
> Its easy to merely say that we'll just use JPEG or TIFF for our format,
> as these will "always" be readable by future image management
[quoted text clipped - 14 lines]
> PowerPoint revisions ago, which created this "canary in a coal mine"
> example.

I agree with your findings regarding MS products.  They commonly
do this to force people to upgrade thus giving them more $.
The difference with jpeg and tiff is that they are open
published formats and you can get open source (free) source
code to read them.  It is safer to stay with open source
formats and code.

The other problem is that Microsoft just won a patent lawsuit
over the FAT file system.  Now we'll probably all pay M$ money
to buy a compact flash card, or a USB disk.  Microsoft might
change the format to force upgrades, like they have done with
numerous other systems, obsoleting the old.  They'll do this
by adding new "features."  I hope the camera
manufacturers adopt a new open source system to force
the issue, while at the same time adopting a more robust
file system (a journaling file system, like ext3).

Roger
Michael Johnson, PE - 30 Jan 2006 15:34 GMT
>> I don't know how someone can say this since the technology hasn't been
>> around for 20+ years.  I have music CDs that are nearly 20 years old and
[quoted text clipped - 79 lines]
> approach with minimized 'touch labor' overhead.  Cost roughly $500 to
> establish 250GB of triple-redundant storage.

Maybe data retrieval will be a booming business in the not too distant
future.  If there is enough demand for a service then someone will
provide it to the masses.  For a fee of course. ;)
-hh - 30 Jan 2006 21:27 GMT
> Maybe data retrieval will be a booming business in the not too distant
> future.  If there is enough demand for a service then someone will
> provide it to the masses.  For a fee of course. ;)

Data retrieval already is a "booming" business.  Within the past ~18
months, we've had two occasions where we've sent out a failed hard
drive in order to recover valuable business data that the project
manager hadn't bothered to back up to our servers.

Bottom line is that we blew roughly $10K for each service call and in
the end, got back less than 1% of the lost data.  

-hh
wilt - 30 Jan 2006 17:15 GMT
>> Merely having success in retaining the image data is not enough.
The process fails when any one piece of the process - - between the
original image and the printing of a physical print (or equivalent) - -

fails. ... digital archiving demands that  more resources (time/money)
will have to be
applied in order to maintain the same level of care as the historical
baseline. ...there's going to be a huge number of consumers who are
going to be
taken by surprise and phenominally disappointed ~10 years from now when

they discover their loss.   Since the camera companies are only
interested in selling hardware, they don't see it as their problem. <<

Precisely the concerns I have...it requires continual and active
vigilence to prevent media and file formats from causing loss of data
in the future.  And these are exactly the reasons I think that history
will find these times we live in to be a bit of 'digital Dark Ages'
with lost history, lost photographs, and ***reliance on the printed
page rather than digital data*** to reconstruct a snapshot of the world
we live it!  Our descendants will never be able to look at digital
pictures that "great great grandpa shot back at the end of the 20th
Century"
-hh - 30 Jan 2006 21:41 GMT
> Precisely the concerns I have...it requires continual and active
> vigilence to prevent media and file formats from causing loss of data
> in the future.  And these are exactly the reasons I think that history
> will find these times we live in to be a bit of 'digital Dark Ages'
> with lost history, lost photographs...

The crux of the matter isn't technology, per se, but that the
technology that we're using carries a very high overhead cost in order
to guard it from very rapid obselecence, and most people aren't willing
to make the investment.

For example, if we were to run a survey of this USENET group, I'd "Bet
the Ranch" that we would find that less than 50% of its regular readers
*faithfully* make monthly backups of their image data.  And the actual
percentage who really do this is probably a lot closer to a mere 5%.
The reason why we don't make good backups is a combination of it not
being cheap or convenient.  But that doesn't make it any lesser of a
problem.

I know its increasingly dated, but Clifford Stoll's book,

"Silicon Snake Oil : Second Thoughts on the Information Highway"
(ISBN: 0385419945)

...is IMO a very good introduction into the subject of the hidden
perils and costs in digital technologies.  And now that its a decade
old, it is still an interesting read, since we can see where his
concerns and predictions have or haven't already come true.

-hh
wilt - 30 Jan 2006 17:08 GMT
>>I have RW DVD's that I used for archiving 5+ years ago that are
perfectly fine.  If they are stored properly and handled with care they

will last a very long time, IMO. <<

Interesting that a CD provided with Photoshop LE with my original G2
digicam just developed the inability to load the software program!
Over the weekend, the installed copy of PSLE stopped working on my PC
(unsure why) so I went to reinstall.  NO LUCK, in spite of several
tries, uninstalling, even Registry cleanup!  I had a second CD with
Photoshop LE, and I was able to reload from that one.  So I have an
example of a CD that has quit working in less than 3 years, and it was
stored in the dark, in a 68 degree and dry location, and in a sleeve
not a jewel case!

>>I don't know how someone can say this since the technology hasn't been
around for 20+ years.  I have music CDs that are nearly 20 years old
and
not one has gone bad, ever.  I have never had a DVD go bad.  I do think

one should avoid the bargain basement discs though but even they will
likely last a good while if stored and handled properly. <<

Tape backup has been around considerably longer than 20 years!  PC's
came about in 80's, but computers existed with mag tape before then!
David Dyer-Bennet - 30 Jan 2006 17:34 GMT
> Tape backup has been around considerably longer than 20 years!  PC's
> came about in 80's, but computers existed with mag tape before then!

Yes, but the *tapes* rarely last as long as 5 years.  Tape is
*extremely* fragile.
Signature

David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/>
RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/>
Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/>
Dragaera/Steven Brust: <http://dragaera.info/>

Philip Homburg - 30 Jan 2006 18:02 GMT
>> Tape backup has been around considerably longer than 20 years!  PC's
>> came about in 80's, but computers existed with mag tape before then!
>
>Yes, but the *tapes* rarely last as long as 5 years.  Tape is
>*extremely* fragile.

That depends on the tapes. I recently needed material from 20 year old
U-matic tapes. No problem.

Signature

That was it. Done. The faulty Monk was turned out into the desert where it
could believe what it liked, including the idea that it had been hard done
by. It was allowed to keep its horse, since horses were so cheap to make.
    -- Douglas Adams in Dirk Gently's Holistic Detective Agency

David Dyer-Bennet - 30 Jan 2006 21:22 GMT
> >> Tape backup has been around considerably longer than 20 years!  PC's
> >> came about in 80's, but computers existed with mag tape before then!
[quoted text clipped - 4 lines]
> That depends on the tapes. I recently needed material from 20 year old
> U-matic tapes. No problem.

Analog tapes, yes.  And still I think you were somewhat lucky, from
what I've read.

(There's some material I helped tape in 1976 that's on Umatic, and
there may exist later VHS transfers, that really needs to be
transferred to a new medium *today*.  But I don't have custody or
access, and don't have modern video transfer experience either, or the
right hardware on my computer.  But I *hope* the master tapes are
still in decent shape, and that somebody will take the task on
sometime soon.)
Signature

David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/>
RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/>
Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/>
Dragaera/Steven Brust: <http://dragaera.info/>

Philip Homburg - 30 Jan 2006 22:31 GMT
>Analog tapes, yes.  And still I think you were somewhat lucky, from
>what I've read.

I don't know. Lot's of tapes of different brands.

The main thing is that the tapes don't desintegrate. Years ago I tried to
restore some 9-track tapes that were not really very old. Basically, the
tapes were gone.

But at the moment, my bet is on keeping data on-line. Off-line is just
asking for trouble.

Signature

That was it. Done. The faulty Monk was turned out into the desert where it
could believe what it liked, including the idea that it had been hard done
by. It was allowed to keep its horse, since horses were so cheap to make.
    -- Douglas Adams in Dirk Gently's Holistic Detective Agency

Jim Redelfs - 30 Jan 2006 13:29 GMT
> If you were willing to spend money and effort to ensure that you
> stored your negatives and slides under good conditions, why do
> anything less for digital images?

Now, THAT's an EXCELLENT question (and point)!

I store my negs in a bank safe deposit box.  I recently invested in TWO,
external firewire drives.  That's overkill, for sure, but I am certainly more
protected than I was with (virtually) NO backup.

Now I'm considering placing one of the HDs in the safe deposit box, too.
Signature

           :)
JR

Roger N. Clark (change username to rnclark) - 30 Jan 2006 14:50 GMT
>>If you were willing to spend money and effort to ensure that you
>>stored your negatives and slides under good conditions, why do
[quoted text clipped - 5 lines]
> external firewire drives.  That's overkill, for sure, but I am certainly more
> protected than I was with (virtually) NO backup.

I consider that a bare minimum.  It is important to store one copy set
off site for disaster recovery.  It is also good to do multiple
media types.  See my digital workflow at:
  http://www.clarkvision.com/photoinfo/digitalworkflow

I write images to DVD and hard drives. I employ USB/Firewire external
hard drives and back up my images to the hard drive. I make a minimum
of 2 sets of backups on DVD and hard drives and keep one set off site.
This means I have 5 copies of the data: 2 DVDs, 2 offline hard drives,
and on the desktop computer. I also have converted my old PC to Linux
servers with large disks. I back up images to the servers for more
copies, resulting in 3 different media/format types. This ensures
against loss due to changing technology and changing formats/file systems.

> Now I'm considering placing one of the HDs in the safe deposit box, too.

Good idea.

Roger
wilt - 30 Jan 2006 17:01 GMT
Interesting that a CD provided with Photoshop LE with my original G2
digicam just developed the inability to load the software program!
Over the weekend, the installed copy of PSLE stopped working on my PC
(unsure why) so I went to reinstall.  NO LUCK, in spite of several
tries, uninstalling, even Registry cleanup!  I had a second CD with
Photoshop LE, and I was able to reload from that one.  So I have an
example of a CD that has quit working in less than 3 years, and it was
stored in the dark, in a 68 degree and dry location, and in a sleeve
not a jewel case!
nrh - 30 Jan 2006 17:11 GMT
> Interesting that a CD provided with Photoshop LE with my original G2
> digicam just developed the inability to load the software program!
[quoted text clipped - 5 lines]
> stored in the dark, in a 68 degree and dry location, and in a sleeve
> not a jewel case!

Probably got the Sony DRM bug. ;-)

N.
Michael Johnson, PE - 30 Jan 2006 17:31 GMT
> Interesting that a CD provided with Photoshop LE with my original G2
> digicam just developed the inability to load the software program!
[quoted text clipped - 5 lines]
> stored in the dark, in a 68 degree and dry location, and in a sleeve
> not a jewel case!

Have you tried to read it on another computer?  Maybe that particular
drive has a glitch with that particular CD.  I doubt this is the reason
but it might be worth checking.
David Dyer-Bennet - 30 Jan 2006 17:33 GMT
> Interesting that a CD provided with Photoshop LE with my original G2
> digicam just developed the inability to load the software program!
[quoted text clipped - 5 lines]
> stored in the dark, in a 68 degree and dry location, and in a sleeve
> not a jewel case!

Sleeves are less good.  Was it vertical or horizontal?  Was there
stuff on it?

Also, it was almost certainly a "pressed" CD, not a CD-R, and their
failure mechanisms are completely unrelated.
Signature

David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/>
RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/>
Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/>
Dragaera/Steven Brust: <http://dragaera.info/>

David Dyer-Bennet - 30 Jan 2006 05:34 GMT
> What are people doing for the long term storage of digital photos?
>
> CDs/DVDs have a life of about 2-5 years

Or 200 years.  Depending on who you believe.

> Hard Drives 3-5 years

Somewhere around there, yes.

> Am I supposed to back up my personal photos to tape?

No, that's less good than hard drives in general.

What you need to do is *monitor your archive*.  We have not yet
reached the position where a digital "archive" can be created once and
left sitting around unattended with any reasonable expectation of
survival.

I try to keep at least three copies of photos, in at least two
different locations.  When I burn multiple optical disks of photos, I
try (with intermediate success) to use *different brands* of media for
the two copies.  And while good CDs or DVDs last a long time, you
can't always reliably count on every single one lasting that long.

(Personally, I've never had a single CD or DVD die as soon as 5 years).
Signature

David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/>
RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/>
Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/>
Dragaera/Steven Brust: <http://dragaera.info/>

Ryan Robbins - 30 Jan 2006 08:47 GMT
> What are people doing for the long term storage of digital photos?
>
> CDs/DVDs have a life of about 2-5 years
> Hard Drives 3-5 years

The answer is nobody really knows. I have 5 1/4-inch disks that are 15 years
old and my old computer can still read them.

But hard drives lasting only three to five years? Where did you hear that?
My first hard drive lasted more than eight years in regular use and I never
had problems with it. My second hard drive (second computer) was still going
strong after five years.
pip22 - 30 Jan 2006 09:42 GMT
I wouldn't use RW media (CD or DVD) for long-term storage of anything you don't want to lose. RW media is less stable than 'write once' media. I know many people who never use RW media at all, not even for temporary storage, because they don't trust it. And since write-once media is now reasonably priced (even the prestige brands) there really is no good reason to risk using RW media instead, for whatever purpose

--
pip22
Peter - 30 Jan 2006 13:41 GMT
> What are people doing for the long term storage of digital photos?
>
> CDs/DVDs have a life of about 2-5 years
> Hard Drives 3-5 years
>
> Am I supposed to back up my personal photos to tape?

Where I work we set up and maintain an archive (about 15TB now) on
harddisks (RAID), which is, of course, closely monitored. It is copied
continuously to two other places (at the moment) which have a mirror of
the data (one on a different continent). All the software used and files
in the archive must be open source/open format/free (it needs to be able
to be read in a long time to come).

-peter
Tom - 30 Jan 2006 21:05 GMT
I just have an idea.  We can just print the binary data (use Base 64 encoding for example) to a piece of paper and then transfer the paper to micro film.  These things last forget just like those micro film used for the newspaper archive in a library.

Whenever we need the picture back, we can just put the paper to a scanner and scan the binary data back.

The only question is how much we can put in a piece of paper... with a 1200x1200 dpi laser printer.

 What are people doing for the long term storage of digital photos?

 CDs/DVDs have a life of about 2-5 years
 Hard Drives 3-5 years

 Am I supposed to back up my personal photos to tape?
David Dyer-Bennet - 30 Jan 2006 21:27 GMT
> I just have an idea.  We can just print the binary data (use Base 64 encoding for example) to a piece of paper and then transfer the paper to micro film.  These things last forget just like those micro film used for the newspaper archive in a library.
>
> Whenever we need the picture back, we can just put the paper to a scanner and scan the binary data back.
>
> The only question is how much we can put in a piece of paper... with a 1200x1200 dpi laser printer.

I've thought of this myself.  Using a 2-d barcode, I don't know how
high a resolution you can expect to print with a good expectation of
being able to read the data *in 100 years*.  Also it needs to be plain
cotton-fiber paper, not coated, for greater longevity.  

If you can adequately expect to read 1/10 inch bits, and the bar code
including ECC redundancy uses 15% overhead, then in an 8x11 area
(leaving 1/4 borders all around) you've got 88 square inches, and 100
bits per square inch, so 8800 bits minus 15% -- i.e. nowhere vagulely
close to good enough.  But my 1/10 inch bits may be unduly
pessimistic, maybe.  At 1/100 inch bits, you get 10,000 bits per
square inch, so nearly a megabit on the sheet of paper.

It's going to be a pretty big archive, I guess.
Signature

David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/>
RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/>
Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/>
Dragaera/Steven Brust: <http://dragaera.info/>

 
Sign In
Join
My Latest Posts
My Monitored Threads
My Blog
My Photo Gallery
My Profile
My Homepage

Start New Thread
Enable EMail Alerts
Rate this Thread



©2009 Advenet LLC   Privacy Policy - Terms of Use
This website includes both content owned or controlled by Advenet as well as content owned or controlled by third parties.