Photo Forum / Digital Photography / DSLR Cameras / February 2006
Back-up/Archive of Digital Photographs...Suggestions?
|
|
Thread rating:  |
pgrogan@gmail.com - 29 Jan 2006 06:06 GMT What are people doing for the long term storage of digital photos?
CDs/DVDs have a life of about 2-5 years Hard Drives 3-5 years
Am I supposed to back up my personal photos to tape?
C J Southern - 29 Jan 2006 07:56 GMT I write mine to CD - not sure where you get 2 - 5 years from - my research suggests quality brands are rated somewhere in the region of 75 years (if cared for properly), with a new range rated at 300 years.
DVDs on the other hand I'm a bit more weary of.
nrh - 29 Jan 2006 11:06 GMT <snipped>
> DVDs on the other hand I'm a bit more weary of. More sleep needed then, perhaps? ;-)
Nigel
Peter - 29 Jan 2006 19:20 GMT >I write mine to CD - not sure where you get 2 - 5 years from - my research >suggests quality brands are rated somewhere in the region of 75 years (if >cared for properly), with a new range rated at 300 years. Really? I'd seriously doubt these figures. No CD-R has lasted more than couple of years on me.
Peter
C J Southern - 29 Jan 2006 20:34 GMT > >I write mine to CD - not sure where you get 2 - 5 years from - my > >research suggests quality brands are rated somewhere in the region of 75 > >years (if cared for properly), with a new range rated at 300 years. > > Really? I'd seriously doubt these figures. No CD-R has lasted more than > couple of years on me. Perhaps you've got an undiagnosed issue with your writer? I can't say I've ever had an issue with even the cheap brands.
I accept that the published figures are usually maximum figures, but none-the-less I would expect that something thats designed to last 300 years shouldn't have an issue lasting the next 30 or 40 years I've got left on this planet.
Jeremy Nixon - 29 Jan 2006 23:14 GMT > Really? I'd seriously doubt these figures. No CD-R has lasted more than > couple of years on me. I have CD-Rs that have been sitting in my car, undergoing the extreme temperature changes of a car interior, longer than that. In fact, I have yet to have a CD-R go bad on me. For some reason, I still don't really trust them as a long-term backup solution.
But the real problem with them (and with DVDs) is that they don't store enough data to be useful for backing up images. I'd need a pretty big stack of DVDs to make a single backup of my image library. Hard drives are the only practical solution.
 Signature Jeremy | jeremy@exit109.com
David Dyer-Bennet - 30 Jan 2006 05:35 GMT > >I write mine to CD - not sure where you get 2 - 5 years from - my research > >suggests quality brands are rated somewhere in the region of 75 years (if > >cared for properly), with a new range rated at 300 years. > > Really? I'd seriously doubt these figures. No CD-R has lasted more than > couple of years on me. Then something really weird is going on. My oldes CD-Rs are over 10 years old, and I haven't had a single one go bad on me yet.
 Signature David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/> RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/> Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/> Dragaera/Steven Brust: <http://dragaera.info/>
pgrogan@gmail.com - 30 Jan 2006 06:25 GMT Are your CD-Rs music, pics or data? And what brand did you use? I hear that Verbatim discs are best for long term survival
David Dyer-Bennet - 30 Jan 2006 16:32 GMT > Are your CD-Rs music, pics or data? And what brand did you use? I > hear that Verbatim discs are best for long term survival Entirely data -- but data includes music and pictures, in my parlance. They're disks intended to be read by computers, containing computer files.
I've used a wide variety of CD-R media, with the most important files going on Kodak Gold Ultima disks. I know I've used Imation disks, and Memorex, and Verbatim, and K Hypermedia, and various generics.
 Signature David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/> RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/> Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/> Dragaera/Steven Brust: <http://dragaera.info/>
pgrogan@gmail.com - 30 Jan 2006 06:28 GMT Are your CD-Rs music, pics or data? And what brand did you use? I hear that Verbatim discs are best for long term survival
Dana H. Myers - 30 Jan 2006 08:05 GMT >> I write mine to CD - not sure where you get 2 - 5 years from - my research >> suggests quality brands are rated somewhere in the region of 75 years (if >> cared for properly), with a new range rated at 300 years. > > Really? I'd seriously doubt these figures. No CD-R has lasted more than > couple of years on me. While I might question a 300-year permanence for current CD-R media, I do have more than a few CD-Rs here that I wrote 5+ years ago, and read without detectable error. Sounds like you might be getting especially poor permanence - how are you storing your CD-Rs?
Dana
C J Southern - 30 Jan 2006 20:00 GMT > While I might question a 300-year permanence for current CD-R media, > I do have more than a few CD-Rs here that I wrote 5+ years ago, and > read without detectable error. Sounds like you might be getting > especially poor permanence - how are you storing your CD-Rs? The 300 year variety are a new product coming out in the next couple of months - 75 years seems to be the figure most often mentioned for the better brands today.
pgrogan@gmail.com - 30 Jan 2006 02:25 GMT Here is my source:
http://computerworld.com/hardwaretopics/storage/story/0,10801,107607,00.html
I doubt seriously that any CD/DVD burnt on a home computer is going to last 75 years.
Proconsul - 30 Jan 2006 02:34 GMT > Here is my source: > > http://computerworld.com/hardwaretopics/storage/story/0,10801,107607,00.html > > I doubt seriously that any CD/DVD burnt on a home computer is going to > last 75 years. The "expert" who wrote that article is braindead....and wrong.....
I've got CDs that are older than five years that are still perfect....
Nothing lasts forever, but I don't buy the "short life" described in the article.....
PC
Robert R Kircher, Jr. - 30 Jan 2006 13:59 GMT > Here is my source: > > http://computerworld.com/hardwaretopics/storage/story/0,10801,107607,00.html > > I doubt seriously that any CD/DVD burnt on a home computer is going to > last 75 years. This one article has caused such a stir in the media world it's unbelievable. I wouldn't be surprised if we don't find out that our Mr. Gerecke has some stake it a new media format about to hit the market.
When every I'm asked about this from my clients I point to this article http://www.popphoto.com/article.asp?section_id=4&article_id=1492&page_number=1
Also, I point to work I've done for the US Library of Congress related to their image archiving in which they use CD for storage.
Lastly, if you go out to the NIST and LoC websites and do a search you will find guidelines on the use of CD as a storage/archival media.
Here are the facts as I see them. Just like any media, tape, hard drive, vinyl records, if not handled properly it will fail. As already pointed out, I have CD's burned years ago both data and music that work today and I've taken no extraordinary steps to keep these CDs. On the other hand I've had CDs that simply don't work after time. BUT, I've had the same issue with what is widely excepted as the only archival media TAPE.
Lastly, since media and file formats are bound to change over time the idea of long term storage of you images is sort of misguided. Eventually we'll all have to migrate our data to the latest file system/technology. As long as your media of choice still works at this point you're in good shape. My solution is redundancy. I have multiple copies of my images on multiple media including USB drives and DVD. My main storage is a RAID-5 on my server (this can be done on the desktop as well). This gives me 3+ opportunities to recover from storage disasters. The chances of not recovering data with such redundancy is slim to none.
 Signature Rob "A disturbing new study finds that studies are disturbing"
Roger N. Clark (change username to rnclark) - 30 Jan 2006 15:08 GMT > When every I'm asked about this from my clients I point to this article > http://www.popphoto.com/article.asp?section_id=4&article_id=1492&page_number=1 [quoted text clipped - 8 lines] > opportunities to recover from storage disasters. The chances of not > recovering data with such redundancy is slim to none. Robert, Good advice. But a warning on raid 5: it CAN fail. At work I had a raid 5 box with fifteen 250 GByte hard drives configured as 2 raid 5 arrays. The fan went out and the hard drives cooked, with complete failure on multiple drives, losing all data. Fortunately, we had them backed up to raid 5 arrays in another building. I also had critical components on DVD (the raid arrays were not full, but more than I would copy to DVD, so only part was on DVD).
It just illustrates, backup backup backup.
Roger
Robert R Kircher, Jr. - 30 Jan 2006 16:11 GMT >> When every I'm asked about this from my clients I point to this article >> http://www.popphoto.com/article.asp?section_id=4&article_id=1492&page_number=1 [quoted text clipped - 20 lines] > > It just illustrates, backup backup backup. No doubt as any storage device can fail but the key is to reduce you chances of data loss. As you point out in your example, the chances of all you storage methods going belly up at the same time are nil so when your RAID did crash you were able to recreate it and the data. Same in my enviornemt as I have my data on USB drive and DVD in the event that the RAID or server crashes. As a mater of fact I have two USB drives that are "mirrored". (using MS's Synctool power toy.
 Signature Rob "A disturbing new study finds that studies are disturbing"
> Roger Richard - 11 Feb 2006 00:30 GMT He could well be right.
I've just discovered that quite a few of my photographic CDs burned 4 years ago are now corrupted and partly unreadable.
All the affected CDs are roughly half OK and half dud, and all of them PNY make.
I've been running a recovery utility for over a week now on two CDs on two PCs, with little success.
I could tear my hair out, but it wouldn't help!
Richard.
>Here is my source: > >http://computerworld.com/hardwaretopics/storage/story/0,10801,107607,00.html > >I doubt seriously that any CD/DVD burnt on a home computer is going to >last 75 years. John Tserkezis - 29 Jan 2006 09:26 GMT > What are people doing for the long term storage of digital photos? > > CDs/DVDs have a life of about 2-5 years > Hard Drives 3-5 years > > Am I supposed to back up my personal photos to tape? Tape would be a good albeit expensive option.
For small operations, I use and suggest a USB drive case to keep a duplicate of sensitive data. Don't rely on the drive holding all your stuff without it being stored elsewhere too.
The drive gets plugged in every week or so, so even though it gets power cycled often in relation to its life, overall, it'll last longer than leaving it in all the time.
I never bought into the CD/DVD life expectancies of many years, I wouldn't trust them past several years. If it's any more, it's an unexpected bonus. Sure they're probably getting better, but I'm not going to trust them just to find out that disk fails at the most inopportune moment.
Personally, I have a raid-5 redundant setup. Every time a drive fails, I replace it. No data loss, with no downtime. (well, there's two days of background re-syncronising to restore the raid setup though) So as long as they keep selling SATA drives over the years, I can keep my data intact.
 Signature Linux Registered User # 302622 <http://counter.li.org>
C J Southern - 29 Jan 2006 09:34 GMT > So as long as they keep selling SATA drives over the years, I can keep my > data intact. It's still a risky proposition, unless you're also taking other precautions. Have you considered ...
- Fire? - Theft? - Malfunction (software? controller?) that scrambles some/all critical data areas? - Power spike / PSU Malfunction - fries all drives in 1 foul swoop.
I've had clients who have lost data through all of these means.
nrh - 29 Jan 2006 11:05 GMT <snipped>
> - Power spike / PSU Malfunction - fries all drives in 1 foul swoop. Bird flu, perhaps? ;-)
Nigel.
Peter - 29 Jan 2006 19:20 GMT >> - Power spike / PSU Malfunction - fries all drives in 1 foul swoop. > > Bird flu, perhaps? ;-) Or even worse... fish flu! 8-D
Tom - 30 Jan 2006 05:33 GMT >>> - Power spike / PSU Malfunction - fries all drives in 1 foul swoop. >>> [quoted text clipped - 5 lines] > > just watch out for chimney flu.. when that one burns out it could take everything.
:-O Does anyone use a remote backup service? If so do you encrypt your stuff first? Cost?
wilt - 30 Jan 2006 16:57 GMT >> So as long as they keep selling SATA drives over the years, I can keep my data intact. << I have been around computing since the 70's when 8K of core memory was $10k. If you have been involved in personal computing since the early 80's as I have, the many drive types that have come and gone will make you know about the eventual obsolescence of a particular interface and/or drive technology is inevitable (although admittedly SCSI has been around a very long time). So when SATA disappears, do you have envision how data will migrate form your RAID with SATA drives to a new RAID with LATESTTECH drives?
I've not been confident about burnable anythings, and right now I use a USB harddrive, so I'm not up to date on RAID that is available today, which is why I'm curious.
David Dyer-Bennet - 30 Jan 2006 17:17 GMT > >> So as long as they keep selling SATA drives over the years, I can keep my data intact. << > [quoted text clipped - 6 lines] > envision how data will migrate form your RAID with SATA drives to a new > RAID with LATESTTECH drives? Just the same way I migrated it from PATA to SATA last November. Which was the same way I went from a 116GB drive to a 160GB drive the year or so before that.
(The RAID is irrelevant, really, so long as your computer can suppport both devices at once.)
> I've not been confident about burnable anythings, and right now I use a > USB harddrive, so I'm not up to date on RAID that is available today, > which is why I'm curious. Variety is good. I currently have my online working copy on SATA, backups on two different Firewwire external drives, local CD or DVD copies, and off-site CD or DVD copies.
 Signature David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/> RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/> Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/> Dragaera/Steven Brust: <http://dragaera.info/>
Philip Homburg - 29 Jan 2006 12:17 GMT >What are people doing for the long term storage of digital photos? > >CDs/DVDs have a life of about 2-5 years >Hard Drives 3-5 years > >Am I supposed to back up my personal photos to tape? I use three removable harddisks. - One is off site, and gets replaced with a more up-to-date version every month. - One is in the safe, and gets replaces with a more up-to-date version every week. - One is in my computer and gets an update at night (my computer is always on for e-mail, web, etc. Otherwise, you have to remember to sync the disk before you to turn off the computer).
Of course, Murphy will figure out a way to destroy all 4 copies of my data. So making enough prints is probably a good idea too.
 Signature That was it. Done. The faulty Monk was turned out into the desert where it could believe what it liked, including the idea that it had been hard done by. It was allowed to keep its horse, since horses were so cheap to make. -- Douglas Adams in Dirk Gently's Holistic Detective Agency
nrh - 29 Jan 2006 12:53 GMT > I use three removable harddisks. > - One is off site, and gets replaced with a more up-to-date version every > month. > - One is in the safe, and gets replaces with a more up-to-date version > every week. <snipped>
Wow! Can I have all the discarded one's please! I have to make mine last around 3 YEARS! ;-)
Nigel
Jim Redelfs - 29 Jan 2006 17:27 GMT > What are people doing for the long term storage of digital photos? I use two, 250gb hard-disk drives, each partitioned in thirds.
> CDs/DVDs have a life of about 2-5 years Huh? I'd like to see your reference on that. While it is generally accepted that optical media has a finite life span, I understand it is MUCH longer than that.
I believe that the TECHNOLOGY to access data from an optical disk created TODAY will be nonexistent well before the data becomes corrupt.
> Hard Drives 3-5 years Magnetic technology. I'll buy that.
> Am I supposed to back up my personal photos to tape? Nah. That's just more magnetic media, albeit OLD and slow.
In any case, one should UPGRADE their archives to current technology AT LEAST every 5-7 years.
 Signature :) JR
Michael Johnson, PE - 29 Jan 2006 17:52 GMT >> What are people doing for the long term storage of digital photos? > [quoted text clipped - 5 lines] > that optical media has a finite life span, I understand it is MUCH longer than > that. I have RW DVD's that I used for archiving 5+ years ago that are perfectly fine. If they are stored properly and handled with care they will last a very long time, IMO.
> I believe that the TECHNOLOGY to access data from an optical disk created > TODAY will be nonexistent well before the data becomes corrupt. > >> Hard Drives 3-5 years > > Magnetic technology. I'll buy that. I have old 2-3 gigabyte IDE hard drives that are nearly 10 years old that still have there original files. All that is needed is to hook them up to an IDE connection and they even boot up to the old Windows 3.11 operating system (severely driver impaired though). :)
>> Am I supposed to back up my personal photos to tape? > > Nah. That's just more magnetic media, albeit OLD and slow. You got that right. I HATED tape backup drives. Talk about unreliable, they were by far the worst backup system I every used.
> In any case, one should UPGRADE their archives to current technology AT LEAST > every 5-7 years. I think any backup system that utilizes a USB connection will be good for a number of years. I think this means of data transfer will be around for years and years with very good backwards compatibility for current USB connections built into future computer systems.
Michael Johnson, PE - 29 Jan 2006 17:56 GMT > I have RW DVD's that I used for archiving 5+ years ago that are > perfectly fine. If they are stored properly and handled with care they > will last a very long time, IMO. I meant to say RW CD's.
Father Kodak - 30 Jan 2006 05:34 GMT >> Nah. That's just more magnetic media, albeit OLD and slow. > >You got that right. I HATED tape backup drives. Talk about unreliable, >they were by far the worst backup system I every used. If tape is that unreliable, then why is tape the technology standard for corporate data backup? Of course, corporate data centers aren't using "toy" tape drives like Travans.
A good tape backup solution is going to cost you, for both the drives AND the media. But tape will last easily 20 years before going bad. Recorded CDs? Perhaps? Recorded DVDs at today's state of the art? No.
The big crisis in photography will come when people discover that all their carefully Photoshopped images are no longer retrievable from CDs and DVDs.
If you were willing to spend money and effort to ensure that you stored your negatives and slides under good conditions, why do anything less for digital images?
Father Kodak
Michael Johnson, PE - 30 Jan 2006 06:25 GMT >>> Nah. That's just more magnetic media, albeit OLD and slow. >> You got that right. I HATED tape backup drives. Talk about unreliable, [quoted text clipped - 3 lines] > for corporate data backup? Of course, corporate data centers aren't > using "toy" tape drives like Travans. For my small consulting firm using the tape backup systems that large corporations used wasn't practical as it was with nearly all small businesses in general. What I used was slow and unreliable. The best thing tape had going for it was cheap media cost and storage capacity. Beyond that it totally sucked. The first system that was truly user friendly and fast while being affordable was hot-swappable hard disks.
> A good tape backup solution is going to cost you, for both the drives > AND the media. But tape will last easily 20 years before going bad. > Recorded CDs? Perhaps? Recorded DVDs at today's state of the art? > No. I don't know how someone can say this since the technology hasn't been around for 20+ years. I have music CDs that are nearly 20 years old and not one has gone bad, ever. I have never had a DVD go bad. I do think one should avoid the bargain basement discs though but even they will likely last a good while if stored and handled properly.
> The big crisis in photography will come when people discover that all > their carefully Photoshopped images are no longer retrievable from CDs > and DVDs. If someone doesn't bother to update their stored data to newer technologies when they become available, then they shouldn't complain when their data is irretrievable. It must not have been that important then. This is why I said storage devices that use the USB interface looks to be a good backup choice for long term compatibility. Heck, the floppy drive is still around after how many years?
> If you were willing to spend money and effort to ensure that you > stored your negatives and slides under good conditions, why do > anything less for digital images? I personally don't think the brand of storage media is as critical as the storage conditions and handling during retrieval.
pgrogan@gmail.com - 30 Jan 2006 06:40 GMT I have been doing some research on this & yes, there is a difference in the brands that are used for DVD and CD burning. Manufacturers use differnet types of dyes with different characteristics. Some last longer than others, some withstand heat better, some withstand light better....etc etc. Also, remember that the store bought CDs and DVDs are very differnet than what you burn on your computer.
Michael Johnson, PE - 30 Jan 2006 17:34 GMT > I have been doing some research on this & yes, there is a difference in > the brands that are used for DVD and CD burning. Manufacturers use > differnet types of dyes with different characteristics. Some last > longer than others, some withstand heat better, some withstand light > better....etc etc. Also, remember that the store bought CDs and DVDs > are very differnet than what you burn on your computer. I have noticed that some of the really cheap discs are very sensitive to scratching. A minor abrasion can actually remove the recoding media from the disc. The best ones appear to be those with a good, tough coating on the side of the disc containing the recording media.
David Dyer-Bennet - 30 Jan 2006 18:02 GMT > > I have been doing some research on this & yes, there is a difference in > > the brands that are used for DVD and CD burning. Manufacturers use [quoted text clipped - 7 lines] > media from the disc. The best ones appear to be those with a good, > tough coating on the side of the disc containing the recording media. Let's keep the terminology straight, though.
The actual "recording media" is dyes embedded in the plastic. That's not what gets damaged or comes off.
What gets easily scratched or comes off on burnable CD and DVD disks is the *reflective* layer, which is on top of the disk (you're writing on it when you label your disks).
And yes, damaging the reflective layer is the easiest way to render these disks unreadable. The good gold archival disks also come with a protective layer over the reflective layer, which makes such damage harder to cause.
 Signature David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/> RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/> Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/> Dragaera/Steven Brust: <http://dragaera.info/>
-hh - 30 Jan 2006 11:22 GMT > I don't know how someone can say this since the technology hasn't been > around for 20+ years. I have music CDs that are nearly 20 years old and > not one has gone bad, ever. IIRC, commercial music CD's use a different encoding process (technology) than what you get with a CD-R burner...as such, you're comparing apples to oranges.
> If someone doesn't bother to update their stored data to newer > technologies when they become available, then they shouldn't complain > when their data is irretrievable. The problem is twofold:
1. The rate of change in digital technology is much higher than traditional film, which has meant that the reliance on some specfic solution will have a shorter effective life.
While there has been 'format'-like changes with 35mm, these were generally limited to the scope of responsibility of the commercial developer/printer, and were not disseminated down to every individual photographer which creates a archive management nightmare due to this splintering effect (You're on CD's, Aunt Mabel is on 3.5" floppies, Uncle Bob is on ZIP 250's...good luck!).
2. Merely having success in retaining the image data is not enough. The process fails when any one piece of the process - - between the original image and the printing of a physical print (or equivalent) - - fails.
Its easy to merely say that we'll just use JPEG or TIFF for our format, as these will "always" be readable by future image management applications, or we'll say that we'll use Photoshop for as long as Adobe is still around. Regardless of the goodness of such strategies, they're both assumptions that have to be tested *every* single time you migrate forward your data to a new PC, new OS or new version Photoshop (or whatever).
For the naysayers, I keep around a "perfectly preserved" data file from an old Microsoft PowerPoint presentation. Its an example of success in Item #1 above, but failiure in #2. I keep a copy on my website that I can point you to and you can try to open the file yourself (drop me an email). Its a PPT version 2 file format, dating from only 1989, and its not like Powerpoint has the excuse that its some obscure backwater application that was discontinued years ago by its manufacturer....but backwards-compatibility support quietly disappeared a couple of PowerPoint revisions ago, which created this "canary in a coal mine" example.
In summary, both of these factors each pragmatically means that digital archiving demands that more resources (time/money) will have to be applied in order to maintain the same level of care as the historical baseline.
And since the general consumer's current level of care is to throw his negatives into a shoebox (ie, extremely low), what this means is that there's going to be a huge number of consumers who are going to be taken by surprise and phenominally disappointed ~10 years from now when they discover their loss. Since the camera companies are only interested in selling hardware, they don't see it as their problem.
> Heck, the floppy drive is still around after how many years? Since it lacks the needed storage capacity, its not a viable solution, so how long its been around is a specious arguement. In any event, when we say "the floppy drive", just which flavor and which hardware-driven format density are we referring to? For example, over the past 20 years, I'm familiar with at least 3 different variants of floppy disks (8", 5.25" and 3.5"), and for just the 3.5" alone, there's been 3 different format densities, plus at least 3 different vendor proprietary formats, which has resulted in at least 7 different variants on 3.5" floppies alone. Granted, things did eventually stabilize, but it pragmatically took a decade for that to occur, so we need to have some perspective in what our desired timelines are: as we looking to "Archive" for 5 years or 50? Different consumers will have different needs.
-hh
PS: I'm currently using an external USB/Firewire Hard Drive with removable trays that allows for a straightforward triple redundency approach with minimized 'touch labor' overhead. Cost roughly $500 to establish 250GB of triple-redundant storage.
Roger N. Clark (change username to rnclark) - 30 Jan 2006 14:58 GMT > Its easy to merely say that we'll just use JPEG or TIFF for our format, > as these will "always" be readable by future image management [quoted text clipped - 14 lines] > PowerPoint revisions ago, which created this "canary in a coal mine" > example. I agree with your findings regarding MS products. They commonly do this to force people to upgrade thus giving them more $. The difference with jpeg and tiff is that they are open published formats and you can get open source (free) source code to read them. It is safer to stay with open source formats and code.
The other problem is that Microsoft just won a patent lawsuit over the FAT file system. Now we'll probably all pay M$ money to buy a compact flash card, or a USB disk. Microsoft might change the format to force upgrades, like they have done with numerous other systems, obsoleting the old. They'll do this by adding new "features." I hope the camera manufacturers adopt a new open source system to force the issue, while at the same time adopting a more robust file system (a journaling file system, like ext3).
Roger
Michael Johnson, PE - 30 Jan 2006 15:34 GMT >> I don't know how someone can say this since the technology hasn't been >> around for 20+ years. I have music CDs that are nearly 20 years old and [quoted text clipped - 79 lines] > approach with minimized 'touch labor' overhead. Cost roughly $500 to > establish 250GB of triple-redundant storage. Maybe data retrieval will be a booming business in the not too distant future. If there is enough demand for a service then someone will provide it to the masses. For a fee of course. ;)
-hh - 30 Jan 2006 21:27 GMT > Maybe data retrieval will be a booming business in the not too distant > future. If there is enough demand for a service then someone will > provide it to the masses. For a fee of course. ;) Data retrieval already is a "booming" business. Within the past ~18 months, we've had two occasions where we've sent out a failed hard drive in order to recover valuable business data that the project manager hadn't bothered to back up to our servers.
Bottom line is that we blew roughly $10K for each service call and in the end, got back less than 1% of the lost data.
-hh
wilt - 30 Jan 2006 17:15 GMT >> Merely having success in retaining the image data is not enough. The process fails when any one piece of the process - - between the original image and the printing of a physical print (or equivalent) - -
fails. ... digital archiving demands that more resources (time/money) will have to be applied in order to maintain the same level of care as the historical baseline. ...there's going to be a huge number of consumers who are going to be taken by surprise and phenominally disappointed ~10 years from now when
they discover their loss. Since the camera companies are only interested in selling hardware, they don't see it as their problem. <<
Precisely the concerns I have...it requires continual and active vigilence to prevent media and file formats from causing loss of data in the future. And these are exactly the reasons I think that history will find these times we live in to be a bit of 'digital Dark Ages' with lost history, lost photographs, and ***reliance on the printed page rather than digital data*** to reconstruct a snapshot of the world we live it! Our descendants will never be able to look at digital pictures that "great great grandpa shot back at the end of the 20th Century"
-hh - 30 Jan 2006 21:41 GMT > Precisely the concerns I have...it requires continual and active > vigilence to prevent media and file formats from causing loss of data > in the future. And these are exactly the reasons I think that history > will find these times we live in to be a bit of 'digital Dark Ages' > with lost history, lost photographs... The crux of the matter isn't technology, per se, but that the technology that we're using carries a very high overhead cost in order to guard it from very rapid obselecence, and most people aren't willing to make the investment.
For example, if we were to run a survey of this USENET group, I'd "Bet the Ranch" that we would find that less than 50% of its regular readers *faithfully* make monthly backups of their image data. And the actual percentage who really do this is probably a lot closer to a mere 5%. The reason why we don't make good backups is a combination of it not being cheap or convenient. But that doesn't make it any lesser of a problem.
I know its increasingly dated, but Clifford Stoll's book,
"Silicon Snake Oil : Second Thoughts on the Information Highway" (ISBN: 0385419945)
...is IMO a very good introduction into the subject of the hidden perils and costs in digital technologies. And now that its a decade old, it is still an interesting read, since we can see where his concerns and predictions have or haven't already come true.
-hh
wilt - 30 Jan 2006 17:08 GMT >>I have RW DVD's that I used for archiving 5+ years ago that are perfectly fine. If they are stored properly and handled with care they
will last a very long time, IMO. <<
Interesting that a CD provided with Photoshop LE with my original G2 digicam just developed the inability to load the software program! Over the weekend, the installed copy of PSLE stopped working on my PC (unsure why) so I went to reinstall. NO LUCK, in spite of several tries, uninstalling, even Registry cleanup! I had a second CD with Photoshop LE, and I was able to reload from that one. So I have an example of a CD that has quit working in less than 3 years, and it was stored in the dark, in a 68 degree and dry location, and in a sleeve not a jewel case!
>>I don't know how someone can say this since the technology hasn't been around for 20+ years. I have music CDs that are nearly 20 years old and not one has gone bad, ever. I have never had a DVD go bad. I do think
one should avoid the bargain basement discs though but even they will likely last a good while if stored and handled properly. <<
Tape backup has been around considerably longer than 20 years! PC's came about in 80's, but computers existed with mag tape before then!
David Dyer-Bennet - 30 Jan 2006 17:34 GMT > Tape backup has been around considerably longer than 20 years! PC's > came about in 80's, but computers existed with mag tape before then! Yes, but the *tapes* rarely last as long as 5 years. Tape is *extremely* fragile.
 Signature David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/> RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/> Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/> Dragaera/Steven Brust: <http://dragaera.info/>
Philip Homburg - 30 Jan 2006 18:02 GMT >> Tape backup has been around considerably longer than 20 years! PC's >> came about in 80's, but computers existed with mag tape before then! > >Yes, but the *tapes* rarely last as long as 5 years. Tape is >*extremely* fragile. That depends on the tapes. I recently needed material from 20 year old U-matic tapes. No problem.
 Signature That was it. Done. The faulty Monk was turned out into the desert where it could believe what it liked, including the idea that it had been hard done by. It was allowed to keep its horse, since horses were so cheap to make. -- Douglas Adams in Dirk Gently's Holistic Detective Agency
David Dyer-Bennet - 30 Jan 2006 21:22 GMT > >> Tape backup has been around considerably longer than 20 years! PC's > >> came about in 80's, but computers existed with mag tape before then! [quoted text clipped - 4 lines] > That depends on the tapes. I recently needed material from 20 year old > U-matic tapes. No problem. Analog tapes, yes. And still I think you were somewhat lucky, from what I've read.
(There's some material I helped tape in 1976 that's on Umatic, and there may exist later VHS transfers, that really needs to be transferred to a new medium *today*. But I don't have custody or access, and don't have modern video transfer experience either, or the right hardware on my computer. But I *hope* the master tapes are still in decent shape, and that somebody will take the task on sometime soon.)
 Signature David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/> RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/> Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/> Dragaera/Steven Brust: <http://dragaera.info/>
Philip Homburg - 30 Jan 2006 22:31 GMT >Analog tapes, yes. And still I think you were somewhat lucky, from >what I've read. I don't know. Lot's of tapes of different brands.
The main thing is that the tapes don't desintegrate. Years ago I tried to restore some 9-track tapes that were not really very old. Basically, the tapes were gone.
But at the moment, my bet is on keeping data on-line. Off-line is just asking for trouble.
 Signature That was it. Done. The faulty Monk was turned out into the desert where it could believe what it liked, including the idea that it had been hard done by. It was allowed to keep its horse, since horses were so cheap to make. -- Douglas Adams in Dirk Gently's Holistic Detective Agency
Jim Redelfs - 30 Jan 2006 13:29 GMT > If you were willing to spend money and effort to ensure that you > stored your negatives and slides under good conditions, why do > anything less for digital images? Now, THAT's an EXCELLENT question (and point)!
I store my negs in a bank safe deposit box. I recently invested in TWO, external firewire drives. That's overkill, for sure, but I am certainly more protected than I was with (virtually) NO backup.
Now I'm considering placing one of the HDs in the safe deposit box, too.
 Signature :) JR
Roger N. Clark (change username to rnclark) - 30 Jan 2006 14:50 GMT >>If you were willing to spend money and effort to ensure that you >>stored your negatives and slides under good conditions, why do [quoted text clipped - 5 lines] > external firewire drives. That's overkill, for sure, but I am certainly more > protected than I was with (virtually) NO backup. I consider that a bare minimum. It is important to store one copy set off site for disaster recovery. It is also good to do multiple media types. See my digital workflow at: http://www.clarkvision.com/photoinfo/digitalworkflow
I write images to DVD and hard drives. I employ USB/Firewire external hard drives and back up my images to the hard drive. I make a minimum of 2 sets of backups on DVD and hard drives and keep one set off site. This means I have 5 copies of the data: 2 DVDs, 2 offline hard drives, and on the desktop computer. I also have converted my old PC to Linux servers with large disks. I back up images to the servers for more copies, resulting in 3 different media/format types. This ensures against loss due to changing technology and changing formats/file systems.
> Now I'm considering placing one of the HDs in the safe deposit box, too. Good idea.
Roger
wilt - 30 Jan 2006 17:01 GMT Interesting that a CD provided with Photoshop LE with my original G2 digicam just developed the inability to load the software program! Over the weekend, the installed copy of PSLE stopped working on my PC (unsure why) so I went to reinstall. NO LUCK, in spite of several tries, uninstalling, even Registry cleanup! I had a second CD with Photoshop LE, and I was able to reload from that one. So I have an example of a CD that has quit working in less than 3 years, and it was stored in the dark, in a 68 degree and dry location, and in a sleeve not a jewel case!
nrh - 30 Jan 2006 17:11 GMT > Interesting that a CD provided with Photoshop LE with my original G2 > digicam just developed the inability to load the software program! [quoted text clipped - 5 lines] > stored in the dark, in a 68 degree and dry location, and in a sleeve > not a jewel case! Probably got the Sony DRM bug. ;-)
N.
Michael Johnson, PE - 30 Jan 2006 17:31 GMT > Interesting that a CD provided with Photoshop LE with my original G2 > digicam just developed the inability to load the software program! [quoted text clipped - 5 lines] > stored in the dark, in a 68 degree and dry location, and in a sleeve > not a jewel case! Have you tried to read it on another computer? Maybe that particular drive has a glitch with that particular CD. I doubt this is the reason but it might be worth checking.
David Dyer-Bennet - 30 Jan 2006 17:33 GMT > Interesting that a CD provided with Photoshop LE with my original G2 > digicam just developed the inability to load the software program! [quoted text clipped - 5 lines] > stored in the dark, in a 68 degree and dry location, and in a sleeve > not a jewel case! Sleeves are less good. Was it vertical or horizontal? Was there stuff on it?
Also, it was almost certainly a "pressed" CD, not a CD-R, and their failure mechanisms are completely unrelated.
 Signature David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/> RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/> Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/> Dragaera/Steven Brust: <http://dragaera.info/>
David Dyer-Bennet - 30 Jan 2006 05:34 GMT > What are people doing for the long term storage of digital photos? > > CDs/DVDs have a life of about 2-5 years Or 200 years. Depending on who you believe.
> Hard Drives 3-5 years Somewhere around there, yes.
> Am I supposed to back up my personal photos to tape? No, that's less good than hard drives in general.
What you need to do is *monitor your archive*. We have not yet reached the position where a digital "archive" can be created once and left sitting around unattended with any reasonable expectation of survival.
I try to keep at least three copies of photos, in at least two different locations. When I burn multiple optical disks of photos, I try (with intermediate success) to use *different brands* of media for the two copies. And while good CDs or DVDs last a long time, you can't always reliably count on every single one lasting that long.
(Personally, I've never had a single CD or DVD die as soon as 5 years).
 Signature David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/> RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/> Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/> Dragaera/Steven Brust: <http://dragaera.info/>
Ryan Robbins - 30 Jan 2006 08:47 GMT > What are people doing for the long term storage of digital photos? > > CDs/DVDs have a life of about 2-5 years > Hard Drives 3-5 years The answer is nobody really knows. I have 5 1/4-inch disks that are 15 years old and my old computer can still read them.
But hard drives lasting only three to five years? Where did you hear that? My first hard drive lasted more than eight years in regular use and I never had problems with it. My second hard drive (second computer) was still going strong after five years.
pip22 - 30 Jan 2006 09:42 GMT I wouldn't use RW media (CD or DVD) for long-term storage of anything you don't want to lose. RW media is less stable than 'write once' media. I know many people who never use RW media at all, not even for temporary storage, because they don't trust it. And since write-once media is now reasonably priced (even the prestige brands) there really is no good reason to risk using RW media instead, for whatever purpose
-- pip22
Peter - 30 Jan 2006 13:41 GMT > What are people doing for the long term storage of digital photos? > > CDs/DVDs have a life of about 2-5 years > Hard Drives 3-5 years > > Am I supposed to back up my personal photos to tape? Where I work we set up and maintain an archive (about 15TB now) on harddisks (RAID), which is, of course, closely monitored. It is copied continuously to two other places (at the moment) which have a mirror of the data (one on a different continent). All the software used and files in the archive must be open source/open format/free (it needs to be able to be read in a long time to come).
-peter
Tom - 30 Jan 2006 21:05 GMT I just have an idea. We can just print the binary data (use Base 64 encoding for example) to a piece of paper and then transfer the paper to micro film. These things last forget just like those micro film used for the newspaper archive in a library.
Whenever we need the picture back, we can just put the paper to a scanner and scan the binary data back.
The only question is how much we can put in a piece of paper... with a 1200x1200 dpi laser printer.
What are people doing for the long term storage of digital photos?
CDs/DVDs have a life of about 2-5 years Hard Drives 3-5 years
Am I supposed to back up my personal photos to tape?
David Dyer-Bennet - 30 Jan 2006 21:27 GMT > I just have an idea. We can just print the binary data (use Base 64 encoding for example) to a piece of paper and then transfer the paper to micro film. These things last forget just like those micro film used for the newspaper archive in a library. > > Whenever we need the picture back, we can just put the paper to a scanner and scan the binary data back. > > The only question is how much we can put in a piece of paper... with a 1200x1200 dpi laser printer. I've thought of this myself. Using a 2-d barcode, I don't know how high a resolution you can expect to print with a good expectation of being able to read the data *in 100 years*. Also it needs to be plain cotton-fiber paper, not coated, for greater longevity.
If you can adequately expect to read 1/10 inch bits, and the bar code including ECC redundancy uses 15% overhead, then in an 8x11 area (leaving 1/4 borders all around) you've got 88 square inches, and 100 bits per square inch, so 8800 bits minus 15% -- i.e. nowhere vagulely close to good enough. But my 1/10 inch bits may be unduly pessimistic, maybe. At 1/100 inch bits, you get 10,000 bits per square inch, so nearly a megabit on the sheet of paper.
It's going to be a pretty big archive, I guess.
 Signature David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/> RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/> Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/> Dragaera/Steven Brust: <http://dragaera.info/>
|
|
|