How To Properly Archive Data On Disc Media

An anonymous reader writes "Patrick McFarland, the well-known Free Software Magazine author, goes into great detail on CD/DVD media over at the Ad Terras Per Aspera site. McFarland covers the history of the media, from CDs through recordable DVDs, explaining the various formats and their strengths and drawbacks. The heart of the article is an essay on the DVD-R vs. DVD+R recording standards, leading to McFarland's recommendation for which media he buys for archival storage. Spoiler: it's Taiyo Yuden DVD+R all the way. From the article: 'Unlike pressed CDs/DVDs, burnt CDs/DVDs can eventually fade, due to five things that affect the quality of CD media: sealing method, reflective layer, organic dye makeup, where it was manufactured, and your storage practices (please keep all media out of direct sunlight, in a nice cool dry dark place, in acid-free plastic containers; this will triple the lifetime of any media).'"

M*Farland?

[MDMurphy]

I'm sure it's just a coincidence that we have to articles posted by anonymous readers linking to "famous author" M*Farland, but it struck me as odd. Especially since he commented on the USB story. Could there little astroturfing going on?

It's not like we haven't seen that before ( Roland P* )

Re:Dupe...

[LighterShadeOfBlack]

It is a good article on the pros and cons of DVD-R vs DVD+R in general, however I'm not too happy with the way the author recommends one particular brand over others like that without any hard data to back it up. It's quite possible it's absolutely true and they really are a superior brand of discs, but without presenting any numbers to support his assertion it will remain nohing more than one person's opinion.

Why bother with optical?

[Anonymous Coward]

A 500GB hard drive is like $150 these days and 1TB drives are just around the corner. Drop one into a $10 USB enclosure and backup your stuff using rsync. To do it right, do this twice with 2 different drives and store them in 2 different physical locations. I don't care what fancy pants brand of DVD-R you use, a magnetic solution is still superior in both durability and simplicity (try backing up 100GB of data using a DVD writer and a hard drive, then tell me which one took longer).

Re:Dupe...

[Dogtanian]

I'm not too happy with the way the author recommends one particular brand over others like that without any hard data to back it up.

To be fair, whilst I'm not claiming that I've never come across criticism of Taiyo Yuden, they seem to be consistently ranked #1 in reliability and quality. In fact, come to think of it I can't recall seeing any reviews where their media (overall) weren't the top rated.

I believe that Verbatim (owned by Mitsubishi) are also very highly rated (except for a brief period in 2002 when they switched to a far less reputable media supplier). More info in this article. [digitalfaq.com]

Bear in mind that a *large* number of major brands don't make their own media; these include companies such as Memorex, Fuji and Emtec (formerly BASF). Apparently you can look at the cakebox/packaging style and media type and figure out if it's good-quality rebranded media inside, but I don't buy enough discs for this to be worth my time; more sensible just to buy from companies that do their own.

Re:Why bother with optical?

[Master of Transhuman]

What's your time worth? As someone said, backing up 100GB of data - something I do periodically and I do it on DVD - takes time. I back up over 200GB of data off my machine to DVD - it takes me most of a day of personal attention. Backing that up to an external hard drive would take much less time and require nothing more than starting the transfer (depending on how the files are being selected of course).

That said, DVD (or tape, of course) is better for offsite archival storage than disk in many, if not all, cases. But nothing can beat disk for fast, local, immediately available backup.

And disks are getting cheaper and with more capacity all the time. While tape is approximately matching disk capacity - and even speed if you buy high-end units - tape drives that can handle that capacity and speed are way more expensive than disks.

It's a no-brainer. The only reason I haven't switched yet to disk backup for everything is that I can't right now afford to buy the drives vs buying 50 DVDs at a time. Plus I'm waiting to upgrade to a whole new machine, at which point I'll move the current machine to act as a file server and attach an external USB or NAS drive system as a backup. This will give me three tiers of backup - the workstation, the file server, and an external backup. Then I can still periodically burn to DVD for offsite storage if I want to.

Re:Why bother with optical?

[KokorHekkus]

And add to this that failure of one optical disc is less catastrophic. If one optical disc fails you have a lot less loss than if one drive does... of course that means more work but there is always a trade-off, isn't there. You could argue that you should have more than one drive but the same goes for optical disc.

From personal experience optical discs might need one more step though: to verify that the write was ok. I don't have any optical discs that have failed me yet after I started to check writes... turns out the only problem was that I had a writer that was about to give up. Hence not a read error but a write one... after that I always run a check.

And a anecodotal story against those who says that it will "allways fail in N months". A swedish tv program took some burned DVDs, put them in a plastic bag and chucked them outside under a bush for about 3 months no problem reading them. So with optical media: check your write + store them as proper archieval media should be.

Re:Why bother with optical?

[MMC Monster]

On topic: People should use something like par2 to create some fault tolerance so that when a few bytes go bad (or a scratch develops) the entire DVD+/-R is not toast.

I typically create data DVDs with 30% redundancy information (though smaller percentages are probably more than adequate) with par2create, and store those par2 files on the same DVD. That way I survive the little scratches and can recreate the data.

Use dvdistaster

[arose]

No matter what format you choose create error correction data [sourceforge.net].

DVD Writable sucks badly as archival technology.

[gweihir]

Sorry, but if you have to select media and burner based on some black magic, then the technology is entirely unfit to be used for any archiving. Archival media give you ensurances like 30 years data lifetime in any combination. You can already get that with MOD. MODs have >50 years data lifetime and drive makers will allways support the lasdt three media generations (currently they are supporting all, i.e. the last fife generations and that wor reading and writing). The only DVD technology that is somewhat comparable is DVD-RAM with cartridge. But that seems to have zero market share in the computer business.

My conclusion is that either people do not care about their archived data or that the number of, e.g., lost baby- and wedding-photographs is not high enough yet.

But how reliable are HDDs?

[AmiMoJo]

I ask myself this a lot: how reliable are HDDs in the long term?

Say you use them for archiving. It is better to go the NAS route and have them always on, or powered down when not in use? How about a USB enclosure only connected when in use? How reliable is an almost-new used-it-once HDD that has been sitting on a shelf for five years?