Forums > General Industry > Friendly Reminder - Data Migration

Photographer

Coarse Art

Posts: 3729

Lexington, Ohio, US

While enjoying the light hearted and edifying banter here on MM, I have actually been working - migrating data to new media.

Are you digital photographers keeping up on this? Since optical media is pretty short-lived and I don't have access to massive tape storage, I try to move it forward on a somewhat regular basis.

Today I am finding CD's as recent as 2003 that are beginning to fade, hence this reminder.

Nov 19 06 05:57 pm Link

Photographer

Rik Austin

Posts: 12165

Austin, Texas, US

2003?

Nov 19 06 05:59 pm Link

Photographer

Sophistocles

Posts: 21320

Seattle, Washington, US

Backups burned to quality name-brand single-layer DVD, disc-at-once finals, and kept in a protective binder out of the light can and should last as long as 20 years.

Nov 19 06 06:00 pm Link

Photographer

Paul Thomas 3

Posts: 1301

Denver, Colorado, US

External hard drives, my man. Big, fast, and cheap.

Nov 19 06 06:00 pm Link

Photographer

Sophistocles

Posts: 21320

Seattle, Washington, US

Paul Thomas wrote:
External hard drives, my man. Big, fast, and cheap.

A single head crash, and you lose it all.

If you go that route, do it to a striped RAID array and make sure you replace drives that die.

Nov 19 06 06:01 pm Link

Photographer

Craig Thomson

Posts: 13462

Tacoma, Washington, US

Tom deL wrote:
While enjoying the light hearted and edifying banter here on MM, I have actually been working - migrating data to new media.

Are you digital photographers keeping up on this? Since optical media is pretty short-lived and I don't have access to massive tape storage, I try to move it forward on a somewhat regular basis.

Today I am finding CD's as recent as 2003 that are beginning to fade, hence this reminder.

You failed to mention what you’re using for the new media.

Nov 19 06 06:02 pm Link

Photographer

Daguerre

Posts: 4082

Orange, California, US

Paul Thomas wrote:
External hard drives, my man. Big, fast, and cheap.

Christopher Ambler wrote:
A single head crash, and you lose it all...

Not if you use 2 drive sets, or 2 DVD sets, or data on DVD and tape.  My archived data is in 4 places, but it is still seriously unlikely that 2 data volumes will simultaneously fail.

I agree that Taiyo Yuden or Verbatum or TDK DVD/CD media should last 20 years. But I've been around long enough to know not to trust it.  Never will I put data in only 1 place, and only 1 DVD.

Nov 19 06 07:02 pm Link

Photographer

Coarse Art

Posts: 3729

Lexington, Ohio, US

Christopher Ambler wrote:
Backups burned to quality name-brand single-layer DVD, disc-at-once finals, and kept in a protective binder out of the light can and should last as long as 20 years.

Burned to quality ... {left out} on carefully calibrated laboratory equipment with clean lenses {/left out} ...

In the real world of (in my case) well used laptops and office PC's with potentially dirty lenses and misaligned heads along with the media degradation over time, I will spend the very tiny money and time required to keep them fresh thank you.

Before you wait 19 years and six months to migrate you might keep testing them and read some of the industry mags:
  http://computerworld.com/hardwaretopics … 07,00.html

I wish there was an easy way to keep digital images as well as my 35+ years worth of 35mm - 8X10 negs :-\

Nov 19 06 07:06 pm Link

Photographer

Conspicuous Photography

Posts: 86

Toronto, Ontario, Canada

Get 2 big drives, proceed with RAID 1. This way if one HDD dies, you can just go out and buy another hard drive and rebuild the mirror.

Or if you want to pay more, http://www.thermaltakeusa.com/product/S … 0001ln.asp

This seems like a great product although I have never tried it.

Nov 19 06 07:06 pm Link

Photographer

Coarse Art

Posts: 3729

Lexington, Ohio, US

Craig Thomson wrote:
You failed to mention what you’re using for the new media.

Due to the costs, right now I am simply moving everything forward to fresh DVD's and putting the best (and worked up) images on SLR tapes.

With decent DVD's below fifty cents, right now keeping stuff on them makes sense. The nice thing about digital is that as long as all of the bits can be read the quality will remain the same.

Nov 19 06 07:11 pm Link

Photographer

Richard Tallent

Posts: 7136

Beaumont, Texas, US

Christopher Ambler wrote:
If you go that route, do it to a striped RAID array and make sure you replace drives that die.

Word of caution: a "striped" array on its own (RAID 0) does NOT mean you can just swap out a bad drive. Quite the opposite: if *either* drive dies, you're screwed, since only half the data is stored on each drive (for read/write performance).

You want a RAID 1 array (mirrored drives), RAID 0+1, or RAID 5 (striped, mirrored, and distributed parity).

Of those, RAID 1 is the lowest-risk: with any of the others, if your RAID controller or software goes belly-up and you are unable to obtain another of the same type, you're *really* screwed. With RAID 1, theoretically you should be able to read either drive in any computer that supports the drive array's file system.

Also, RAID 1 may not have the fastest write times, but reads can be just as fast as RAID 0, if not better, depending on the controller hardware/software.

Nov 20 06 12:52 am Link

Photographer

Leonard Gee Photography

Posts: 18096

Sacramento, California, US

Richard is right about the Raid. You'd better have a spare controller if it's a hardware based raid - hardware based is the fastest. But you're not protected against viruses or malicious software. Two mirrored Raid 5 arrays with tape backup in depth is the only way to go if you want HD storage.

Head crashes aren't the only problem with a simple external drive. All you need is for one bit of the platter media to flake off from the partition table.

Nov 20 06 01:31 am Link

Photographer

R Michael Walker

Posts: 11987

Costa Mesa, California, US

Paul Thomas wrote:
External hard drives, my man. Big, fast, and cheap.

I'd call that risky unless you "exercise" them regullalry. More drive die while off than running 24/7. I use a server with Raid 5 for mine.
Mike

Nov 20 06 01:36 am Link

Photographer

R Michael Walker

Posts: 11987

Costa Mesa, California, US

Tom deL wrote:
While enjoying the light hearted and edifying banter here on MM, I have actually been working - migrating data to new media.

Are you digital photographers keeping up on this? Since optical media is pretty short-lived and I don't have access to massive tape storage, I try to move it forward on a somewhat regular basis.

Today I am finding CD's as recent as 2003 that are beginning to fade, hence this reminder.

How do you store them? If it's dark and dry you shouldn't have those porblems. I do mine every 3 years like clockwork cause I'm Paranoid! But no falty discs ever...even from the begenning od CDs. i now use DVDs. Still no problems but i have found a file or two that came back unrecogniziable from them. No entire discs though.
Mike

Nov 20 06 01:40 am Link

Photographer

Alluring Exposures

Posts: 11400

Casa Grande, Arizona, US

1 Terabyte Raid (I think 5, it's been a while and I don't want to look right this minute) with hot-swappable drives. I will never lose a single byte of data unless my whole rig gets stolen or a plane lands on it... because if one drive goes bad I just pull it out, replace it with a new one and the rig goes to town filling in the missing data on the new drive smile

Nov 20 06 01:45 am Link

Photographer

Le Beck Photography

Posts: 4114

Los Angeles, California, US

Christopher Ambler wrote:

A single head crash, and you lose it all.

If you go that route, do it to a striped RAID array and make sure you replace drives that die.

Not striped. Striped is for speed not redundance. Level 1 with drive mirroring or duplexing is for security.

http://www.storagereview.com/guide2000/ … iping.html
http://www.storagereview.com/guide2000/ … evel1.html

Nov 20 06 02:18 am Link

Photographer

Coarse Art

Posts: 3729

Lexington, Ohio, US

What interesting turns a little reminder to check backups has taken.

All of the external drive/RAID suggestions:

Is this solution for off-site backups as well? (Picturing some virus laden Windoze/RAID box chugging away in the safe deposit box {g})

FWIW I have several linux boxes with small(er) drives in RAID configurations which I try to keep up to date for redundancy. Still it's reassuring to have everything off-site on static media.

Nov 20 06 07:23 am Link

Photographer

Leonard Gee Photography

Posts: 18096

Sacramento, California, US

Le Beck Photography wrote:
Not striped. Striped is for speed not redundance. Level 1 with drive mirroring or duplexing is for security.
http://www.storagereview.com/guide2000/ … iping.html
http://www.storagereview.com/guide2000/ … evel1.html

Striped is speed with redundency. Each byte is split on separate drives with a checksum. The checksum is redundency in a different form. When you lose a drive, the lost bit is recaculated from the checksum, restoring the missing bit.

Nov 20 06 03:57 pm Link

Photographer

Charlie Schmidt

Posts: 856

Kansas City, Missouri, US

Disk striping stores each data unit in only one place and does not offer protection from disk failure.


If you want failure protection...move to level 5

Nov 20 06 07:17 pm Link

Photographer

Coarse Art

Posts: 3729

Lexington, Ohio, US

Kansas City Media Group wrote:
Disk striping stores each data unit in only one place and does not offer protection from disk failure.

If you want failure protection...move to level 5

Actually RAID levels 3, 4 and 5 can all tolerate the failure of one of drives.

Levels 1 and 10 offer better fault tolerance being mirrored, if duplexed they can even tolerate loss of a controller.

Now I hope that all of this RAID nonsense hasn't obscured the original point of this thread:

   ***** ***** ***** *****
OPTICAL MEDIA IS NOT FOREVER.
   ***** ***** ***** *****

Sorry for shouting.

Nov 20 06 07:45 pm Link

Photographer

Charlie Schmidt

Posts: 856

Kansas City, Missouri, US

Tom deL wrote:

Actually RAID levels 3, 4 and 5 can all tolerate the failure of one of drives.

Levels 1 and 10 offer better fault tolerance being mirrored, if duplexed they can even tolerate loss of a controller.

Now I hope that all of this RAID nonsense hasn't obscured the original point of this thread:

   ***** ***** ***** *****
OPTICAL MEDIA IS NOT FOREVER.
   ***** ***** ***** *****

Sorry for shouting.

With RAID 3, simple parity sums are used for redundancy..Simple Sums
I do not and could not, recomend, or consider this true talerant....You do no see much 3 out there..mybe it's just me?!?!

as for your opitical media statement....I agree...but then again nothing man made lasts forever?

Nov 20 06 07:59 pm Link