Author Topic: 4 TB external storage solution  (Read 1289 times)

Offline datora

  • Member
  • Posts: 1411
  • "Warning! Otaku logic powers in use!"
4 TB external storage solution
« on: May 27, 2011, 08:13:21 PM »
.
I've finally, after nearly half a year, scrounged enough extra change to create an external storage/ back up solution.  I though I'd document it here so people could reference it.

Objective:
 - "Large" external storage (2 or 3 TB drive), utilizing USB + possibly another connection
 - intended to be powered on "occasionally: estimate ~2-4 hours/day average

Compromises:
 - limited to USB 2.0 (had wanted USB 3, plus maybe eSATA 6)
 - drives "adequate" for reliabiility; had wanted WD Caviar Black or equivalent

Bonus:
 - obtained 2-drive external housing, so can go 4 TB instead of expected 2 TB
 - total cost: $174.97; had expected similar cost for a single drive


Hardware:
 - Rosewill R2-JBOD Aluminum 3.5" USB 2.0 DUAL-BAY External Enclosure - $34.99 (promo code: EMCKEHF59)
 - SAMSUNG Spinpoint F4 HD204UI 2TB 5400 RPM 32MB Cache SATA 3.0Gb/s - 2 x $69.99 (promo code: EMCKEHC22)

Newegg.com started running some aggressive Memorial Day sales this week, so I was able to spend slightly more and get more drive space.


Wanted to list this in case anyone wanted to jump on the deal while it lasts.  I've been watching hard drive and enclosure ratings for over half a year and this is a pretty solid bet and an outstanding deal ... so long as nothing goes wrong.  And, the odds are pretty good that nothing will.

I would have preferred a USB 3.0 solution.  My current computer cannot use it, but I wanted forward compatibility and the option to use USB 3 when connecting to other, more modern computers.  Too bad.  I expect this particular 2-drive enclosure to be offered in USB 3.0 before much longer; I suspect that this USB 2 case is old stock they are liquidating.  An eSATA would have been a nice bonus, but is a bit exotic and I won't miss it.

On the plus side, this case will accept any SATA 3.0 GB/sec or 6.0/sec hard drive, and automatically detect & use the specification.  According to the comments, it looks like I can mix & match, if I wish.  But, this will end up with two identical drives, so I shouldn't have to worry.  The drives I intend to use also have been reliably installed in this case by other users, so there shouldn't be worries there either.

The case supports what appears to be RAID 0 (they call it "BIG") where both drives are seen as a single volume.  I doubt I'll use that.  I got the case specifically for its JBOD mode, where it sees each drive as a separate volume.  For my own reasons, this is the only mode I can really use since I will occasionally swap individual drives in and out of the case.


The Samsung HD204UI drives themselves have about the most solid reviews of any 2 TB drives available.  They are intended as long-term storage devices, with efficiency favored over performance.  This is just fine by me.

I would rather have had Western Digital Caviar Black drives or the equivalent since that is the step-up required for significantly increased reliability.  However, the costs for those drives is prohibitive at ~$150 each.  I don't trust the WD green drives.  I have a pair of 750 GB WD Caviar Blacks @SATA 6.0 GB/sec which have been in service nearly 24 hours/day for about a full year now, and they are very solid.  I use them as my primary OS installation drive and mirror them back & forth every ten days or so.  Big happy there.

One of the Hitachi 2 TB  drives was available on sale for $59.99 each earlier in the week, but the reviews didn't give me very good warm fuzzies.

I had breifly entertained the idea of a 3 TB model, but the tech still seems a bit .... fragile.  Even  the 2 TB tech is still a bit shaky.

However, I went with the Samsung because I started using one last September, and it's been powered on & in service as an internal drive nearly 24 hours/ day ever since.  Also, it's been pretty packed since Day One.  I immediately archived ~1.3 TB to it last fall and have filled it the rest of the way since, with a number of deletions & rewrites.  It now has ~60 GB of free space.

I consider it reliable and recommend it as if I would use several of them myself.  ;)

Over the upcoming week I'll be playing with the new hardware as it is delivered.   I intend to switch drives around a bit & check different compatibility, like placing one 750 WD drive in with one 2 TB Samsung, swapping existing data archives into the enclosure, and formatting a 2 TB drive via USB connection, for examples.


So, wish me luck, folks.  Please!  My luck has been pretty bad the past two years and I need a nice, smooth large data archive option to "just work" right now so I can focus on other things.
I win, once again, in my never-ending struggle against victory.

Offline Hiero

  • Member
  • Posts: 978
  • Futile attempts at being funny
Re: 4 TB external storage solution
« Reply #1 on: May 27, 2011, 08:40:13 PM »
I finally got around to getting the set up we had talked about in the pm's awhile back and it's working well. I saw the Memorial savings also and I'm thinking of picking up another Samsung 2TB also haha.
Good luck with your project/ experimenting though.
Life is short, art long, opportunity fleeting, experience treacherous, judgment difficult

Offline Freedom Kira

  • Member
  • Posts: 4324
  • Rawr™.
Re: 4 TB external storage solution
« Reply #2 on: May 27, 2011, 11:39:01 PM »
I was under the impression that JBOD puts the two drives together into one volume, but does not stripe the data as RAID 0 does for extra performance (and therefore your data would be a tad more secure). Don't use RAID 0 unless you can stand to lose all of the data on the disks. If one drive fails, all your data is gone.

Hitachi is a solid brand for HDDs. I recommend you go look at the reviews again for the 2TB disk, and filter by ratings. Specifically, look at all the 1 egg ratings. I scrolled down about halfway, and every single one I read up to that point was a DOA report. And, if you have any experience with Newegg, they make DOA RMAs very hassle-free. If you're really paranoid, you should go with their enterprise-grade disks.

Also, keep in mind that 3TB disks tend to be faster than 2TB disks of the same speed because of their higher data density.

I'm gonna be building a server later this summer with some of Hitachi's 3TB disks (probably five of them in RAID 5). Look forward to it. =P

Offline bork

  • Member
  • Posts: 251
  • Huh ?
Re: 4 TB external storage solution
« Reply #3 on: May 28, 2011, 01:07:40 AM »
The reason for those DOA could be due to the drop kick shipment method.  I never have been comfortable with mail order disk drives, asking for trouble as I see it.  I have worked around the UPS shipping hub during my college years know how the trucks were loaded and unloaded, did try to be nice but things did get bounced.

Hitachi are a good disk, the 3.5-inch drives have never failed on my so far (except the ones I opened up to see inside).
« Last Edit: May 28, 2011, 01:14:09 AM by bork »

Offline datora

  • Member
  • Posts: 1411
  • "Warning! Otaku logic powers in use!"
Re: 4 TB external storage solution
« Reply #4 on: May 29, 2011, 05:14:06 AM »
.
OKay, so a preliminary evaluation of the Rosewill enclosure.  Received this afternoon and was able to play with it for a couple of hours tonight.  Everything applies to a Win XP Pro system with all current patches.

First off: JBOD.  This mode, does indeed, mount the two hard drives as completely separate entities.

You can place a single drive in this enclosure and it will work.  Today I used drives that had already been formatted and filled with data.  Drives slip right into place beautifully, right onto their SATA data & power connectors without any undue stress.  In fact, I was concerned they might not be tight enough connections, they go on and off so smoothly.

I used two drives: one a Samsung 2 TB as described above, the other a Western Digital Caviar Black 750 GB as described above ... except I got the model slightly off.  Mine do not use the SATA 6.0 GB/sec specification .. they use the 3.0 spec (SATA II or SATA 300).  The Samsung is 5400 rpm, the WD is 7200 rpm, both have 32 MB cache.

My system is a few years old.  It uses the first SATA I specification (SATA 150).  Actually, it primarily relies on PATA-100 and "just happens" to have two SATA 150 connections as an option.  My PATA drives have been failing and giving me other fits & serious issues, thus one major reason for this project: to get away from the PATA drives completely.

So, the Samsung drive auto-detects.  It is a SATA II spec drive, but when connected to a SATA I controller it auto-adjusts its data rate.  The WD drives need to be jumpered to limit them to SATA I data throughput.  It's especially important because I use them as boot drives and hard-forcing the specification reduces confusion by the BIOS & operating system.

Important why ..?  This evaluation allows me to figure out how to transfer ~2 TB of data by the best method, close to 800 minutes of time saved per TB, or well over 20 hours.  Damn, but I sure do wish I was using a USB 3.0 system ....  :'(

Here's the speed tests.  The WD drive has a jumper in place when installed as an internal drive, but the jumper is removed when it is installed in the enclosure.  The enclosure auto-detects between the SATA 3.0 & 6.0 GB/sec specifications, and I could not find any reference to it handling the SATA I spec ... so, figured I didn't want the WD drive limited for at least that reason.

I used a torrent directory: The Twelve Kingdoms because of its nice size (15.31 GB/ 16,441,679,049 bytes) and it's broken down into 45 files approx. 352-367 MB each, ~355-356 being most common.  I also used four photo directories (15.4 GB/ 16.623,070,358 bytes) that consist of 3,953 files approx. 4,700-5,900 KB each, ~5,000-5,300 being most common.

Data transfers are more efficient/faster when in fewer large files than when in many smaller files.  These show the trend.  It is casual: I did not perform duplicates in true scientific/statistical fashion, and my timing could be off by ~3 sec since it was all manual.  The "enclosure" is when the drive is mounted in the external hard drive case, "internal" is inside my PC using the SATA controller on the motherboard.

from enclosure (Samsung 2TB) > internal drive (WD 750 GB)
~10:15 min (12 Kingdoms)
~12:26 min (pictures)

from enclosure (WD 750 GB) > internal drive (Samsung 2TB)
~9:47 min (12 Kingdoms)
~12:53 min (pictures)

from internal drive (WD 750 GB) > enclosure (Samsung 2TB)
~11:42 min (12 Kingdoms)
~14:30 min (pictures)

from internal drive (Samsung 2TB) > enclosure (WD 750 GB)
~11:56 min (12 Kingdoms)
~12:29 min (pictures)


from internal drive (Samsung 2TB) > internal (WD 750 GB)
~5:23 min (12 Kingdoms)
~5:49 min (pictures)

from internal drive (WD 750 GB) > internal (Samsung 2TB)
~4:34 min (12 Kingdoms)
~7:05 min (pictures)


from enclosure (Samsung 2TB) > enclosure (WD 750 GB)
~20:01 min (12 Kingdoms)
[N/A] (pictures)

from enclosure (WD 750 GB) > enclosure (Samsung 2TB)
~20:06 min (12 Kingdoms)
[N/A] (pictures)


All in all, no real surprises.  It's all in line with USB 2.0 transfer speeds.  Weird aberration: the 4:34 & 7:05 times when transferring from the WD to the Samsung when both drives were mounted internally.  I think there was some sort of data bottleneck to cause the 7 min time; I think it should have been about 6 or slightly under.  I was watching the CPU usage and noticed a couple big spikes that coincided with delays in file transfer.   Actually, fairly normal activity that can be observed when watching USB 2.0 transfers.

Interesting in that it seems a trend: when transferring several large files from the WD to the Samsung, I get my best times ... but I pay for it when transferring many smaller files from the WD to the Samsung; the Samsung to WD transfers seem more consistent.  Must be an interesting caching/hardware configuration going on between them.  It'll be interesting when I can try this between two Samsung drives.

Transfers between the enclosure and internally mounted drives used the most processing power.  I have a 3.0 GHz P4 duel core, which settled in about 30%-35% load across the USB connection.  When transferring across the internal SATA controller, the load dropped by about 5%-10%, bouncing around 20%-30%.  When transferring data between drives when they were both mounted in the enclosure, CPU load dropped about another 5% ... poor compensation for such a miserable data transfer rate.

Generally speaking, my system was tweaked to run at fairly minimal load.  No major apps, not even web surfing or WinAmp.  I was running utorrent, but CPU load was steady at 3%-5% before any data transfers started.  Memory use was nominal at ~320 MB.

The greatest disappointment was: I had hoped that when two drives were mounted inside the enclosure in JBOD mode that they might transfer data between themselves at the SATA II specification.  Instead, I got the worst of all worlds: a miserable half-speed of the USB 2.0 specification.  Clearly the external case routes the data through the motherboard, then use the USB to route it back to the case again, thus doubling transfer time.  That's also why I didn't bother transferring the picture directories on the last set; it probably would have taken 30 or 40 minutes for each.


I'm really pleased with the enclosure.  It is solid, brushed black anodized aluminum.  It has substantial mass; I was surprised & happy since it will provide nice heat sink capacity.  The enclosure uses a small fan, which is reasonably quiet, but not silent.  I don't expect any heat problems; I don't have a utility handy that captures the drive temp over the USB connection, but the case remains cold to the touch after several hours of continuous data transfer.

The greatest annoyance with the case is the way it mounts the drives to the system.  While it is powerful -- it treats the drives as essentially mounted internally, so formatting, partitioning, etc. are easy -- it does NOT allow use of the Remove Hardware utility with Windows.  The drives remain "In Use" and the only ways to 'unmount' the case are to 1) power the computer off to a cold boot or 2) turn the power switch off.  Neither attractive options.  I suppose 3) jerk the USB cable out of the socket ... but that runs the highest risk of unpleasant side effects.


Watching movies/anime, listening to music and torrenting (all at the same time, even!) over the USB connection to directly stream data off the drives works perfectly, as expected.

So, I got what I wanted: large, slow-ish storage that seems to be well-protected and reasonably versatile.  When the other drives arrive, I'll have ~3.63 TB formatted capacity to archive things, in duplicate on physically separate drives for the unique, real important stuff (like my photos and live recordings).  Not much more to the story anymore ... other than, I'll report back or respond to questions on how well it all holds up under use over time.
« Last Edit: May 29, 2011, 05:30:01 AM by datora »
I win, once again, in my never-ending struggle against victory.

Offline shadowmaniac

  • Member
  • Posts: 420
Re: 4 TB external storage solution
« Reply #5 on: June 01, 2011, 12:51:39 PM »
Thanks for the post. Was gonna build something similar once I get the $$ as well and this post is sure gonna come in handy.

As a side note, I'd like to recommend the SAMSUNG Spinpoint F4 HD204UI 2TB.
I've primarily been using Western Digital Caviar Green WD20EARS 2TB but bought the Samsung one since it was on sale and so far, it ran just as well as the WD20EARS (despite having half the cache; at least, I did not notice a significant reduction in performance) with a slight yet significant difference: the Samsung drive ran at 4-7 degrees lower than the WD drive.

Offline datora

  • Member
  • Posts: 1411
  • "Warning! Otaku logic powers in use!"
Re: 4 TB external storage solution
« Reply #6 on: June 01, 2011, 04:34:54 PM »
.
That's why I posted it!  ;) :D  Awesome if it helps anyone ... these external storage solution questions are pretty common around here.

I'm currently playing around with the Samsung sector alignment tool ... initially very unhappy as it wants 1 day and 15 hours (!!!) to align one 2 TB drive over USB 2.0.  Playing around with different tools and Win XP disk management.  Example: need 5:03 hours to format over USB 2.0 connection (which should be about the same as internally mounted, but we'll see).  Gonna write 1s across the drive for full wipe and some other etc. to help burn 'em in before I actually put them into service as my archive.

So, more posts later.

However, newegg just put 2TB Western Digital Caviar Black drives (7200 rpm/ 6.0 GB/sec) on sale for $139.99 delivered (promo code EMCKEGJ44).  Considering they were $189.99 just three weeks ago, that is a substantial price reduction for premium drives.  I can't use the deal, but if anyone wants a top drive for either internal or over a USB 3.0 external connection, these are pretty much the only choice at the top end.

I'd use these to build a 5-drive NAS if I had the cash ....
I win, once again, in my never-ending struggle against victory.

Offline Lupin

  • Member
  • Posts: 2169
Re: 4 TB external storage solution
« Reply #7 on: June 02, 2011, 10:31:40 PM »
The greatest annoyance with the case is the way it mounts the drives to the system.  While it is powerful -- it treats the drives as essentially mounted internally, so formatting, partitioning, etc. are easy -- it does NOT allow use of the Remove Hardware utility with Windows.  The drives remain "In Use" and the only ways to 'unmount' the case are to 1) power the computer off to a cold boot or 2) turn the power switch off.  Neither attractive options.  I suppose 3) jerk the USB cable out of the socket ... but that runs the highest risk of unpleasant side effects.
Did you try disabling write-caching for the drives?