I've not heard any out-and-out horror stories, but I've got no first hand experience.
I'm planning on picking up 3x manufacturer recertified 18TB drives from SPD when money allows, but for now I'm running 6x ancient (minimum 4 years old) 3TB WD Reds in RAID 6. I keep a close eye on SMART stats, and can pick up a replacement within a day if something starts to look iffy. My plan is to treat the 18TBs the same; hard drives are consumables, they wear out over time, and you have to be ready to replace them when they do
I'm running several used ("renewed") enterprise SAS HDDs and enterprise SATA SSDs. They've been solid so far.
The HDDs came with about 30k hours each which is not bad at all, and the SSDs only had around 100 TB written out of the total 6.2 PB rating.
I'm not sure I would do used with standard consumer HDDs, they typically don't last as long and are likely abused a lot more in a desktop PC vs a datacenter server.
As always have proper backups in place, all drives fail eventually no matter where you buy them.
At one point, I found a complete set of ROMs for every single game on retroachievements.com. It’s almost assuredly out of date by now, and I’m not saying it would have every single Vimm ROM…. But there would be a lot of overlap. If any are already wiped from Vimm and nobody has a backup, let me know and I’ll do some digging to see if I have anything comparable.
100TB??? What the heck did you store in there?
A lot of "Linux ISOs", ok, I get it, but how many GB is each? Some may be 10/20GB, but I guess that most of them are about 2/4GB. Some images of old drives, ok (some TB), and then?
I've lost count, but upwards of 10,000 Movies/Shows (and ofc each show could have 10, 20 or even 100+ individual files) that only comes to about 100-120TBs
The remaining 150 or so (My usage is 280TBs, I just locked in a limit of 300) is, well, my entire life that isn't deemed so important as to go to my actual personal GDrive. It's not just some images, it has every image of every drive and device I've ever owned just prior to it being put out of service.
Man, this is really kind of annoying that the old price aggregate sites like Shucks.top aren't working anymore. I did flop between pcpartpicker, disk prices, and just searching the sites directly and found a 16 and 18 TB WD drive for 219/285 respectively so ~14/16 dollars per TB respectively. Guess I'll just have to go with the 16 because I'm cheap and need storage very soon.
With Amazon if you have prime shipping or next day delivery (whatever they call it) enabled it will only show stock in your local distribution centre. Turn it off and get the real stock levels.
I use jellyfin to host everything; movies, shows, books. It can tag matadata and id most books fairly well. But do not use it's built in reader. I don't know about comics though. I can then easily download whatever book to any device connected to the jellyfin server and use local software to read it.
I usually just use librera reader as it's open source and highly customizable. But it does have it's glitches.
What I know: https://raid.wiki.kernel.org/index.php/A_guide_to_mdadm
No need to do hardware raid, mdadm is great.
I got an HBA card off of art of server on eBay, and have ungodly amounts of disk. Also, am ungodly power bill...
You can stick regular SATA drives into a SAS Bay, but not SAS drives into a SATA bay.
Some HP equipment is bitchy about non -HP drives, cards, etc.
I saw a fair amount of "Do RAID 6!" But I found on my hardware that RAID 5 and a hot standby was moderately faster.
Try not to mix drive sizes, it messes things up and wastes space.
Have fun!
I just found a dell h200 for 27€ shipping included on aliexpress.
It should be already flashed in IT mode, right? This screen pic is in the description:
Maybe a plug-in for Lemmy server could be developed to automatically back up and / or restore instances from Arweave. Some protocol could be used to turn the instances into Json, which could then be uploaded as documents and parsed, or something like that. And then the Json could then be potentially restored. There might be many pages for a large instance, but they could perhaps be organized in a thoughtful and functional way.
Any good tools to deduplicate files? Got a bunch of images with different names, on different folders, sometimes with different resolutions, spread out across 10 external hard drives that I need to go through...
This was done by hand on my end. If I had needed to do it procedurally, I’m not sure what my approach would have been, but the direction I’d probably head in would be to look into finding duplicate MD5 hashes.
I get what you’re proposing but I’d respectfully suggest looking into unRAID on basically any hardware that can boot an OS.
It won’t necessarily be small and cute (though you can accomplish that if you wish), but you can make it do just about anything. I bought old enterprise hardware to run my main and backup servers on. I feel really comfortable with my data safety.
FYI you probably shouldn't be saying you feel really comfortable with your data safety while suggesting unraid. The way unraid handles it's storage will lead to data loss at some point. Unraid only locks down an array and protects it when smart starts issuing warnings that a drive has failed. Smart isn't magic though and when a drive starts to die it might start writing garbage data for days if not weeks before smart catches on. If a drive writes garbage for long enough there's nothing you can do to fix it due to that way unraid handles arrays. This is why ZFS is such a popular option as it treats hard drive with a level of skepticism and verifies the data was actually written correctly along with verifying the data from time to time.
That's not even mentioning unraid is charging for what other software does for free.
Sorta... If the array was built with hybrid ZFS within unraid which is what the majority of unraid users go with as it allows for better mixing of various sized drives and easier expansion of the array in the future (in other words the main selling points of unraid) then you do not get any of the safety nets ZFS provides as what unraid is essentially doing is making a single drive zfs vdev for each drive in the array. In unraid's own words "ZFS-formatted disks in Unraid's array do not offer inherent self-healing protection.".
Unraid natively supports full ZFS arrays in addition to unraid arrays since the last major release. Can mix and match both types on the same system as necessary.
All of my (easily replaceable) Plex media is native unraid arrays while my documents are all on a ZFS array on the same system with snapshots and such. It’s the perfect solution.
You say the sound comes from the power supply and the HDD is not plugged into the computer.
My diagnistic: the power-supply makes a noise when it operates at very low load (almost 0mA of current), it is probaly making the cyclic noise because of some blinking LED or another very small variation of the loaf somewhere.
This is a very common symptom of cheap power-supplies, but it doesn't necessarly mean it isn't working normally, just an annoyance.
It wasn't sensible, given the short life of DNA. One of those sci-fi ideas that caught media and technophile attention, but wasn't ever going to go anywhere.
Project Silica appears to be attempting very high density, very long life storage, though.
I recall watching a documentary (on Curiosity Stream maybe? I'm no longer subscribed) on data storage longevity. It covered DNA storage, which I think this PBS video w/ transcript provides more recent coverage of its developments. As well as holographic storage, which I could only find the Wikipedia page for.
As for which one I think might be the future, it's tough to say. Tape is pretty good and cheap but slow for offline storage. Archival media will probably end up all being offline storage, although I could see a case for holographic/optical storage being near line. Future online storage will probably remain a tough pickle: cheap, plentiful, fast; select at most two, maybe.
datahoarder
Top