datahoarder

scrubbles , in SAS hardware questions
@scrubbles@poptalk.scrubbles.tech avatar

Personally, I recommend the lsi cards. Those things are tanks. The lsi 8i (8 internal) has been my friend for many years without fail. It does support jbod, so no raid, and I hooked a tape drive up to it too.

Tell me more about your tape drive though, I'm unhappy with mine and I'm looking to replace it

syaochan OP ,

Sorry but I haven't got the tape drive yet. I found an HP lto-5 ultrium 3000 on ebay but I'm not sure if it's a good choice

scrubbles ,
@scrubbles@poptalk.scrubbles.tech avatar

Feel free to ping me if you make the jump, I learned a lot about it. Biggest thing I can recommend is double triple make sure everything supports ltfs, it will make your life 1000% easier.

TCB13 , (edited ) in SAS hardware questions
@TCB13@lemmy.world avatar

Yes the Dell H310 will work, but be around 40$. Other good options:

  • Supermicro AOC-S3008L-L8E LSI 9300-8i - should sell for around 40$
  • Dell H200 IT - less expensive, like 25$

There are also other cards from less known brands, just search ebay or aliexpress for LSI 9211-8i or LSI 9207-8i.

syaochan OP ,

I just found a dell h200 for 27€ shipping included on aliexpress.
It should be already flashed in IT mode, right? This screen pic is in the description:

https://feddit.it/pictrs/image/1905f636-52f7-46b7-a405-189ae3f9fc7e.webp

phanto , in SAS hardware questions

What I know: https://raid.wiki.kernel.org/index.php/A_guide_to_mdadm
No need to do hardware raid, mdadm is great.
I got an HBA card off of art of server on eBay, and have ungodly amounts of disk. Also, am ungodly power bill...
You can stick regular SATA drives into a SAS Bay, but not SAS drives into a SATA bay.
Some HP equipment is bitchy about non -HP drives, cards, etc.
I saw a fair amount of "Do RAID 6!" But I found on my hardware that RAID 5 and a hot standby was moderately faster.
Try not to mix drive sizes, it messes things up and wastes space.
Have fun!

ReversalHatchery , in Archiving Lemmy instances

You may reach out to the Archive Team. They are not related to archive.org, but they often work together.

They're reachable on IRC, but if you know how, you can also visit the channels from Matrix.

MichaelTen , in Archiving Lemmy instances
@MichaelTen@lemmy.world avatar

Maybe a plug-in for Lemmy server could be developed to automatically back up and / or restore instances from Arweave. Some protocol could be used to turn the instances into Json, which could then be uploaded as documents and parsed, or something like that. And then the Json could then be potentially restored. There might be many pages for a large instance, but they could perhaps be organized in a thoughtful and functional way.

grue , in Archiving Lemmy instances

I don't know enough about how ActivityPub works to be sure, but I suspect the right way to archive a Lmy instance would be to create software that acts like another instance, federates with the one you want to archive, and saves the raw stream of ActivityPub packets.

Baku OP ,
@Baku@aussie.zone avatar

Oh, yeah, you're probably right. Unfortunately I absolutely do not have the knowledge required to do that, but I'll keep it in mind. Thanks

person , in Archiving Lemmy instances

Well since posts are numbered sequentially, you could archive all of them by generating the links. Tiny issue is, this would include every post that was federated with the server, which is almost 2 million it seems. A bit overkill for a relatively small instance.

I think if you filter by local on the main page and click next until you get to the end, there aren't that many pages. You could save those with outlinks.

Also, I believe, the posts will live on on other instances regardless.

Baku OP ,
@Baku@aussie.zone avatar

Oh good idea, thank you! Yeah, I think because of the federation stuff, it should persist, although I think that will complicate searching and finding things. I'm pretty sure this is the largest instance to go down to date, so I'd rather be safe than to lose things, even if it is only a small instance.

This does make me a bit nervous for how archiving larger instances will look when one eventually dies, though. A spider that logs everything into a spreadsheet and then splitting into different groups would probably be the best option. Or maybe a local ArchiveBox setup could work too. All the Lemmy admins seem fairly resonable though, so perhaps they might even upload everything directly into the Internet Archive themselves

Deebster OP , in Lost Doctor Who episodes found – but owner is reluctant to hand them to BBC
@Deebster@programming.dev avatar

Sounds like these 80 year olds need some friendly data hoarders to help them to digitise their collections. (Or for the BBC to promise to return the film, undamaged, once they've digitised them.)

user224 ,
@user224@lemmy.sdf.org avatar

Or for the BBC to promise to return the film, undamaged, once they’ve digitised them.

"Yeah, so..., we lost them it seems. But not to worry, here's a £10 voucher to McDonald's."

otter ,
@otter@lemmy.ca avatar

Convincing them should be easy enough as long as it's someone trustworthy

The media is going to be degrading every day that it's not digitized

netburnr , in Remember Seagate’s Dual Actuator HDDs? They’re Back, in SATA Form
@netburnr@lemmy.world avatar

It's a Seagate, i would never buy it. Host (now wd) for life.

empireOfLove ,

Timd to update your criteria, friend. Seagate hasn't been top of the failure stack for like 8 years now. The 3TB scandal era is long since passed. Now it's WD who has been shitting on quality control, sending out faulty SSD's that wipe user data, bait-and-switching HDD customers with a cheaper, much worse performing technology (SMR) WITHOUT TELLING THEM, them basically blowing corporate raspberries at everyone when people complain.

While i agree they were the best, HGST also hasn't even existed as a non-WD product for years....

Sharpiemarker ,

Yep. Seagate have earned their reputation. Pass.

pastermil ,

Care to elaborate?

Sharpiemarker ,

They've had some of the highest failure rates among drive manufacturers.

roawre ,

Care to elaborate? Seagate is one of my favorite brand. And i read a lots of reviews and tech articles before purchasing any components. I am curious to learn about what i have missed about them. Thx

Nollij ,

Not OP, but this comes up regularly.

A lot of people have very strong opinions of brands based on a woefully inadequate sample size. Typically this comes from a higher than expected failure rate, possibly even much higher than expected. It could've been a bad model, a bad batch at manufacturing, improper handling from the retailer, or even an improper running environment. But even the greediest data hoarders only have a few dozen drives, often in just a couple of environments and use-cases.

Very few of these results are actually meaningful trends. For every person that swears by WD and will never touch a Seagate, there's someone else that swears by Seagate and will never touch another WD. HGST and Toshiba seem to have a very slight edge on reliability, but it's very small. And there are still people that refuse to touch them because of the "Death Star" drives many years ago.

It's also very difficult to predict which models will have high failure rates. By the time it becomes clear one is a lemon, they're already EoL.

I avoid buying WD new because of their (IMHO completely illegal) stance on warranty, but I'm comfortable buying their stuff used.

Don't worry too much about brand. Instead go for specs and needs. Follow a good backup strategy and you'll be fine

LeafOnTheWind ,

HGST is a part of WD and has been for quite a while.

But a big part of why the average consumer drive kind of sucks is that there is way more money in enterprise level drives so very little resources get put toward client drives.

Nollij ,

Owned by, yes. Have their operations actually been integrated though? I haven't checked in a long time, but it was still a separate division last time I did.

LeafOnTheWind ,

It's integrated. Only a few things internally are still labeled HGST.

TrickDacy , in The road has been paved

What's a data scrubber?

PixeIOrange ,

It scrubs your data

beerclue OP ,

It's a data maintenance feature that amends data in storage pools that are incorrect or incomplete. It works on BTRFS volumes or RAID 5/6 storage pools. It's scheduled to run monthly on my NAS. I guess it started now as I upgraded my drives from 4x4TB to 4x18TB.

CorrodedCranium , (edited ) in What's your most treasured data?
@CorrodedCranium@leminal.space avatar

I have some copies of shows that only received pilot episodes or shorts such as Wet City that I think are pretty rare. For treasured though I've got a journal from when I was in high school. A lot of it's insignificant forgettable stuff like going to the movies with friends but the prompts of setting help me paint a vivid mental image of it that makes me feel a bit nostalgic.

Helix , in What's your most treasured data?

Nudes of my ex girlfriends.

the_rogue ,
@the_rogue@sh.itjust.works avatar

Heh incel of lemmy eh ?? I guess every platform must have atleast one.

Helix ,

Incels don't have exes.

Cwilliams ,

Bro that's actually wierd

CorrodedCranium ,
@CorrodedCranium@leminal.space avatar

Potentially illegal too

Petter1 , in What's your most treasured data?

My 3TB of injected VC games for wiiU
(And soon additionally about 8 tb of injected VC games for 3ds)

Flamangoman OP ,

Hell ya, I fucking love the wii u lol. Best emulation station going

Cwilliams ,

Couldn't agree more 😉

oldfart , in What's your most treasured data?

I have emails going back to YAM on Amiga in 2002, some games I wrote for GBA and mobile platforms that don't exist any more. I have some old IM logs but reading that was so cringe I should delete it, with wipe not rm. Some of the obscure old music I have isn't available even on Soulseek (except when I'm sharing it). Source code of old programs I and my friends wrote. And photos, of course.

wuphysics87 , in What's your most treasured data?

I'm on an opposite end of the spectrum. I keep almost nothing

  • All
  • Subscribed
  • Moderated
  • Favorites
  • random
  • datahoarder@lemmy.ml
  • test
  • worldmews
  • mews
  • All magazines