502
submitted 2 days ago by Dju@lemmy.world to c/technology@lemmy.world
top 50 comments
sorted by: hot top controversial new old
[-] RxBrad@infosec.pub 43 points 1 day ago

The majority of Reddit discourse on this is wild. The crowd there is going HARD to try and paint IA in the most negative light possible.

I know we don't like Reddit here, but for example: https://www.reddit.com/r/DataHoarder/comments/1g7w0rh/internet_archive_issues_continue_this_time_with/

It's almost as if the "hackers" and/or copyright holders are running that conversation.

[-] ikidd@lemmy.world 24 points 1 day ago

Since it's Reddit, I would guess copyright sockpuppets are steering the narrative to help damage them further.

[-] notfromhere@lemmy.ml 53 points 1 day ago

We need IA full mirrors. This is too critical to leave to this one company.

[-] psycotica0@lemmy.ca 39 points 1 day ago

Knowing the folks at IA I'm sure they would love a backup. They would love a community. I'm sure they don't want to be the only ones doing this. But dang, they've got like 99 Petabytes of data. I don't know about you, but my NAS doesn't have that laying around...

[-] el_abuelo@programming.dev 11 points 1 day ago* (last edited 1 day ago)

I wonder if someone can come up with some kind of distributed storage that isn't insanely slow. Kinda like a CDN but on personal devices. I'm thinking like SETI@HOME did with distributed compute.

Edit: this is kinda like torrents but where the contents are changing frequently.

[-] psycotica0@lemmy.ca 10 points 1 day ago

You should look up IPFS! It's trying to be kinda like that.

It'll always be slower than a CDN, though, partly because CDNs pay big money to be that fast, but also anything p2p is always going to have some overhead while the swarm tries to find something. It's just a more complicated problem that necessarily has more layers.

But that doesn't mean it's not possible for it to be "fast enough"

And there's a promising new IPFS-like system called Iroh, which should have a lot less overhead and in general just be faster than IPFS. It's not quite ready to just switch to right now, but an enterprising individual could probably make something useful with it without too much work (i.e. months, not years).

I'm using it for a distributed application project right now, but the intent is a bit different than the IA use-case.

[-] el_abuelo@programming.dev 1 points 1 day ago

Interesting, thanks

[-] peereboominc@lemm.ee 5 points 1 day ago

Something like torrents. Split the whole thing in small 5gb torrents.

[-] notfromhere@lemmy.ml 3 points 1 day ago

That is an insane amount of storage. How much does it grow every year and is it stable growth or accelerating?

[-] nickwitha_k@lemmy.sdf.org 6 points 1 day ago

Quick question for those more in the know: Have these events disrupted IA's ability to archive pages? I ask because I was recently talking with a security guy about a novel malware that used a hacked webpage for command injection. One possible motive that came to mind, if the archiving was disrupted would be to cover tracks for a similar malware. Inject code, perform malicious activity, revert, then, there's more time before the control code is discovered.

[-] DudeImMacGyver@sh.itjust.works 80 points 1 day ago

Why are people fucking with the Internet Archive? Who benefits?

[-] interdimensionalmeme@lemmy.ml 14 points 15 hours ago

Copyright holders compete with old content clogging up the works. They wish the library would burn.

[-] Draconic_NEO@lemmy.world 38 points 1 day ago

Well right wingers want to ban books and services like IA make that harder since they provide easy access to download or digitally borrow those books. It makes it harder for them to deny people access to those books since they can find them online. Of course, there are other ways people can still obtain those books, IA isn't the only one, but it's the easiest and the most convent.

load more comments (4 replies)
[-] queermunist@lemmy.ml 51 points 1 day ago* (last edited 1 day ago)

People use Archive links to avoid giving sites traffic.

This is a problem for advertisers and media corps.

Not saying they're the ones doing this, but they'd definitely benefit.

I've enjoyed using Wayback Machine on journalistic articles where they try to retcon information, but the original copy had already been captured. The Ministry of Truth hates archive.org.

[-] DudeImMacGyver@sh.itjust.works 6 points 1 day ago

Wouldn't put it past them...

load more comments (4 replies)
load more comments (1 replies)
[-] 1984@lemmy.today 107 points 2 days ago

I guess this is an attempt to discredit them.

After working at many, many companies, security is usually very bad. This is typical. Not changing access tokens is also very common.

[-] Shdwdrgn@mander.xyz 26 points 2 days ago

Discrediting someone usually has a goal of pushing customers to another source though. There is no other source of this information, so what would be the point?

[-] qfe0@lemmy.dbzer0.com 107 points 2 days ago* (last edited 1 day ago)

Destroy a source of historical documents so that the past can be contested. Sow doubt, confusion, deniability. Hide evidence of past crimes, or inconvenient documents. Plant documents, etc.

[-] Broken@lemmy.ml 2 points 1 day ago

Sow doubt. As in spreading it like seeds to take root and grow. 100% in agreement with you, just being a grammar Nazi. Carry on.

[-] bamfic@lemmy.world 9 points 1 day ago

Russians banned it, russian hackers trying to destroy it, at least it's consistent

[-] 1984@lemmy.today 20 points 2 days ago
[-] Oha@lemmy.ohaa.xyz 2 points 8 hours ago

I really hate that reddit slang but username checks out

[-] muntedcrocodile@lemm.ee 8 points 1 day ago

He who controls the past controls the future, he who controls the present controls the past.

load more comments (1 replies)
[-] OpenStars@discuss.online 18 points 2 days ago

Generating turmoil just prior to the USA election maybe?

load more comments (1 replies)
[-] grue@lemmy.world 80 points 2 days ago

Okay, enough is enough. The Internet Archive is both essential infrastructure and irreplaceable historical record; it cannot be allowed to fall. Rather than just hoping the Archive can defend itself, I say It's time to hunt down and counterattack the scum perpetrating this!

[-] dovahking@lemmy.world 15 points 1 day ago

Where are the anonymous group and 4chan autists? They should attack these assholes. Attacking internet archive is like kicking a kitten. Everyone will hate you for it.

[-] SynopsisTantilize@lemm.ee 36 points 1 day ago* (last edited 1 day ago)

Lol you're gonna pull that thread and at the end of the sweater is gonna be the CIA or Russia.

Edit: in = is

[-] grue@lemmy.world 14 points 1 day ago

Did I stutter?

load more comments (2 replies)
[-] zlatiah@lemmy.world 47 points 2 days ago

This again??

This time once archive.org is back online again... is it possible to get torrents of some of their popular data storage? For example I wouldn't imagine their catalog of books with expired copyright to be very big. Would love a community way to keep the data alive if something even worse happens in the future (and their track record isn't looking good now)

[-] njordomir@lemmy.world 13 points 1 day ago

Yep, that seems like the ideal decentralized solution. If all the info can be distributed via torrent, anyone with spare disk space can help back up the data and anyone with spare bandwidth can help serve it.

[-] Shdwdrgn@mander.xyz 8 points 1 day ago

Most of us can't afford the sort of disk capacity they use, but it would be really cool if there were a project to give volunteers pieces of the archive so that information was spread out. Then volunteers could specify if they want to contribute a few gigabytes to multiple terabytes of drive space towards the project and the software could send out packets any time the content changes. Hmm this description sounds familiar but I can't think of what else might be doing something similar -- anyone know of anything like that that could be applied to the archive?

[-] njordomir@lemmy.world 5 points 1 day ago

Yeah, the projects I've heard about that have done something like this broke it into multiples.

For example, 1000GB could be broken into forty 25GB torrents and within that, you can tell the client to only download some of the files.

At scale, a webpage can show the seed/leach numbers and averages foe each torrent over a time period to give an idea of what is well mirrored and what people can shore up. You could also change which torrent is shown as the top download when people go to the contributor page and say they want to help host it ensuring a better distribution.

load more comments (1 replies)
load more comments (3 replies)
[-] Exeous@lemmy.world 15 points 2 days ago

Like this idea

[-] catloaf@lemm.ee 8 points 1 day ago

I'm pretty sure all their content is available by torrent, so you could mirror the data and provide the torrent files for direct download. It'll probably be here when it's back up: https://archive.org/details/public-domain-archive

load more comments (1 replies)
[-] obbeel@lemmy.eco.br 10 points 1 day ago* (last edited 1 day ago)

Apparently, BlackMeta is behind the DDoS attack to the Internet Archive. Apparently they are pro-Palestine hacktivists - their X account also has some russian written in it.

(Edit) Also, Internet Archive is banned on China since 2012 and Russia since 2015.

[-] Traister101@lemmy.today 57 points 1 day ago

Yes they are a "pro-Palestine" Russian based hacker group... Nothing funny going on here no sir

load more comments (4 replies)
[-] GhostFaceSkrilla@lemmy.world 3 points 1 day ago* (last edited 1 day ago)

Definitely not their genocidal neighbors terrorizing as usual. /s

[-] dch82@lemmy.zip 28 points 2 days ago

Not this crap again

[-] _sideffect@lemmy.world 19 points 2 days ago
load more comments
view more: next ›
this post was submitted on 20 Oct 2024
502 points (99.6% liked)

Technology

58810 readers
4945 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS