1020

Wayback Machine back in read-only mode after DDoS, may need further maintenance.

you are viewing a single comment's thread
view the rest of the comments
[-] dohpaz42@lemmy.world 132 points 1 month ago

Maybe it’s time to federate the IA.

[-] independantiste@sh.itjust.works 76 points 1 month ago

One of the rare use cases of a blockchain actually being useful. A federated internet archive that uses a blockchain to validate that the saved data has not been altered by a malicious actor trying to tamper with proofs

That would be really cool but horribly inefficient because of the sheer amount of storage required

[-] RecluseRamble@lemmy.dbzer0.com 123 points 1 month ago

horribly inefficient

The core feature of all blockchain tech.

[-] independantiste@sh.itjust.works 13 points 1 month ago

To be fair that would not necessarily be because of the blockchain part, more because of the decentralized/federated nature of this theorical network

[-] RecluseRamble@lemmy.dbzer0.com 29 points 1 month ago

Sure, but the networking and consent-finding are defining features of a blockchain. Nobody calls a git repo a blockchain.

[-] AlexanderESmith@social.alexanderesmith.com 5 points 1 month ago* (last edited 1 month ago)

You mean a "github repo". Git by itself doesn't give a hoot about validating authors what-so-ever (I could sign as "Bill Gates bill@microsoft.com", and git would happily accept the commit), and it's not federated (multiple people manually downloading various states of the repo at various times doesn't count).

Github ensures owners are who they are, as linked to their profile (though email validation only goes as far as "Well, they clicked the link in the email, so this must be their email account"). Github also isn't federated, since that one site going down takes all the repos with it (unless someone had it cloned, but again, random people downloading at random times yields different states of the repo, depending on when the clone/fetch occured, but then you'd end up with tens/hundreds/thousands of sources of various levels of truth).

[-] whostosay@lemmy.world 7 points 1 month ago

It's not a minor nitpick. The comment was that "nobody calls a git repo a blockchain". It's because it's not a blockchain, or even remotely similar to one.

[-] whostosay@lemmy.world 4 points 1 month ago

You are right, I was just poking fun a little. No hard feelings. You did just kind of um akshually my use of um akshually tho

No worries. I just correct people on it because it's caused problems at work before. It's a pain when people think that git automatically means github, and they start complaining about cost, and Microsoft feeding their AI, and setting up user accounts, and etc etc etc.

I'm like... dude, I just want to sync the code from a central server, we can do it in house for free in 5 minutes...

[-] Valmond@lemmy.world 2 points 1 month ago

Github is a website, controlled by no less than Microsoft lol.

A git repo can be spread out like a "blockchain" without the messy validation and coin earnings, maybe that was the intended comparison?

Could it be? Sure, I don't see a technological reason why someone couldn't build a system like that.

Are they now (federated, or blockchained)? No.

[-] Valmond@lemmy.world 1 points 1 month ago

True.

I'm working on a decentralised sharing protocol, but it uses reciprocal sharing so you'd have to have large storage anyways.

Hoof, yeah. Collaboration tools always seem to come down to bandwidth, storage, or both.

[-] Valmond@lemmy.world 1 points 1 month ago

You need to use something I guess :-) Any examples?

Honestly, despite not actually being federated, I've been using raw Git a lot recently. As opposed to ActivityPub, you can always download the current state lf the central repo and bring yourself up to current. I just wish it were easier to store binary data in it (e.g. sharing my MP3s between my laptop and phone)

Of course, that's not a collaborative use-case. I have no intention of opening my files to the world. Just noting that ActivityPub has some pretty severe limitations (if my mbin server is offline, I wont get the updates I missed while it was down, ever. And if I can't process messages in real-time, I miss those too).

Honestly, despite not actually being federated, I've been using raw Git a lot recently. As opposed to ActivityPub, you can always download the current state lf the central repo and bring yourself up to current. I just wish it were easier to store binary data in it (e.g. sharing my MP3s between my laptop and phone)

Of course, that's not a collaborative use-case. I have no intention of opening my files to the world. Just noting that ActivityPub has some pretty severe limitations (if my mbin server is offline, I wont get the updates I missed while it was down, ever. And if I can't process messages in real-time, I miss those too).

[-] kautau@lemmy.world 44 points 1 month ago

I mean you don’t need the blockchain for that. The same way that distro mirrors don’t need the blockchain. It can be federated, with each upload being verified through hashes that they are in fact the real upload. I would argue that something like blockchain would remove the authority from them, granting the position of a bad actor spinning up enough servers to be able to poison the blockchain just because they had the computing power, claiming authority

[-] explodicle@sh.itjust.works 7 points 1 month ago

Bro hear me out bro

We put the whole thing on a blockchain. BUT

  • entry order isn't super important

  • you don't need to validate the entire archive

So basically a blockchain, but for a bunch of files, not ordered. So instead of a native token, users can just trade bits of information as currency. 🙀

If it goes really well, we could even recruit one of the Bitcoin developers to help.

[-] kautau@lemmy.world 8 points 1 month ago

lol I fucking hate this because idiots will read this and be like “oh shit is this the new blockchain”

Well done

[-] downhomechunk@midwest.social 1 points 1 month ago

Take my money! All of it!

[-] RedStrider@lemmy.world 13 points 1 month ago
[-] kautau@lemmy.world 5 points 1 month ago

Yes, this is a great example of where ipfs would work (specifically for file hosting, not necessarily for the actual web interface), and also, no ipfs is not a blockchain, and it shouldn’t be. I thought we were past the whole “can this be a blockchain” thing, but here we are. Blockchain is cool tech. It’s also incredibly inefficient for anything beyond a transaction ledger, or in today’s case, money laundering and trying to avoid taxes and regulation.

[-] zeppo@lemmy.world 1 points 1 month ago

Sounds like BitTorrent, too

[-] WaterSword@discuss.tchncs.de 10 points 1 month ago

The thing is sometimed articles must be removed from IA (copyright (I disagree with that one) or when information is leaked that could threaten lives), with a blockchain this would be impossible

[-] tehmics@lemmy.world 4 points 1 month ago

this would be impossible

Perfect.

I'd be interested in seeing real examples where lives are threatened. I find it unlikely that the internet archive would be the exclusive arbiter of so-called deadly information

[-] WaterSword@discuss.tchncs.de 9 points 1 month ago

There was an actual example where a journalistic article about afghanistan accidentally leaked names of some sources and people who helped westerners in afghanistan, which did actually endanger those people’s lives.

[-] tehmics@lemmy.world 2 points 1 month ago

If they're leaked, they're leaked. The archive doesn't change that one way or the other

[-] douglasg14b@lemmy.world 0 points 1 month ago* (last edited 1 month ago)

Gotcha so you actually stated your previous question in bad faith as you had no interest in the answer to begin with.

[-] tehmics@lemmy.world 1 points 4 weeks ago* (last edited 4 weeks ago)

No. The archive of it isn't doing the dangerous part. The info was already out there and the bad actor who would do something malicious would get that info from the same place the archive did. I need you to show how the archival of information that was already released leads to a dangerous situation that didn't already exist.

[-] brbposting@sh.itjust.works 3 points 1 month ago

I thought of something but I don’t know if it’s a good example.

Here’s the hypothetical:

A criminal backs up a CSAM archive. Maybe the criminal is caught, heck say they’re executed. Pedos can now share the archive forever over encrypted messengers without fear of it being deleted? Not ideal.

[-] tehmics@lemmy.world 2 points 4 weeks ago* (last edited 4 weeks ago)

Yeah this is a hard one to navigate and it's the only thing I've ever found that challenges my philosophy on the freedom of information.

The archive itself isn't causing the abuse, but CSAM is a record of abuse and we restrict the distribution not because distribution or possession of it is inherently abusive, but because the creation of it was, and we don't want to support an incentive structure for the creation of more abuse.

i.e. we don't want more pedos abusing more kids with the intention of archival/distribution. So the archive itself isn't the abuse, but the incentive to archive could be.

There's also a lot of questions with CSAM in general that come up about the ethics of it in that I think we aren't ready to think about. It's a hard topic all around and nobody wants to seriously address it beyond virtue signalling about how bad it is.

I could potentially see a scenario where the archival could be beneficial to society similar to the FBI hash libraries Apple uses to scan iCloud for CSAM. If we throw genAI at this stuff to learn about it, we may be able to identify locations, abusers and victims to track them down and save people. But it would necessitate the existence of the data to train on.

I could also see potential for using CSAM itself for psychotherapy. Imagine a sci-fi future where pedos are effectively cured by using AI trained on CSAM to expose them to increasingly mature imagery, allowing their attraction to mature with it. We won't really know if something like that is possible if we delete everything. It seems awfully short sighted to me to delete data no matter how perverse, because it could have legitimate positive applications that we haven't conceived of yet. So to that end, I do hope some 3 letter agencies maintain their restricted archives of data for future applications that could benefit humanity.

All said, I absolutely agree that the potential of creating incentives for abusers to abuse is a major issue with immutable archival, and it's definitely something that we need to figure out, before such an archive actually exists. So thank you for the thought experiment.

[-] JayDee@lemmy.ml 2 points 3 weeks ago

We don't need a blockchain for that.

Having multiple servers which store file checksums would have much less overhead, would be easily repeatable and appendable, with no need for unnecessary computational labor. Linux mint currently uses the checksum process for verifying that an ISO downloaded is not altered in any way, and it can work for any file (preferably not humongous files).

Strive for K.I.S.S. whenever possible.

[-] Valmond@lemmy.world 0 points 1 month ago

You need a useless 51% of good nodes to assure that, making it even more wasteful.

[-] cyborganism@lemmy.ca 18 points 1 month ago

I don't know if that's a good idea.

How would you go about implementing the infrastructure for that?

[-] dohpaz42@lemmy.world 2 points 1 month ago

That’s an excellent question. Unfortunately I do not have an answer. But I believe it’s worth discussing some means of redundancy for the IA; even if it’s as simple as rsync to other hosts.

[-] turkalino@lemmy.yachts 7 points 1 month ago

They’ve been using Filecoin

YaCy self-hostable search engine kind of has this feature and architecture by way of a DHT inter-peer search, in combination with local page caching. Although the caching feature is something that a node operator needs to manually enable.

this post was submitted on 15 Oct 2024
1020 points (99.5% liked)

Technology

59381 readers
1686 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS