20
Anyone have experience scraping twitter?
(hexbear.net)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 17 Aug 2025
20 points (100.0% liked)
technology
23917 readers
330 users here now
On the road to fully automated luxury gay space communism.
Spreading Linux propaganda since 2020
- Ways to run Microsoft/Adobe and more on Linux
- The Ultimate FOSS Guide For Android
- Great libre software on Windows
- Hey you, the lib still using Chrome. Read this post!
Rules:
- 1. Obviously abide by the sitewide code of conduct. Bigotry will be met with an immediate ban
- 2. This community is about technology. Offtopic is permitted as long as it is kept in the comment sections
- 3. Although this is not /c/libre, FOSS related posting is tolerated, and even welcome in the case of effort posts
- 4. We believe technology should be liberating. As such, avoid promoting proprietary and/or bourgeois technology
- 5. Explanatory posts to correct the potential mistakes a comrade made in a post of their own are allowed, as long as they remain respectful
- 6. No crypto (Bitcoin, NFT, etc.) speculation, unless it is purely informative and not too cringe
- 7. Absolutely no tech bro shit. If you have a good opinion of Silicon Valley billionaires please manifest yourself so we can ban you.
founded 5 years ago
MODERATORS
I hadn't considered that, no. Practically I think it'd be more effort for both me and the artist to do that than for me to just download all of their artworks with some tool. If you're asking because you think I should get their consent for using it, I would totally agree if it was a publicly broadcast game or something that their art was being used in, but just in a game between my friends I don't think it's necessary.
So i do think its good to get consent but i didnt suggest that for this reason. If someones posting specific things on twitter they know theyll be scraped and are kind of implicitly allowing those specific works to be used for free by people.
This though would potentially allow you to get access to more stuff that isnt posted publicly, and would also allow the artist to know someone likes their work enough to do this. Maybe they'd even want to play the game with you.
As for difficulty most artists have their works saved and all they'd have to do is share a google drive folder or something and have you download it. Super easy.
Also its just like... talking to people is good yknow? I mean this is someone whose work you like, and the internet makes things so impersonal already. Starting a discussion, and getting to know someone with similar tastes just seems like a net positive. A wasted opportunity for a potential friend if you dont atleast try imo. But ultimately its up to you what you do.
That's a good point. I think I will give them a message later. Thanks for the advice!
What if they point you to a different site with their art that is easier to scrape?
They might appreciate hearing from someone who likes their work.