66
submitted 1 year ago* (last edited 1 year ago) by nooneescapesthelaw@lemmy.ml to c/piracy@lemmy.dbzer0.com

Ok so I want to download this embedded PDF/document in order to physically print it. The website allows me to view it as much as I want, but is asking me to fork over 25 + tax USD so i can download the document.

Obviously, i don't want to do that, so I try to download the embedded document via inspect element. But, the weird thing is it not actually loading a pdf, but like really small pictures of each page:

So, my question is basically how can I download this document in order to print it?

PdF link: https://www.sbcaplanroom.com/jobs/2477/plans/goleta-sanitary-district-biosolids-and-energy-phase-1-project/?preview=200647

top 31 comments
sorted by: hot top controversial new old
[-] andrew_bidlaw@sh.itjust.works 22 points 1 year ago* (last edited 1 year ago)

FOR LINUX, COMPLETE AND WORKING

  1. Install xdotool, AutoKey
  2. In Firefox get Save Screenshot: https://addons.mozilla.org/en-US/firefox/addon/savescreenshot/ Then, in Firefox Shortcuts add Ctrl+1 as a hotkey to capture visible page.
  3. Create a script for Autokey in Python, mine is:
import time
import os   
import subprocess

pages = dialog.input_dialog(title='', message='Number of pages:', default='5').data

time.sleep(1)
for k in range(1,int(pages)):
    subprocess.run(["xdotool", "key", "ctrl+1"]) # Plugin's hotkey
    time.sleep(2)
    subprocess.run(["xdotool", "click", "1"]) # Mouseclick
    time.sleep(2)

subprocess.run(["xdotool", "key", "ctrl+1"]) # to screenshot the last one
  1. In the bottom of a program, set a hotkey to launch it (I set it to Home).
  2. Open OP's page and via Inspect Element find the link to embed. It's https://www.sbcaplanroom.com/preview/2477/12610/200647
  3. Press F11, make the whole picture fit.
  4. Place mouse pointer over next page button, so it clicks each time.
  5. Lauch my Autokey script via Home button.
  6. Enter number of pages.
  7. See how it does it.
  8. Open screenshots directory in XnView, select them. Locate it's BatchConvert tool, in Actions tab select a crop action and adjust it to pages' margins. ACHTUNG The last one should be done differently, you can open it in XnV and crop this one alone.
  9. Use any tool to stitch them back together into a PDF. I've used PDF Arranger: https://github.com/pdfarranger/pdfarranger But some user down there said it crashed on 600-something pages document.

Result: https://files.catbox.moe/iivoga.pdf

[-] ftbd@feddit.de 4 points 1 year ago

Compatible with any system? AFAIK autohotkey is windows-only

[-] andrew_bidlaw@sh.itjust.works 3 points 1 year ago* (last edited 1 year ago)

Damn, you are right.

I've found this Q-A thread about alternatives for Linux: https://unix.stackexchange.com/a/533392 I'd need to look into it.

Good god XnV and plugins aren't.

Upd: AutoKey works. Scripts are on Python.

[-] iHUNTcriminals@lemm.ee 2 points 1 year ago

They say the op has magic powers!

[-] konalt@lemmy.world 1 points 1 year ago

Got any suggestions for image-to-pdf tools? The ones i've tried online all break after 300 pages or so

[-] andrew_bidlaw@sh.itjust.works 2 points 1 year ago

PDF Arranger: https://github.com/pdfarranger/pdfarranger

On the top there's a button to import - Select images you want to add - Save as.

[-] konalt@lemmy.world 3 points 1 year ago
[-] andrew_bidlaw@sh.itjust.works 1 points 1 year ago
[-] konalt@lemmy.world 3 points 1 year ago

I waited about 20 minutes and it eventually crashed. No luck.

[-] andrew_bidlaw@sh.itjust.works 2 points 1 year ago* (last edited 1 year ago)

Dammit. Are you on Windows? I can drop some pirated Acrobat for you to try.

600 seems like an overkill, maybe you can try to add a 100 at a time?

[-] konalt@lemmy.world 2 points 1 year ago

Somehow I never thought of using Acrobat. Seems to be working, thanks for reminding me!

[-] andrew_bidlaw@sh.itjust.works 1 points 1 year ago

Np. Hope it goes well.

[-] andrew_bidlaw@sh.itjust.works 17 points 1 year ago* (last edited 1 year ago)

OP, I did it: https://files.catbox.moe/6eofj6.pdf

I will edit my reply with linux specifics.

My link was updated with a slightly better PDF. Comparison on max zoom: https://files.catbox.moe/5q3v4b.png A person with a 4k display could make better, but that's what my screen is capable of.

Either way, it was a fun puzzle for my entry knowledge of linux\python\macroses and I feel I'll use this method a couple of times myself. Hope someone would make use of it.

[-] nooneescapesthelaw@lemmy.ml 9 points 1 year ago

Holy shit dude you are awesome, thanks alot!

[-] andrew_bidlaw@sh.itjust.works 4 points 1 year ago

You are welcome 😉

[-] spez@sh.itjust.works 4 points 1 year ago
[-] andrew_bidlaw@sh.itjust.works 3 points 1 year ago

Fuck you and thank you, mr Spez ☺

[-] princessnorah@lemmy.blahaj.zone 10 points 1 year ago

Okay so, PDF documents are actually already “a collection of images” basically. This website is clearly trying to make it an extra step harder by loading the images individually as you browse the document. You could manually save/download all the images and use a tool to turn it back into a pdf. I haven’t heard of a tool that does this automatically, but it should be possible for a web scraper to make the GET requests sequentially then stitch the pdf back together.

[-] Pantoffel@feddit.de 5 points 1 year ago

I would go this route as well. As a developer this sounds easy enough. It you don't get vertical sequences of images, but instead a grid of images, then I would apply traditional image stitching techniques. There are tons of libraries for that on github.

[-] jlow@beehaw.org 2 points 1 year ago

Just as a tiny nitpick: PDFs can be just a collection of images. If there's text I would hope that they're embedded as text or vectors, which is what would usually happen if you export a document from a program (that isn't completely bs). So texts / vector graphics etc should not be images usually (unless you scan a document as a PDF - which I hate with a passion but can see that people prefer a single PDF over a collection of image files). Even then you could OCR the imges / PDF to make it searchable etc. Anyway in this case it seems to be a collection of images indeed ^__^

[-] Morgikan@lemm.ee 8 points 1 year ago* (last edited 1 year ago)

Imagemagick can convert a series of images to single PDF: "convert page*.png mydoc.pdf"

[-] hai@lemmy.ml 2 points 1 year ago

I thought the convert command didn’t do this, and that it was the magick one?

[-] applejacks@lemmy.world 4 points 1 year ago

I've run into this before on archive.org, incredibly annoying.

I believe there are utilities that can capture and join together JPEGs into a PDF, but it seems they purposefully uploaded a very low res version to prevent that.

Hate to say, but I don't see a way around it.

[-] nooneescapesthelaw@lemmy.ml 4 points 1 year ago

In this case the jpegs themselves change everytime you zoom in, so you zoom in a little it loads a new set of higher quality Jpegs.

Do you remember the tool you are talking about?

[-] Moonguide@lemmy.ml 1 points 1 year ago

You could stitch together the pdfs with screen captures then, but that would be a royal pain in the ass.

[-] pulverizedcoccyx@lemmy.ca 1 points 1 year ago

ChromeCacheView is a step in the right direction, but nothing fully automatic. I'm also searching for a less manual solution.

[-] applejacks@lemmy.world 1 points 1 year ago

check this out, autohotkey script that screenshots and flips pages:

https://www.autohotkey.com/board/topic/58115-auto-screen-capture-script/

Seems after that you can select all the pages in windows explorer, hit print, and choose PDF.

[-] LesserAbe@lemmy.world 3 points 1 year ago

You could write a script to scroll through the document at defined intervals, take screenshots, then have the script edit them together.

Of course by then, the time you'd have spent would be worth more than $25

[-] Isoprenoid@programming.dev 13 points 1 year ago* (last edited 1 year ago)

Of course by then, the time you’d have spent would be worth more than $25

Yes, but you'd now have a script that can be used in the future as well. Automation is a magical thing, my friend.

[-] Luvon@beehaw.org 2 points 1 year ago

To semi automate downloading all the pages, try jdownloader 2. You probably need to paste the url into jdownloader manually for jdownloader to load all the downloadable bits it finds on the page.

[-] Blackmist@feddit.uk 1 points 1 year ago

Think you'll have to take screen shots. That's a pretty good way of stopping you downloading it.

Or just email and ask them for a copy. It's not Harry Potter or anything, there's no reason it shouldn't be free if you ask the right person.

this post was submitted on 04 Nov 2023
66 points (92.3% liked)

Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ

54746 readers
670 users here now

⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.

Rules • Full Version

1. Posts must be related to the discussion of digital piracy

2. Don't request invites, trade, sell, or self-promote

3. Don't request or link to specific pirated titles, including DMs

4. Don't submit low-quality posts, be entitled, or harass others



Loot, Pillage, & Plunder

📜 c/Piracy Wiki (Community Edition):


💰 Please help cover server costs.

Ko-Fi Liberapay
Ko-fi Liberapay

founded 1 year ago
MODERATORS