259

A bride to be discovers a reality bending mistake in Apple's computational photography (appleinsider.com)

submitted 11 months ago by stopthatgirl7@kbin.social to c/technology@lemmy.world

100 comments fedilink hide all child comments

A U.K. woman was photographed standing in a mirror where her reflections didn't match, but not because of a glitch in the Matrix. Instead, it's a simple iPhone computational photography mistake.

top 50 comments

sorted by: hot top controversial new old

[-] e0qdk@kbin.social 222 points 11 months ago

This story may be amusing, but it's actually a serious issue if Apple is doing this and people are not aware of it because cellphone imagery is used in things like court cases. Relative positions of people in a scene really fucking matter in those kinds of situations. Someone's photo of a crime could be dismissed or discredited using this exact news story as an example -- or worse, someone could be wrongly convicted because the composite produced a misleading representation of the scene.

[-] falkerie71@sh.itjust.works 46 points 11 months ago

I see your point, though I wouldn't put it that far. It's an edge case that has to happen in a very short duration.
Similar effects can be acheived with traditional cameras with rolling shutter.
If you're only concerned of relative positions of different people during a time frame, I don't think you need to be that worried. Being aware of it is enough.

[-] Odelay42@lemmy.world 57 points 11 months ago

I don't think that's what's happening. I think Apple is "filming" over the course of the seconds you have the camera open, and uses the press of the shutter button to select a specific shit from the hundreds of frames that have been taken as video. Then, some algorithm appears to be assembling different portions of those shots into one "best" shot.

It's not just a mechanical shutter effect.

[-] falkerie71@sh.itjust.works 10 points 11 months ago

I'm aware of the differences. I'm just pointing out that similar phenomenon and discussions have been made since rolling shutter artifacts have been a thing. It still only takes milliseconds for an iPhone to finish taking it's plethora of photos to composite. For the majority of forensic use cases, it's a non issue imo. People don't move that quick to change relative positions substantially irl.

[-] Odelay42@lemmy.world 14 points 11 months ago

Did you look at the example in the article? It's clearly not milliseconds. It's several whole seconds.

[-] falkerie71@sh.itjust.works 8 points 11 months ago* (last edited 11 months ago)

You don't need a few whole seconds to put an arm down.

Edit: I should rephrase. I don't think computational photography algorithms would risk compositing photos that are whole seconds apart. In well lit environments, one photo only needs 1/100 seconds or less to expose properly. Using photos that are temporally too far apart risk objects moving too much in the frame, and thus fail to composite.

[-] Odelay42@lemmy.world 6 points 11 months ago

There's three different arm positions in a single picture. That doesn't happen in the blink of an eye.

The camera is taking many frames over a relatively long time to do this.

This is nothing at all like rolling shutter, and it's very obvious from looking at the example in the article.

[-] LifeInOregon@lemmy.world 7 points 11 months ago

Those arm positions occur over the course of a fluid motion in a single second. How long does it take for you to drop your hands to your side or raise them to clasped from the side? It doesn’t take me more than about half a second as a deliberate movement.

[-] llii@feddit.de 6 points 11 months ago

It takes you several seconds to move your arm? I hope you don’t do manual work.

Also did you use the iOS camera app before? You can see how long it takes for the iPhone to take multiple shots for the always-on hdr feature, and it isn’t several seconds.

load more comments (4 replies)

[-] PoolloverNathan@programming.dev 6 points 11 months ago

A specific shit?

[-] Odelay42@lemmy.world 7 points 11 months ago

😎

[-] curiousaur@reddthat.com 30 points 11 months ago

It should be. All computational photography has zero business being used in court

[-] Decoy321@lemmy.world 18 points 11 months ago

We might be exaggerating the issue here. Fallibility has always been an issue with court evidence. Analog photos can be doctored too.

[-] curiousaur@reddthat.com 4 points 11 months ago

Sure, but smartphones now automatically doctor every photo you take. Someone who took the photo could not even know it was doctored and think it represents truth.

load more comments (1 replies)

[-] ElderWendigo@sh.itjust.works 17 points 11 months ago* (last edited 11 months ago)

All digital photography is computational. I think the word you're looking for is composite, not computational.

[-] NotSoCoolWhip@lemmy.world 3 points 11 months ago

Unless the dude is saying only film should be admissible, which doesn't sound all that bad.

[-] ElderWendigo@sh.itjust.works 8 points 11 months ago

Film is also subject to manipulation in the development stage, even if you avoid compositing e.g. dodging and burning. Photographic honesty is an open and active philosophic debate that has been going on since its inception. It's not like you can really draw a line in the sand and blanketly say admissible or not. Although I'm sure established guidelines would help. Ultimately, it's an argument about the validity of evidence that needs to be made on a case by case basis. The manipulations involved need to be fully identified and accounted for in those discussions.

[-] Blackmist@feddit.uk 9 points 11 months ago

With all the image manipulation and generation tools available to even amateurs, I'm not sure how any photography is admissible as evidence these days.

At some point there's going to have to be a whole bunch of digital signing (and timestamp signatures) going on inside the camera for things to be even considered.

[-] Blackmist@feddit.uk 26 points 11 months ago

I'm still waiting for the first time somebody uses it to zoom in on a car number plate and it helpfully fills it in with some AI bullshit with something else entirely.

We've already seen such a thing with image compression.

https://www.zdnet.com/article/xerox-scanners-alter-numbers-in-scanned-documents/

[-] ook_the_librarian@lemmy.world 24 points 11 months ago

This was important in the Kyle Rittenhouse case. The zoom resolution was interpolated by software. It wasn't AI per se, but the fact that a jury couldn't be relied upon to understand a black box algorithm and its possible artifacts, the zoomed video was disallowed.

(this in no way implies that I agree with the court.)

load more comments (4 replies)

[-] Jarix@lemmy.world 11 points 11 months ago

This isn't an issue at all it's a bullshit headline. And it worked.

This is the result of shooting in panorama mode.

In other news, the sky is blue

load more comments (1 replies)

[-] SatyrSack@lemmy.one 204 points 11 months ago

Saved you a click

[-] ComradePorkRoll@lemmy.world 71 points 11 months ago

Preventing people from perpetuating clickbait "journalism" is so punk rock.

[-] kboy101222@lemm.ee 37 points 11 months ago

Damn, this photo is weirdly unsettling to me

[-] StealThisComment@lemmy.dbzer0.com 12 points 11 months ago

I'm totally getting Black Swan vibes.

[-] Strawberry@lemmy.blahaj.zone 13 points 11 months ago

Not even a mistake, this is unavoidable if you move during a panorama. iPhones can't pause time. Cool photo tho

load more comments (1 replies)

[-] Pulptastic@midwest.social 11 points 11 months ago

MVP

[-] slaacaa@lemmy.world 63 points 11 months ago* (last edited 11 months ago)

Uhm, ok?

The way the girl’s post is written, it’s like she found out Apple made camera lenses from orphans’ retinas (“almost made me vomit on the street”). I assumed it was well known that iPhone takes many photos and stitches the pic together (hence the usually great quality). Now the software made a mistake, resulting in a definitely cool/interesting pic, but that’s it.

Also, maybe stop flailing your arms around when you want your pic taken in your wedding dress.

[-] Jarix@lemmy.world 4 points 11 months ago

When have panorama photos ever not done weird stuff?

[-] jtk@lemmy.sdf.org 45 points 11 months ago

Who wants photos of a fake reality? Might as well just AI generate them.

[-] LifeInOregon@lemmy.world 47 points 11 months ago

Generally the final photo is an accurate representation of a moment. Everything in this photo happened. It’s not really generating anything that wasn’t there. You can sometimes get similar results by exploiting the rolling shutter effect.

https://camerareviews.com/rolling-shutter/

It’s not like they’re superimposing an image of the moon over a night sky photo to fake astrophotography or something.

load more comments (1 replies)

[-] hitmyspot@aussie.zone 23 points 11 months ago

A photo is a fake reality. It's a capture of the world from the perspective of a camera that no person has ever seen.

Sure we can approximate with viewfinders and colour match as much as possible but it's not reality. Take a photo of a light bulb, versus look at a light bulb, as one obvious example.

This is just one other way to get less consistency in the time of different parts of the photos, but overall better capture what we want to see in a photo.

[-] Gabu@lemmy.world 3 points 11 months ago* (last edited 11 months ago)

Your argument makes literally no sense. You're, baselessly, assuming a person's perspective is a prism of reality. There's no such a thing - in fact, I'd rather trust reality as being detected by the sensors of a camera, with their known flaws, attributes and parameters, than trust the biological sensors at the back of your eyes or the biological wiring to the inside of your skull.

[-] Roastchicken@lemmy.world 5 points 11 months ago

Case point: https://youtu.be/UtKt8YF7dgQ?si=G-ni_azX0PYtfUBg And other selective attention demonstrations. People are unreliable and easily manipulated.

load more comments (1 replies)

[-] hitmyspot@aussie.zone 4 points 11 months ago

Yes, but that's the reality from the perspective of the camera, which will be slightly different from a perspective of the person operating it.

If the camera is out of focus, is that more or less accurate than a phone camera choosing the least out of focus frame, even if half a second after you clicked?

There is no objective reality in pictures or photos or art, only what we perceive. We now value real life activity shots. When cameras needed long exposure, it was still life portrait by necessity. Both show different versions of reality.

Again, you're saying that the camera has flaws, ergo it's imperfect, but in a known way. It's the same for phone photos. They are imperfect but in a known way that leads to more frequent desirable pics.

load more comments (3 replies)

[-] Chozo@kbin.social 17 points 11 months ago* (last edited 11 months ago)

To their credit, it's not "fake". This isn't from generative AI, this is from AI picking from multiple different exposures of the same shot and stitching various parts of them together to create the "best" version of the photo.

Everything seen in the photo was still 100% captured in-lens. Just... not at the exact same time.

[-] LWD@lemm.ee 12 points 11 months ago* (last edited 10 months ago)

deleted

load more comments (2 replies)

[-] DirigibleProtein@aussie.zone 36 points 11 months ago

Seriously? She almost vomited because the photos didn’t match? Give me a fucking break!

[-] stopthatgirl7@kbin.social 30 points 11 months ago* (last edited 11 months ago)

I’m pretty sure that was just a joke.

[-] ChairmanMeow@programming.dev 23 points 11 months ago

The woman in question is a comedian.

load more comments (1 replies)

[-] NaoPb@eviltoast.org 31 points 11 months ago

Ah yes, I remember noticing it would make like a short video instead of one picture, back when I had an iPhone. I turned that function off because I didn't see the benefits.

[-] KairuByte@lemmy.dbzer0.com 15 points 11 months ago

That’s not what this is. I also turned that off, it’s called “Live Photo” or something like that. Honestly I find it to be a dumb feature.

What this is, is the iPhone taking a large number of images and stitching them together for better results.

load more comments (12 replies)

[-] aeronmelon@lemm.ee 14 points 11 months ago

It's a really cool discovery, but I don't know how Apple is suppose to program against it.

What surprises me is how much of a time range each photo has to work with. Enough time for Tessa to put down one arm and then the other. It's basically recording a mini-video and selecting frames from it. I wonder if turning off things like Live Photo (which retroactively starts the video a second or two before you actually press record) would force the Camera app to select from a briefer range of time.

Maybe combining facial recognition with post processing to tell the software that if it thinks it's looking at multiple copies of the same person, it needs to time-sync the sections of frames chosen for the final photo. It wouldn't be foolproof, but it would be better than nothing.

[-] xantoxis@lemmy.world 36 points 11 months ago

Program against it? It's a camera. Put what's on the light sensor into the file, you're done. They programmed to make this happen, by pretending that multiple images are the same image.

load more comments (16 replies)

load more comments (2 replies)

[-] restingboredface@sh.itjust.works 13 points 11 months ago

I may have missed this in the comments already but it is really important to note here that the article says the photo was taken using panorama mode, which is why the computational photography thing is even an issue. If you have used panorama mode ever you should go in expecting some funkiest, especially if someone in the shot is moving, as the bride apparently was when it was shot.

[-] satans_crackpipe@lemmy.world 12 points 11 months ago

Stop posting apple advertisments.

[-] orion2145@lemmy.world 10 points 11 months ago

There’s a note at the end of the article that says it was take using pano. So this is doubly unsurprising. Despite the instagram caption reading it wasn’t.

load more comments

this post was submitted on 01 Dec 2023

259 points (82.1% liked)

Technology

59038 readers

4107 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS