154
submitted 7 months ago by WayeeCool@hexbear.net to c/news@hexbear.net

Just over half of Amazon Fresh stores are equipped with Just Walk Out. The technology allows customers to skip checkout altogether by scanning a QR code when they enter the store. Though it seemed completely automated, Just Walk Out relied on more than 1,000 people in India watching and labeling videos to ensure accurate checkouts. The cashiers were simply moved off-site, and they watched you as you shopped.

you are viewing a single comment's thread
view the rest of the comments
[-] nationalize_amazon@hexbear.net 14 points 7 months ago

I used to work at Amazon on this, and I know A LOT about how this technology works. If I remember correctly, JWO began to separate from Amazon Fresh back in late 2022 when they told us they would cancel JWO in the new Amazon Fresh upcoming stores and use their new dash carts instead. They told us that the focus would instead be selling JWO tech to third party vendors, such as stores in stadiums and airports.

I know (somewhat outdated) about how most of their tech works, as well as some of the internally-stated reasoning behind their business decisions. AMA lol

[-] nationalize_amazon@hexbear.net 17 points 7 months ago

One thing I know for a fact that is probably the most troubling/dystopian, is that the technology absolutely exists and works pretty well to be able to track the movements of every individual person in a crowd, including by having multiple camera angles as a person moves in and out of view. Drones, satellites, and street cameras can absolutely be used to do this on a fairly large scale, and I have to assume it is being done. Amazon's technology in particular isn't exactly doing this and I don't necessarily think they are providing it to 5 eyes or whatever, but I know for a fact it can and is being done at least for some BS convenience stores.

[-] thebartermyth@hexbear.net 7 points 7 months ago

Probably schools tbh, there have been a lot of papers floated about using a camera and AI to tell if students are paying attention or cheating or whatever. There's already exammonitor & others using webcams so it's not a huge leap to make.

[-] silent_water@hexbear.net 10 points 7 months ago

so what did they do if you walked in, didn't scan your qr code, and walked out? how did they think they were going to separate the two groups well enough to prevent theft? like the whole concept screams "figure out how to steal in full view of the entire store". like one wig, a little costuming, and the cops are never going to find you from the video footage.

[-] nationalize_amazon@hexbear.net 13 points 7 months ago

I spent a decent amount of time thinking of how best to shoplift from there, lol. My best idea is that with some decent slight of hand, you could easily fool the system into thinking you took 1 product instead of 2, or you returned an item when you actually didn't. And then you can challenge your receipt to make them fix it. There are a lot of camera angles, but they are only 14fps, and it can still be pretty tough to tell what someone is actually doing even if they are acting totally normally and non-maliciously.

Another funny theory I had is that to beat the tracking system, you could lie down or something. It's not something I ever tested in practice, but their tracking system relies heavily on the assumption that everyone is standing upright, so maybe if you rolled on the floor a little it would get confused. But when it gets confused it goes to one of those low paid workers in India or Costa Rica, so it might get corrected manually.

[-] Awoo@hexbear.net 12 points 7 months ago* (last edited 7 months ago)

Horse costume for 2 people

[-] silent_water@hexbear.net 10 points 7 months ago

yeah, the whole thing just screams "find an attack vector". did they actually red team it?

[-] nationalize_amazon@hexbear.net 15 points 7 months ago

I mean, they test it a lot. It seems like the general philosophy though was that the ways of fooling the system reliably are somewhat convoluted, so if someone is willing to do all that, just let them lol.

Amusingly, one of the particular vulnerabilities that they mentioned having problems with in the UK in particular was people just brazenly going into a store, taking down some cameras or other equipment (networking equipment, edge compute, etc.) and Just Walking Out.

[-] DamarcusArt@lemmygrad.ml 6 points 7 months ago

It does seem like an easy way to do this is just get your buddy to shine a laser pointer at the camera while you grab the stuff.

[-] nationalize_amazon@hexbear.net 10 points 7 months ago

Any given shelf is generally visible by like 6-8 cameras.

[-] DamarcusArt@lemmygrad.ml 6 points 7 months ago

Oh, I see. That's fucked. Over here stores have like...3 cameras total? Giver or take? Positioned in a way that multiple aisles are covered by a single camera. We don't really have a lot of fearmongering about shoplifting though.

[-] nationalize_amazon@hexbear.net 7 points 7 months ago

It's not really about shoplifting, the cameras are a core component of the system, and if they could use fewer they would. Say what you will about the concept, but the cameras themselves aren't really the insidious part, in my opinion.

[-] JoeByeThen@hexbear.net 1 points 7 months ago

I'm assuming these cameras all have to be wired, right? If they were wifi, a concentrated deauth attack could take the whole store down.

[-] nationalize_amazon@hexbear.net 2 points 7 months ago

Yeah they're wired, larger grocery stores were kind of a problem because they need up to like 10gbps connection, which is pretty abnormal for a grocery store. Because yes, almost all of the video is processed in the cloud, although they are trying to shift more of it to processing on devices in the stores.

[-] nationalize_amazon@hexbear.net 10 points 7 months ago

The stores have gates that prevent entry until you scan the code. You could maybe hop the turnstyle, but there's usually at least one employee near the front to "help people get in". And to be fair, lots of people have questions about it so it's not entirely bs, but I guess their job is also to dissuade this.

[-] silent_water@hexbear.net 4 points 7 months ago

oh they're walk out only? that's bizarre.

[-] nationalize_amazon@hexbear.net 9 points 7 months ago

I mean, to scan in is still really quick, it's like going into a subway or something.

[-] thebartermyth@hexbear.net 5 points 7 months ago

Wouldn't this turn the store into a 'stealing minigame'?

[-] nationalize_amazon@hexbear.net 10 points 7 months ago

I mean yeah, you can try, but it's actually kind of difficult. It's way easier to steal from any conventional store, probably.

[-] thebartermyth@hexbear.net 8 points 7 months ago

yeah, that makes sense. I guess it just feels like a dare.

[-] InappropriateEmote@hexbear.net 7 points 7 months ago

A price tag on anything in any store is a dare imo. You just have to weigh the likelihood of succeeding if you accept the dare and what the stakes are if you fail.

this post was submitted on 02 Apr 2024
154 points (100.0% liked)

news

23553 readers
847 users here now

Welcome to c/news! Please read the Hexbear Code of Conduct and remember... we're all comrades here.

Rules:

-- PLEASE KEEP POST TITLES INFORMATIVE --

-- Overly editorialized titles, particularly if they link to opinion pieces, may get your post removed. --

-- All posts must include a link to their source. Screenshots are fine IF you include the link in the post body. --

-- If you are citing a twitter post as news please include not just the twitter.com in your links but also nitter.net (or another Nitter instance). There is also a Firefox extension that can redirect Twitter links to a Nitter instance: https://addons.mozilla.org/en-US/firefox/addon/libredirect/ or archive them as you would any other reactionary source using e.g. https://archive.today . Twitter screenshots still need to be sourced or they will be removed --

-- Mass tagging comm moderators across multiple posts like a broken markov chain bot will result in a comm ban--

-- Repeated consecutive posting of reactionary sources, fake news, misleading / outdated news, false alarms over ghoul deaths, and/or shitposts will result in a comm ban.--

-- Neglecting to use content warnings or NSFW when dealing with disturbing content will be removed until in compliance. Users who are consecutively reported due to failing to use content warnings or NSFW tags when commenting on or posting disturbing content will result in the user being banned. --

-- Using April 1st as an excuse to post fake headlines, like the resurrection of Kissinger while he is still fortunately dead, will result in the poster being thrown in the gamer gulag and be sentenced to play and beat trashy mobile games like 'Raid: Shadow Legends' in order to be rehabilitated back into general society. --

founded 4 years ago
MODERATORS