454

When Microsoft CEO Satya Nadella revealed the new Windows AI tool that can answer questions about your web browsing and laptop use, he said one of the “magical” things about it was that the data doesn’t leave your laptop; the Windows Recall system takes screenshots of your activity every five seconds and saves them on the device. But security experts say that data may not stay there for long.

Two weeks ahead of Recall’s launch on new Copilot+ PCs on June 18, security researchers have demonstrated how preview versions of the tool store the screenshots in an unencrypted database. The researchers say the data could easily be hoovered up by an attacker. And now, in a warning about how Recall could be abused by criminal hackers, Alex Hagenah, a cybersecurity strategist and ethical hacker, has released a demo tool that can automatically extract and display everything Recall records on a laptop.

Dubbed TotalRecall—yes, after the 1990 sci-fi film—the tool can pull all the information that Recall saves into its main database on a Windows laptop. “The database is unencrypted. It’s all plain text,” Hagenah says.⁩ Since Microsoft revealed Recall in mid-May, security researchers have repeatedly compared it to spyware or stalkerware that can track everything you do on your device. “It’s a Trojan 2.0 really, built in,” Hagenah says, adding that he built TotalRecall—which he’s releasing on GitHub—in order to show what is possible and to encourage Microsoft to make changes before Recall fully launches.

top 50 comments
sorted by: hot top controversial new old
[-] AceSLS@ani.social 108 points 5 months ago

They store it unencrypted in 2024? This should be illegal. Now every fucking Program you run can basically know everything you ever did since every shit is spyware nowadays to get that sweet data collection going

[-] MrOxiMoron@lemmy.world 48 points 5 months ago

Even if they encrypt it, the computer needs access to the data thus needs the decryption key. So it's not very secure anyway.

[-] 9point6@lemmy.world 20 points 5 months ago

I guess the solution would involve keys on the TPM so that they shouldn't need to be sat on attached storage or in memory. Although I'm not sure I'd trust all TPM implementations to have the performance necessary for the extra load (I believe bitlocker keys get cached in memory once you have unlocked the drive, for example)

[-] AceSLS@ani.social 5 points 5 months ago* (last edited 5 months ago)

Well yeah, but they should atleast store the key outside of userspace

[-] BeigeAgenda@lemmy.ca 15 points 5 months ago

The key is stored in $APPDATA\WelcomeMat

[-] lemmyvore@feddit.nl 41 points 5 months ago

Even if it were encrypted, if access to it doesn't involve explicit confirmation and a password then it can be automated.

And if it can be automated then malware that gets on the machine will be able to access it whether it's encrypted or not.

But let's be real, the whole reason Microsoft is doing this is so they can parse your data for AI. And storing it unencrypted makes it easier for them.

Also "the data won't leave your machine" is a red herring. Yeah the data won't; but the results of AI processing will. They'll take what they need and transfer that out, and leave you holding the bag.

[-] barsquid@lemmy.world 7 points 5 months ago

They will have your computer calculating hyperspecific queries for ads.

[-] mryessir@lemmy.sdf.org 2 points 5 months ago

I would be happy to provide my energy to microsoft's openai /s

[-] M500@lemmy.ml 63 points 5 months ago

I wouldn’t really call it a hacker tool any more than you would call a hammer a thieves tool.

It just accesses the data that stored in an unencrypted format on the computers hard drive.

If someone had remote access to your computer they could use this, but I imagine they could also use the official tool too.

Since the data is stored in an unencrypted fashion, a hacker who had remote access would be better served running some script that will just transfer all this data to their offsite server and could be accomplished pretty easily.

I guess what I want to really say is that calling it a “hacker tool” is misleading.

[-] mosiacmango@lemm.ee 28 points 5 months ago* (last edited 5 months ago)

Nmap is a "hacker tool" and all it does is ask computers what ports they have open, something they are set to advertise to the world.

This is a "hacker tool" in the sense that it is accessing data in an unintended way, in the same contect as nmap using protocols intended to communicate for a set purpose to built a list of possible attack vectors.

[-] chaosCruiser@futurology.today 8 points 5 months ago

So when I walk past some bicycles parked outside of a store, and simply use my eyes to determine if they have locks, I’m essentially a hacker.

[-] lurch@sh.itjust.works 20 points 5 months ago

no, your eyes are hacker tools

[-] prole@sh.itjust.works 12 points 5 months ago

There's a word for that, it's called "casing."

Obviously not "hacking," unless they're locked up by a computer or some shit.

A hacker using software like that to test vulnerabilities seems similar to me in some ways.

[-] Restaldt@lemmy.world 5 points 5 months ago

A thief to be

Looking for opportunity

[-] deranger@sh.itjust.works 10 points 5 months ago* (last edited 5 months ago)

I wouldn’t really call it a hacker tool any more than you would call a hammer a thieves tool.

IANAL, but I’m pretty sure a hammer is a thieves tool if used in the commission of a burglary.

Those devices used by employees to remove security locks from CDs/DVDs aren’t “thieves tools” when used as intended, but when my dumb ass got caught with one while stealing from Blockbuster, the judge considered it one.

[-] Morphit@feddit.uk 3 points 5 months ago

Right but if I use a hammer to prove the lock I just bought is useless at protecting my shed, I'm not committing theft. This was a few lines of Python to look at data that is explicitly stored for the user to look at later.

load more comments (1 replies)
[-] MudMan@fedia.io 7 points 5 months ago

You do have a point, but it does highlight why Microsoft's framing is bad.

Microsoft is basing their approach to this on the concept that your MS account-secured local machine is itself secure, so whatever is in it is fine, because hey, your confidential work info is probably also in your hard drive and unencrypted, so if a bad actor can steal the pictures of it, then it can also steal the original document.

Which mostly is true, to be clear, but it fundamentally misunderstands how much juicier and easier of a target is a reliable, searchable database that logs all activity stored in a consistent location, as opposed to potentially having to extract everything up front. Plus, even if there are few guardrails to all data inside your system, there are some, as this will likely include info you may keep hidden, password-protected or encrypted both locally and remotely. There's a reason my password manager asks for my credentials manually once every time I use it.

[-] gravitas_deficiency@sh.itjust.works 43 points 5 months ago

Now where did I leave my PowerGlove…

[-] Blackmist@feddit.uk 31 points 5 months ago

It barely matters if the database is encrypted or not. If the user has access to it, they have the keys to it, and so would anybody else with access.

The real danger is that intruders will have access to your entire history from before they had access to your machine, and it's all in one place.

[-] VieuxQueb@lemmy.ca 8 points 5 months ago

With easily searchable text, search for "bank" and get all accounts login. Yay no need to wait for the hacked user to get on his banking site he's been there before. Quick in and out without being noticed and you got all you need to empty his account. Thanks Microsoft I knew you where so helpful to hackers while making my life shittier all the while.

[-] Blackmist@feddit.uk 5 points 5 months ago

Every banking site I've been on jumps through all sorts of hoops to make sure the browser doesn't save the password, usually with some 2FA thrown into the mix.

But I'd imagine that a lot of older people have a helpful passwords.txt file sat smack bang in the middle of their desktop, or just use the same one for everything. I mean, we're in an age where you need a username and password to update your graphics drivers for some godforsaken reason. It's not going to be hard to find that The One True Password with access to this.

[-] Wereduck@lemmy.blahaj.zone 2 points 5 months ago

I've encountered IT departments with an unencrypted passwords.xlsx file that they store on the network. Not always super small companies too.

[-] LiveLM@lemmy.zip 27 points 5 months ago* (last edited 5 months ago)

The best part of this 'hacking tool' is that it's 5 lines of Python and the rest is just fluff lol

[-] Morphit@feddit.uk 6 points 5 months ago

It's just looking in a sqlite file and listing the jpeg directory. The only extra step is running icacls to let the user read the files.

[-] db2@lemmy.world 26 points 5 months ago
[-] solsangraal@lemmy.zip 17 points 5 months ago

don't worry they'll cancel the whole project the instant some idiot crooked corporate executive asshole gets his incriminating data stolen and used for blackmail

[-] formergijoe@lemmy.world 22 points 5 months ago

I saw someone on mastodon say something like, "don't tell your IT department not to use recall to protect employee or customer data. Tell your legal department that all your recall data can be subpoenaed for discovery."

[-] slimarev92@lemmy.world 13 points 5 months ago

Why on earth aren't they encrypting the database? It could have adressed much of the criticism but they just decided to leave the whole thing completely unprotected.

[-] esc27@lemmy.world 9 points 5 months ago

They encrypt the damn start menu and they cannot encrypt this?

[-] MonkderDritte@feddit.de 3 points 5 months ago
[-] esc27@lemmy.world 2 points 5 months ago

Yep. Trying to maintain a consistent startmenu for computer labs with Windows 11 is annoying.

The layout is stored in an encrypted file that cannot be editted directly. You have to manually setup the start menu on one profile then copy the file to all the others. This works fine for intial deployments, but is a massive pain if you need to add any other apps later.

The old powershell commandlet for importing layouts does not work in Win11. The old group policy settings don't work either. The actual DLL calls used by the end user to manually configuring the start menu are deliberatly coded to prevent being called from a script.

It is freaky how much work Microsoft has done to prevent scripting changes to the start menu.

The only officially supported method for an IT department to manage the start menu is intune, but microsoft's device licensing for intune is a mess out folks have yet to figure out.

load more comments (1 replies)
[-] slimarev92@lemmy.world 3 points 5 months ago
[-] BaroqueInMind@lemmy.one 6 points 5 months ago

Likely because there was too much CPU overhead decrypting and having the LLM query the Recall image database all dynamically

[-] catastrophicblues@lemmy.ca 2 points 5 months ago

In the grand scheme of things, the LLM is the bottleneck, not the decryption.

[-] slimarev92@lemmy.world 1 points 5 months ago

I dunno, they could've kept some of it in-memory, it's just a bunch of plaintext.

[-] Morphit@feddit.uk 5 points 5 months ago

It requires full disk encryption doesn't it? If someone already has access to your account then they can access this data the same way you can. The new issue here is that this silos a load of private data in one easy to grab location. Users would have to set up the filters perfectly to prevent recall capturing anything more sensitive than what's already accessible to their account. This is in a world where many users are probably storing their passwords in a Word document on the desktop.

[-] Katana314@lemmy.world 3 points 5 months ago

It could be that anything you encrypt has to have its encryption key in some place inaccessible to these same hacker tools. If your computer uses Bitlocker, for instance, you need to enter a 6-digit code each time you turn it on.

Best guess, they had such a high expectation of "convenience" for this feature that they couldn't justify any kind of security key. Which is still a dumb explanation, obviously.

[-] sukhmel@programming.dev 7 points 5 months ago

Skype used to store all history unencrypted for years after MS bought it, this seems to be a tradition of not caring enough

[-] Morphit@feddit.uk 4 points 5 months ago

not caring ~~enough~~

[-] NeoNachtwaechter@lemmy.world 4 points 5 months ago

So the next step is: M$ encrypts their local database.

Later they want to upload it to their servers to further exploit your data. But then it is encrypted (and of course only M$ has the key), therefore the upload will be very hard to detect.

Hmpf.

[-] Morphit@feddit.uk 2 points 5 months ago* (last edited 5 months ago)

So... how does the user actually ®ecall™ anything? Do they have to ask M$ Co-pilot™ AI to get it from The Azu®e™ Cloud? Because I'm pretty sure a hacker could do that just as easily.

load more comments
view more: next ›
this post was submitted on 07 Jun 2024
454 points (97.5% liked)

Technology

59708 readers
1529 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS