it’s so amazing, the absolute brain rot it takes to think that a LLM is a better way to operate a vending machine than simple if-then logic. “If the value of money inserted is equal to the price, then dispense the item”.
Like, why? What is even the point? It doesn’t need to negotiate the price, it doesn’t need have a conversation about your day, the vending machine just needs to dispense something when payed the right amount.
The idea is that it isn't just operating the vending machine itself, it's operating the entire vending machine business. It decides what to stock and what price to charge based on market trends and/or user feedback.
It's a stress test for LLM autonomy. Obviously a vending machine doesn't need this level of autonomy, you usually just stock it with the same thing every time. But a vending machine works as a very simple "business" that can be simulated without much stakes, and it shows how LLM agents behave when left to operate on their own like this, and can be used to test guardrails in the field.
Did you read the article? This one also ordered goods to be stocked in it based on user feedback and was meant as an experiment for people to break anyway
The if-then machine would not be able to rise the price of things based on the costumers habits
SellTheThings () {
If [ sells this much in this period of time people or supply is low ]; then
raise.prices
elif [ the opposite ]; then
lower.prices
else
same.prices
fi
}
A purely mechanical counting/tabulating device could calculate that.
There is zero actual reason for AI.
Only an AI can detect how expensive-looking your clothes are and raise the price based on that.
In case of an office vending machine, it could even identify you by your ID, check with the HR AI to see how much you make and adjust prices accordingly
Even if we assume they want to do discriminatory pricing (they probably do), they can do that without using LLMs. Use facial recognition and other traditional models to predict the person's demographics and maybe even identify them. If you know who they are, do a lookup for all products they've expressed interest in elsewhere (this can be done with either something like a graph DB or via embeddings). Raise the price if they seem likely to purchase it based on the previous criteria. Never lower the price.
That's a complicated process, but none of that needs an LLM, and they'd be doing a lot of this already if they're going full big brother price discrimination.
It was a literal 100-level course project in my CS programme in 2000 or so.
You didn't even do it with a programmed CPU, you used 74xx logic gates and counters wired on a breadboard
Nice, have any material you can share?
Even if you wanted the AI to have a conversation with the user, like in sci-fi visions of the future, why does that affect the output of the machine? If you really wanted to make an AI grift version of a vending machine, just graft a chatbot on a screen stop the section where you make selections and pay. This whole bubble is absurd.
Maybe AI isn't so bad after all. In fact, they should implement this in more locations.
That was all part of the idea, though, because Anthropic had designed this test as a stress test to begin with. Previous runs in their own office had indicated similar concerns.
Guy who just got his shit wrecked: it was a social experiment
Here's the 60 Minutes piece and Anthropic's June article about the one in their own office.
Claudius was cajoled via Slack messages into providing numerous discount codes and let many other people reduce their quoted prices ex post based on those discounts. It even gave away some items, ranging from a bag of chips to a tungsten cube, for free.
Their article on this trial has some more details too.
I hate when I get to a vending machine, only to find out it's out of tungsten cubes.
They are desperate for any usecase they can sell LLM for.
If this was a stress test, imagine it doing anything important.
Actually since it's doing so well, they should stress test their market value and make it CEO
It looks like it's 10,000 years away from being trusted with anything. The number of times it said, "I think this person is bullshitting me" and then did what it was asked anyway was rediculous.
Comrade Soda-Machine, is that you?
Brendan would never hurt a fly!
I can see a new film; Terminator: Rise of the Vending Machines
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.