FWIW, I've gone to ChatGPT multiple times with a specific intent to buy, like "hey I need a thing like X or Y, but with quality Z too" and sometimes it just hallucinates things that appear never to have existed, other times it comes up with real items, but the links it gives me to buy them lead nowhere, so I end up just googling the name of it and buying it that way (examples: computer monitor, power bar, USB charge station, kitchen gadgets, Christmas presents/toys, soldering supplies like tips and flux, 3D printing filaments, etc).
I would guess that ChatGPT has left at least $100 on the table from me having to do this when literally all it had to do was give me a referral link to Amazon or whatever and I would have clicked the buy button.
> I would guess that ChatGPT has left at least $100 on the table
Man, this thing is going to be so lucrative when they inject ads into it. Imagine how this is going to combine with the parasocial AI boyfriend/girlfriend people, it's going to be worse than hostess clubs. They'll have to invent whole new categories of nonexistant products for the bots to sell.
Same experience, I thought using chatGPT to find some fairly specific things to buy would be a slam dunk, but it couldn’t provide links half the time and also failed to hold to criteria like shipping region etc. I would tell it to give direct links and it would mostly just say ”go on Amazon and search for X”.
There’s a special type of frustration when an LLM is close to being useful but just… isn’t.
I have similar experiences. Asked to find and list a bunch of suppliers near a specific city. It started showing me places that were >5 hours away, claiming them to be a "short drive".
In most of these cases I'm not looking for "the best" or a ranked list. Rather I'm looking for an item to fill a specific need and I can judge within a second of seeing the picture if it does or does not.
I expect some or all of the items I've been shown did exist for sale at some point in the past and information about them was in the training data.
You prefer outdated-by-atleast-a-year data instead of the freshly scraped and ranked Google Search results?
GPT 5 was publicly released in August last year. That data has to be atleast a year old, right?
If I'm comparing Macbook Neo to a Chromebook, it's impossible for the Neo to show up in the training data, and has to use RAG
(This is assuming the data is atleast a year old. Seems like OAI isn't doing fresh runs for 5.1, 5.2, etc. but I'm unsure if that's been officially disclosed)
Not everything good or necessary was released in the past two years.
As an example interaction, recently I sent ChatGPT a picture of my soldering station and say I'm having trouble with it being slow to melt and it says "well these are your upgrade options but really all you need is a chunkier tip with more thermal mass, he's a link to a tip set you could try" but then the link is dead and I'm able to google my own similar set and just buy it (it worked great).
Another one was wanting a U-shaped bracket to mount a riser on my desk, and the only ones I could find at the building supply store are L-shaped. I asked Chat about this and it said it's just too niche of an item to be mass produced but suggested I buy from someone doing semi-custom fabrication on etsy. Sure enough... another dead link, but I google it and find the store, and order.
Two cases where I didn't really know what I actually wanted/needed, and Chat successfully filled the gap with information I was able to independently verify afterward, but also Chat missed out on the opportunity to get a referral fee out of my eventual spend.
Hi Mike, how recently was it you’ve last tried to find products on ChatGPT? We’ve been making many updates recently, so wanted to pinpoint what it might be to improve on things.
I would guess that ChatGPT has left at least $100 on the table from me having to do this when literally all it had to do was give me a referral link to Amazon or whatever and I would have clicked the buy button.