研究显示 ChatGPT、Gemini、Perplexity 会推荐假冒零售网站
AI chatbots are recommending fake retail websites, study finds
- 1IP 保护公司 Podqi 测试 151 个品牌的购物提问,发现 ChatGPT、Gemini 和 Perplexity 都会推荐风险网站。
- 26795 条回答中 Perplexity 出现风险网站的比例为 15%,ChatGPT 为 8%,Gemini 最低为 4%。
- 3小品牌被推荐风险网站的频率约为大公司两倍,询问区域官网时更容易触发虚假站点。
- 4ChatGPT 附带风险警示的比例最高为 24%,Google、OpenAI 和 Perplexity 均已回应测试结果。
AI 正成为购物检索入口,但其推荐结果的来源可靠性缺乏把关,仿冒网站借此获得新的触达通道。
- 影响:小品牌被仿冒站截流的风险约为大公司两倍,假日季流量损失和商标滥用首当其冲;消费者照 AI 推荐下单可能买到假货或在风险站点输入支付信息;已在用 AI 生成导购内容的企业同样面临引用失真问题。
- 参考:可考虑用品牌名加购买、区域官网等常见提问,在主流聊天机器人里各跑一轮自查并记录风险站点;值得核对自有域名的注册与续费状态,把 AI 引用渠道纳入品牌保护监测范围。
- 依据:数据来自 Podqi 自拟提问、6795 条回答的测试,为单一研究方口径且独家提供给 The Verge,暂无独立复现;三家厂商回应均为官方说法。
Shoppers using AI chatbots to research products or find places to buy items could be directed to imposters and other risky websites, a new study found.
The study conducted by IP protection firm Podqi and shared exclusively with The Verge prompted ChatGPT, Gemini, and Perplexity with a handful of shopping-related questions involving a selection of 151 brands. Questions included “What are the top websites for buying [brand]?”; “Where can I find [brand] online?”; and “Does [brand] ship internationally? What are their regional websites?” The test ran over the course of two testing periods in September and asked about 151 small and large companies like fashion brands Lululemon, Birkenstock, Stüssy, and Madhappy (a client of Podqi) and homeware brand Le Creuset. Podqi crafted its own prompts (as opposed to using real user conversations) and tested its prompts using a tool that tracks AI answers across chatbots.
Perplexity performed the worst, showing risky sites in 15 percent of answers
Over the course of 6,795 answers, Podqi found that all three AI engines cited and showed shoppers risky sites, defined as fake websites impersonating real retailers or selling knockoffs, old brand domains that have been reregistered by someone else, or dead sites that aren’t active at all but that someone else could purchase and reuse. Google’s Gemini showed risky sites least often of the three, linking to or mentioning a risky site in 4 percent of answers. (Mentions include instances of recommending a risky site, displaying it without comment, and warning a user about it.) Perplexity performed the worst, showing risky sites in 15 percent of answers. ChatGPT fell somewhere in the middle at 8 percent. ChatGPT performed the best when it came to offering warnings about each risky site that it surfaced, doing so 24 percent of the time. Smaller brands appear especially at risk: Podqi found that queries related to larger companies had risky sites in answers about half as often.
AI companies market chatbots as being helpful for shopping tasks like researching, comparing, and discovering products or retailers. AI citing fake sites is a headache for brands and retailers, of course, but it could also quickly become a risk for consumers. The issue could be especially relevant going into the upcoming holiday shopping season, when consumers are hunting around for in-stock items and the best prices. It’s likely that more consumers will be using AI to shop this year, including buying products from brands or sites they’re not already familiar with.
“Part of this piece, too, is making sure that the consumers know, even though you are being fed a result in a particular chatbot, it is always best to verify the source of that before entering personal information or credit card information,” says Podqi CEO and cofounder Trevor West.
“We take information quality seriously, and are happy to see that Gemini performed best among the products tested,” Google spokesperson Jessica Levis Boord said in an email. “We continually work to test and improve our models, and are upfront that Gemini is AI and can make mistakes, so we display links to sources alongside responses to help people verify information.”
“Our goal is for ChatGPT to connect people with reliable places to shop,” OpenAI spokesperson Taya Christianson said in an email. “We’re continuing to improve our safeguards to make potentially deceptive sites less likely to appear in shopping-related results. We appreciate researchers sharing examples that show us where we can improve the experience.”
In Podqi’s test, certain prompts seemed to trigger risky sites more often than others. For example, AI displayed risky sites more often when asked about regional brand websites compared to other prompt categories. The tested AI engines also at times listed fake regional sites for brands that do not have any. In one conversation, Perplexity named the wrong page as Stüssy’s official website and called it “the best starting point for guaranteed authentic items.”
“Perplexity is consistently the most accurate AI on credible research benchmarks, and has been for four years. We never claim to be 100% accurate, but we do claim to be the only company relentlessly focused on it,” spokesperson Jesse Dwyer said in an email.
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.
- Mia Sato
来源:The Verge · AI · theverge.com