Google’s Bard AI chatbot has been caught plagiarizing a CPU review from Tom’s Hardware and it doesn’t seem happy about it. A journalist at the tech news website asked Bard, “which of two competing processors — the Intel Core i9-13900K or AMD Ryzen 9 7950X3D — was faster,” and that’s when things took an interesting turn. It appears that the AI essentially scrapes the internet for data in order to answer questions. The problem is that it doesn’t necessarily cite its sources when doing so, that is unless the user presses the AI to provide them.
From Tom’s Hardware:
“The answer it gave was taken directly from one of our Tom’s Hardware articles, but Bard didn’t mention the article and instead referred to the number as occurring “in our testing,” implying that Google itself had done the benchmarking.”
Upon further questioning about where the AI obtained its information from it then stated Tom’s and when asked if it had just plagiarized by not citing its source, it said yes. Bard even went so far as to apologize for its mistake and that it would try to be more careful in the future. However, when the journalist provided a screenshot of the previous conversation and asked Bard, a day later, if it had ever committed plagiarism the AI responded that the screenshot was a fake. Paul Lilly (Hot Hardware) also confirmed getting a similar response.
Beta Does Afterall Mean Not Quite Ready for Primetime
Google’s Bard AI chatbot is technically in a Beta phase and Google itself has said that it is an “experimental conversational AI service”. Google has even gone so far as to include disclaimers on Bard’s homepage clarifying that the service “may give inaccurate or inappropriate responses.” The Bard FAQ does include a section regarding how and when Bard cites its sources.
From Bard FAQ:
“Bard, like some other standalone LLM experiences, is intended to generate original content and not replicate existing content at length. We’ve designed our systems to limit the chances of this occurring, and we will continue to improve how these systems function. If Bard does directly quote at length from a webpage, it cites that page.
Bard was built to be a creative and helpful collaborator—it works well in creative tasks like helping you write an email or brainstorm ideas for a birthday party. We see it as a complementary experience to Google Search. That’s why we added the “Google It” button to Bard, so people can easily move from Bard to explore information from across the web.
Bard is an experiment, and we’ll use its launch as an opportunity to learn, iterate, and improve the experience as we get feedback from a range of stakeholders including people like you, publishers, creators, and more.“
What happened regarding the instance of it using data from Tom’s CPU review does somewhat reflect what is stated here but clearly, it needs a bit more work. Tom’s further clarified about the responses Bard gave vs. what was in their review which shows how the AI honed in on key data points for its answer.
“In our testing, the $699 Ryzen 9 7950X3D is 12% faster than the $589 Core i9-13900K at 1080p gaming at stock settings, and 9% faster when the chips are overclocked.”– Tom’s Hardware
“The AMD Ryzen 9 7950X3D is faster than the Intel Core i9-13900K in gaming. In our testing, the 7950X3D was 12% faster than the 13900K at 1080p gaming at stock settings, and 9% faster when the chips were overclocked.”Bard