Google AI Mode gives inconsistent answers on US election results
Google’s AI Mode gave inconsistent answers when asked about US election results, sometimes directing users to official records instead of naming the winner. The variation matters because straightforward questions about certified results may receive different levels of detail depending on the user and how the question is asked.
In tests, answers varied across elections and users: some questions about the 2020, 2024 and 2012 elections received links rather than direct responses, while asking again produced winners and cited Google Civics data. The answers became more direct in spot checks from Taiwan, Russia, France and Canada, and Google’s Gemini and other chatbots responded directly. AI Mode attributed its behaviour to strict safety filters and a preference for official sources, though the article notes that AI systems can be unreliable when describing their own processes.
In short
- Google AI Mode sometimes avoided naming US election winners.
- Responses varied by user, election and repeated questions.
- The tool cited safety filters and official records.
Steelman: both sides, in good faith
The strongest fair case each way — we don't pick a winner.
The case for
A cautious approach to election questions can help prevent AI from confidently spreading incorrect or misleading claims, especially when official records provide a reliable way to verify results. Directing users to certified sources may be a reasonable safeguard, and variation in answers could reflect differences in wording or how the system applies those safeguards.
The case against
Certified election results are settled facts, so users should be able to get a clear, consistent answer to a straightforward question. If the system sometimes names a winner and sometimes provides only links, that inconsistency can confuse users and weaken trust; careful sourcing should support a direct answer rather than replace one.
Explained simply
US presidential elections are run by state and local authorities, which count votes and certify results under state rules. The Electoral College formally determines the winner, and federal officials record the result when Congress counts electoral votes.
Google AI Mode is a search feature that generates conversational answers, sometimes drawing on information from websites and Google’s own data. Google Civics provides information about elections and government. AI systems can give different answers to similar questions, so the detail they provide may vary with how a question is phrased or where it is asked.
The issue matters because people use search tools to find basic information about elections. Official records provide a way to check certified results, while an AI-generated answer may not always make those results clear.
AI Elections Politics Technology
Read the full article at the source →
Originally published by Ars Technica as “Google AI gets cagey when asked who won the 2020 elections”.