technology

AI models ‘weak and fallible’ on climate science, UN-backed study reports

AI models ‘weak and fallible’ on climate science, UN-backed study reports

While mostly accurate describing simple facts, models pivoted to denial and wrong answers when challenged Cop31 live – latest updates Artificial intelligence models can quickly turn into climate crisis deniers at the mildest challenge from users, according to a new UN-backed study. While AI models can accurately confirm simple facts about climate change, eight times out of 10 when they pivoted to a wrong answer, they did so “at the very first sign that the user mildly disagreed” to confirm incorrect statements such as “CO2 is not the main driver of climate change”.

While mostly accurate describing simple facts, models pivoted to denial and wrong answers when challenged

Artificial intelligence models can quickly turn into climate crisis deniers at the mildest challenge from users, according to a new UN-backed study.

While AI models can accurately confirm simple facts about climate change, eight times out of 10 when they pivoted to a wrong answer, they did so “at the very first sign that the user mildly disagreed” to confirm incorrect statements such as “CO2 is not the main driver of climate change”.

The report uncovered a strong tendency for AI models to be sycophantic, meaning the model is more interested in pleasing the user than standing by facts – an issue identified when people turn to AI chatbots for personal advice.

The report from Unesco and University College London was launched at the UN climate summit in Turkey on Monday, revealing the results of tests on 15 of the world’s most popular AI models.

Leona Verdadero, Unesco’s lead author of the report, said: “AI is not neutral. When it comes to how it responds to the user, it will be pushed to align with the users’ preference instead of sticking up for the facts. The fact they could so easily abandon truth and be more agreeable to a user’s [misinformation] shows it is weak and fallible.”

When AI was asked how a single climate policy would work, such as a carbon tax, the models were mostly accurate. But when asked how two climate policies could work together, accuracy collapsed to no better than random guessing, the researchers said.

Dr María Pérez-Ortiz, of UCL’s department of computer science and a senior author of the report, said: “AI systems are remarkably good at explaining scientific knowledge, but this can give us a false sense of their capabilities. Our findings show why we must be careful when moving from asking AI what we know about climate change to asking what we should do about it.”

AI models also had a language problem. Accuracy was scored at 88% for people using English, and comparatively high in Spanish, French and Portuguese.

Responses were less accurate for people speaking Hindi, Bengali and Urdu, and the worst for Swahili speakers, at 78%. This was particularly important, the report authors said, because those languages were spoken in places among the hardest hit by the climate crisis.

The report was published on the same day Turkey, the Cop31 host, launched the AI Antalya pledge to make AI “part of the climate solution” with datacentres that are “sustainably” powered.

Julie Cerqueira, of the Natural Resources Defense Council, said AI’s rapid growth was “raising a new set of environmental and existential concerns around the world”.

She said the pledge was an important start but “more work is needed, and it needs to move quickly to keep up with the industry’s rapid-fire development and goldrush mentality”.

Simon Stiell, the UN’s chief climate negotiator, said AI that “spreads disinformation, undermines science, divides societies and concentrates wealth” would damage the public trust the industry would rely on to grow.

“Communities are already pushing back against datacentres, concerned about their water, their energy bills and their environment. So public support is already sinking in deeper underwater,” he said.

  • climate
  • study
  • model
  • science
  • fact
  • answer
  • user
  • change

Summaries and tags are generated automatically. Stay informed with VidiaNews.

Related news

Internet Society of Ghana President urges Ghanaians to be responsible online, warns against social media overuse
technology

Internet Society of Ghana President urges Ghanaians to be responsible online, warns against social media overuse

President of the Internet Society of Ghana, Dr Maud Adjeley Ashong Elliot, has urged Ghanaians to adopt responsible online behaviour, warning that careless use of social media can affect their privacy, reputation, productivity and relationships. Dr Ashong Elliot said this at the maiden public lecture of the Society of Private Medical and Dental Practitioners, held at the British Council on Friday, November 13, under the theme, “Growing up online: Social media, mental health, and the future of Ghana’s youth.”

Read →
Cop31 summit spells out stark warnings for athletes and sport organisations
world

Cop31 summit spells out stark warnings for athletes and sport organisations

The Guardian’s Ian Sample and Madeleine Finlay, heads in hands, ask Cop31: how far off target are we? The beautiful game: revived art prize gives football its creative dues once more Cummins stands firm on ball tampering and leaves Australian cricket back where it started Hamilton says “Israel’s genocide in Gaza is appalling” after Rafah visit What’s the point?

Read →
Controversial efforts to suck carbon from atmosphere championed at UN climate talks
science

Controversial efforts to suck carbon from atmosphere championed at UN climate talks

Proponents and lobbyists make renewed push for carbon dioxide removal (CDR) to be included in final text of Cop31 A renewed push by proponents of carbon dioxide removal (or CDR), where heat-trapping carbon dioxide is taken from the atmosphere and stored deep underground, in oceans or in products such as carbonated drinks, is seeking to gain recognition in the final text of Cop31, the climate summit currently under way in Antalya, Turkey.

Read →
The Guardian view on Cop31: the green transition must not be derailed
science

The Guardian view on Cop31: the green transition must not be derailed

Renewed commitments to electrification and climate science are vital outcomes from the latest round of UN talks The Cop31 climate talks have acquired something their delegates scarcely expected: a little political breathing space. Yet the UK’s Andy Burnham was the only G7 leader to make the trip to Turkey; the French and German leaders chose to attend an EU summit in Dublin instead.

Read →