Facebook with Latestnigeriannews  Twieet with latestnigeriannews  RSS Page Feed
Home  |  All Headlines  |  Punch  |  Thisday  |  Daily Sun  |  Vanguard   |  Guardian  |  The Nation  |  Daily Times  |  Daily Trust  |  Daily Independent
World  |  Sports  |  Technology  |  Entertainment  |  Business  |  Politics  |  Tribune  |  Leadership  |  National Mirror  |  BusinessDay  |  More Channels...

Viewing Mode:

Archive:

  1.     Tool Tips    
  2.    Collapsible   
  3.    Collapsed     
Click to view all Entertainment headlines today

Click to view all Sports headlines today

Advanced AI chatbots are less likely to admit they don't have all the answers

Published by Engadget on Thu, 26 Sep 2024


Researchers have spotted an apparent downside of smarter chatbots. Although AI models predictably become more accurate as they advance, they're also more likely to (wrongly) answer questions beyond their capabilities rather than saying, 'I don't know.' And the humans prompting them are more likely to take their confident hallucinations at face value, creating a trickle-down effect of confident misinformation.'They are answering almost everything these days,' Jos Hernndez-Orallo, professor at the Universitat Politecnica de Valencia, Spain, told Nature. 'And that means more correct, but also more incorrect.' Hernndez-Orallo, the project lead, worked on the study with his colleagues at the Valencian Research Institute for Artificial Intelligence in Spain.The team studied three LLM families, including OpenAI's GPT series, Meta's LLaMA and the open-source BLOOM. They tested early versions of each model and moved to larger, more advanced ones ' but not today's most advanced. For example, the team began with OpenAI's relatively primitive GPT-3 ada model and tested iterations leading up to GPT-4, which arrived in March 2023. The four-month-old GPT-4o wasn't included in the study, nor was the newer o1-preview. I'd be curious if the trend still holds with the latest models.The researchers tested each model on thousands of questions about 'arithmetic, anagrams, geography and science.' They also quizzed the AI models on their ability to transform information, such as alphabetizing a list. The team ranked their prompts by perceived difficulty.The data showed that the chatbots' portion of wrong answers (instead of avoiding questions altogether) rose as the models grew. So, the AI is a bit like a professor who, as he masters more subjects, increasingly believes he has the golden answers on all of them.Further complicating things is the humans prompting the chatbots and reading their answers. The researchers tasked volunteers with rating the accuracy of the AI bots' answers, and they found that they 'incorrectly classified inaccurate answers as being accurate surprisingly often.' The range of wrong answers falsely perceived as right by the volunteers typically fell between 10 and 40 percent.'Humans are not able to supervise these models,' concluded Hernndez-Orallo.The research team recommends AI developers begin boosting performance for easy questions and programming the chatbots to refuse to answer complex questions. 'We need humans to understand: 'I can use it in this area, and I shouldn't use it in that area,'' Hernndez-Orallo told Nature.It's a well-intended suggestion that could make sense in an ideal world. But fat chance AI companies oblige. Chatbots that more often say 'I don't know' would likely be perceived as less advanced or valuable, leading to less use ' and less money for the companies making and selling them. So, instead, we get fine-print warnings that 'ChatGPT can make mistakes' and 'Gemini may display inaccurate info.'That leaves it up to us to avoid believing and spreading hallucinated misinformation that could hurt ourselves or others. For accuracy, fact-check your damn chatbot's answers, for crying out loud.You can read the team's full study in Nature.This article originally appeared on Engadget at https://www.engadget.com/ai/advanced-ai-chatbots-are-less-likely-to-admit-they-dont-have-all-the-answers-172012958.html'src=rss
Click here to read full news..

All Channels Nigerian Dailies: Punch  |  Vanguard   |  The Nation  |  Thisday  |  Daily Sun  |  Guardian  |  Daily Times  |  Daily Trust  |  Daily Independent  |   The Herald  |  Tribune  |  Leadership  |  National Mirror  |  BusinessDay  |  New Telegraph  |  Peoples Daily  |  Blueprint  |  Nigerian Pilot  |  Sahara Reporters  |  Premium Times  |  The Cable  |  PM News  |  APO Africa Newsroom

Categories Today: World  |  Sports  |  Technology  |  Entertainment  |  Business  |  Politics  |  Columns  |  All Headlines Today

Entertainment (Local): Linda Ikeji  |  Bella Naija  |  Tori  |  Pulse  |  The NET  |  DailyPost  |  Information Nigeria  |  Gistlover  |  Lailas Blog  |  Miss Petite  |  Olufamous  |  Stella Dimoko Korkus Blog  |  Ynaija  |  All Entertainment News Today

Entertainment (World): TMZ  |  Daily Mail  |  Huffington Post

Sports: Goal  |  African Football  |  Bleacher Report  |  FTBpro  |  Kickoff  |  All Sports Headlines Today

Business & Finance: Nairametrics  |  Nigerian Tenders  |  Business Insider  |  Forbes  |  Entrepreneur  |  The Economist  |  BusinessTech  |  Financial Watch  |  BusinessDay  |  All Business News Headlines Today

Technology (Local): Techpoint  |  TechMoran  |  TechCity  |  Innovation Village  |  IT News Africa  |  Technology Times  |  Technext  |  Techcabal  |  All Technology News Headlines Today

Technology (World): Techcrunch  |  Techmeme  |  Slashdot  |  Wired  |  Hackers News  |  Engadget  |  Pocket Lint  |  The Verge

International Networks:   |  CNN  |  BBC  |  Al Jazeera  |  Yahoo

Forum:   |  Nairaland  |  Naij

Other Links: Home   |  Nigerian Jobs