Primary Country (Mandatory)

United States

Other Country (Optional)

Set News Language for United States

Primary Language (Mandatory)
English
Other Language[s] (Optional)
No other language available

Set News Language for World

Primary Language (Mandatory)
English
Other Language(s) (Optional)

Set News Source for United States

Primary Source (Mandatory)
CNN
Other Source[s] (Optional)

Set News Source for World

Primary Source (Mandatory)
AajTak
Other Source(s) (Optional)
  • Countries
    • India
    • United States
    • Qatar
    • Germany
    • China
    • Canada
    • World
  • Categories
    • National
    • International
    • Business
    • Entertainment
    • Sports
    • Special
    • All Categories
  • Available Languages for United States
    • English
  • All Languages
    • English
    • Hindi
    • Arabic
    • German
    • Chinese
    • French
  • Sources
    • India
      • AajTak
      • NDTV India
      • The Hindu
      • India Today
      • Zee News
      • NDTV
      • BBC
      • The Wire
      • News18
      • News 24
      • The Quint
      • ABP News
      • Zee News
      • News 24
    • United States
      • CNN
      • Fox News
      • Al Jazeera
      • CBSN
      • NY Post
      • Voice of America
      • The New York Times
      • HuffPost
      • ABC News
      • Newsy
    • Qatar
      • Al Jazeera
      • Al Arab
      • The Peninsula
      • Gulf Times
      • Al Sharq
      • Qatar Tribune
      • Al Raya
      • Lusail
    • Germany
      • DW
      • ZDF
      • ProSieben
      • RTL
      • n-tv
      • Die Welt
      • Süddeutsche Zeitung
      • Frankfurter Rundschau
    • China
      • China Daily
      • BBC
      • The New York Times
      • Voice of America
      • Beijing Daily
      • The Epoch Times
      • Ta Kung Pao
      • Xinmin Evening News
    • Canada
      • CBC
      • Radio-Canada
      • CTV
      • TVA Nouvelles
      • Le Journal de Montréal
      • Global News
      • BNN Bloomberg
      • Métro
MoreBack to News Headlines
Researchers warn of unchecked toxicity in AI language models

Researchers warn of unchecked toxicity in AI language models

CTV
Monday, April 22, 2024 11:21 AM GMT

As OpenAI’s ChatGPT continues to change the game for automated text generation, researchers warn that more measures are needed to avoid dangerous responses.

As OpenAI’s ChatGPT continues to change the game for automated text generation, researchers warn that more measures are needed to avoid dangerous responses.

While advanced language models such as ChatGPT could quickly write a computer program with complex code or summarize studies with cogent synopsis, experts say these text generators are also able to provide toxic information, such as how to build a bomb.

In order to prevent these potential safety issues, companies using large language models deploy safeguard measures called “red-teaming,” where teams of human testers write prompts aimed at provoking unsafe responses, in order to trace risks and train chatbots to avoid providing those types of answers.

However, according to researchers with Massachusetts Institute of Technology (MIT), “red teaming” is only effective if engineers know which provocative responses to test.

In other words, a technology that does not rely on human cognition to function still relies on human cognition to remain safe.

Researchers from Improbable AI Lab at MIT and the MIT-IBM Watson AI Lab are deploying machine learning to fix this problem, developing a “red-team language model” specifically designed to generate problematic prompts that trigger undesirable responses from tested chatbots.

"Right now, every large language model has to undergo a very lengthy period of red-teaming to ensure its safety,” said Zhang-Wei Hong, a researcher with the Improbable AI lab and lead author of a paper on this red-teaming approach, in a press release.

Read full story on CTV
Share this story on:-
Run 3 Space | Play Space Running GamePlay Run 3, the ultimate space tunnel running game with 300+ challenging levels!Adv.
Traffic Jam 3D | Online Racing GameTraffic Jam 3D is a game where you’ll be driving through heavy traffic.Adv.
Duck Hunt | Play Old Classic GamePlay the classic 1984 light gun shooter game Duck Hunt on your browser.Adv.
More Related News
Parking Slot | Free Parking GamePlay Parking Slot, the best online 3D car driving and parking game.Adv.
Slope Ball Run - Play OnlineSlope Game takes you on an exciting journey of a ball on special paths.Adv.
© 2008 - 2025 Webjosh  |  News Archive  |  Privacy Policy  |  Contact Us