OpenAI’s Sam Altman announced in a social media post that he’s planning to loosen restrictions for adults using its chatbot to allow access to content like “erotica.”
The company isn’t clarifying what it means by “erotica” content, but the announcement comes one day after Governor Gavin Newsom vetoes a bill restricting users under 18 access to AI chatbots.
Sacha Haworth is the executive director of Tech Oversight California, which is a watchdog group that holds tech companies accountable.
Altman Tuesday’s X post began by saying the company is being more restrictive for those dealing with mental health issues but then pivots to plans to loosen restrictions for adults, giving them access to more content including erotica.
“What’s concerning is that this company has not proven that they can prevent a child from accessing that same thing. Tweeting doesn’t make it true,” said Haworth.
OpenAI has been under fire when it comes to safety. The company was named in a lawsuit by a family, blaming ChatGPT for their teenage son committing suicide.
Haworth fears a new erotica feature that could create a downside for users.
“The priority of these companies is to encourage people to stay on their platform as long as possible,” said Haworth.
The National Center of Sexual Exploitation is also calling on OpenAI to reverse its decision on adding erotica content, saying, “Sexualized AI chatbots are inherently risky, generating real mental health harms from synthetic intimacy; all in the context of poorly defined industry safety standards.”
Wednesday, Altman said they are not “loosening any policies related to mental health” and that “minors need significant protection with the chatbot”. But he also said OpenAI is not the “moral police of the world.”
Some tech experts say they are not surprised by the company’s pivot.
“This is an industry, they want to make money, and they don’t want to close down, they think erotica is a good stream of revenue. Historically it has been for many industries,” said Nolan Higdon, a digital culture expert.
OpenAI plans to roll out these changes in December.
NBC Bay Area has reached out to the company to get more clarification but hasn’t heard back.
Pete Suratos
Source link