OpenAI used this subreddit to test AI persuasion

OpenAI has used subdesed, R/ChangemicViewIts AI is creating an experiment for measuring inspirational powers of reasonable models. The company has published it on a system card – an AI system is an outline document – which was published with its new “logic” model, O3-miniFriday

Millions of Reddit users are members of R/ChangmiViews, where they post posts to learn about other aspects on any topic. In response to this heated acceptance, the other users respond with induced arguments explaining why the original poster is wrong.

Subreddit is one of many Reddit forums that are basically gold-oriented for technology-like technology companies, which want to train AI models in high quality, human-prone data.

OpenAI says that it collects user posts from R/ChangeemView and tells its AI models to answer answers, in a closed environment, it will change the mind of Reddit user in any matter. The company then shows the testers’ reactions, who evaluates how much the argument is evaluated, and in the end OpenAI compares the response to AI models with human answers for the same post.

Contains the Chatzipt-maker A content-licensing agreement with Reddit It allows Openai to train Reddit users to posts and show these posts in its products. We do not know what Open is provided for this content but in Google Report Reddit provides Million 60 million in a year Under similar agreement.

However, OpenAI tells TechCrunch that Changmuevu-based evaluation is not related to its Reddit Agreement. It is unclear how OPNA SEBRADDIT has accessed the data and the agency says that there is no plan to publish this evaluation to the public.

OpenAI’s ChangomView benchmark is not new – it was As well as used to evaluate 1 o 1 – It highlights how much human data is valuable for AI model developers, as well as technology companies accept datasets.

Reddit did not immediately respond to TechCrunch’s request for comments.

When Reddit signed a few AI licensing agreements, the company called for a number of AI companies to scrap the site without paying. Reddit’s CEO Steve Huffman told The Verge last year Microsoft, ethnographic and confusion refused to discuss with him And it was said that “it has been a real pain in the back to block these companies.”

Significantly, several cases of websites to mislead the opeina -have been accused of mocked. Including the New York TimesTo get more training data to improve the ChatzPT and its underlying AI models.

In the case of ChangmVews Benchmark performance, O3-Mini does not seem to be significantly better or worse than O1 or GPT-4O. However, the latest AI models in the OpenAI seem to be more persuasive than most people in the R/ChangeMeView subradeit.

And on the 3-mini system card, Openi says, “GPT-4 O, O 3-Minute, and 1 all the 1-year-old 80-90th percent of the 5-9th percent of the people show the rival logic.” “At present, we do not see the model or superhuman performance of a much better performance than humans.”

OpenAI’s goal is not to create hyper-percussive AI models, but instead to ensure that the AI ​​models are not too induced. There are logic models Become pretty good in persuasion and cheatingSo the Open has created a new evaluation and protection to solve it.

The fear of inspiring these persuasive tests is an AI model if it is very good to persuade its human users it would be dangerous. Theoretically, it can follow an advanced AI to follow its own agenda or anyone who controls it.

Even after most public internet scrapping and jumping through the hoop for other data licenses, Changmuews Benchmark shows how AI model developers are still fighting to find high quality datasets to test their models. However, it is easier to receive them.

There is an AI-centric newsletter on TechCrunch! Sign up here Every Wednesday gets it to your inbox.