Roblox introduces real-time AI feedback to eliminate illegal language

Roblox is introducing a real-time, AI-powered chat rephrasing feature that automatically replaces banned words with polite language, the company said. he announced Thursday.

The new feature goes beyond Roblox’s current filters, which only replace words and phrases banned with the “#” symbol. But Roblox says that when users encounter strings of “####,” conversations can become garbled and difficult to follow.

Now, instead of just displaying the hashes, the filtered text will be converted into a polite language that is closer to the user’s original intent.

For example, a message that says “Hurry TF!” it would previously appear as “####,” but will now be changed to “Hurry!” Everyone in the chat has been notified that the message has been redacted to prevent the conversation from happening, Roblox says.

“Chat is at the heart of how people connect, collaborate, and play on Roblox,” said Rajiv Bhatia, vice president of User and Product Discovery at Roblox. Press release. “Real-time voice-over helps ensure accuracy in games and conversations and improves language accuracy. This approach reduces chat friction and preserves the values ​​that help keep our community fair.”

Roblox says that while the replay will reduce some of the interference in the chat, its security will still be effective due to the high level of difficulty.

This new feature is supported in all languages ​​available on Roblox’s automatic translation tools.

The company is also upgrading its filtering system to detect variations in banned languages. Roblox says initial results show the system is performing well in detection leetspeakand more sophisticated attempts to bypass the filter. This has allowed the company to reduce the spread of false positives by sharing or asking for personal information by up to 20x.

Thursday’s announcement comes soon after Roblox introduced face authentication to access chats on its platform following a wave of child protection lawsuits from the Attorney General Texas, Kentuckyand Louisianaamong others. Cases were filed in response to reports that Roblox was targeting young users to dangerous threats, such as grooming and visible objects.