Get 40% Off
🤯 This Tech Portfolio is up 29% YTD! Join Now to Get April’s Top PicksGet The Picks – Just 99 USD

Kids gaming platform Roblox faces hurdles ahead of public listing: rough words

Published 19/11/2020, 11:17
Updated 19/11/2020, 11:20
© Reuters. FILE PHOTO: The spread of the coronavirus disease (COVID-19) in Manchester

© Reuters. FILE PHOTO: The spread of the coronavirus disease (COVID-19) in Manchester

By Munsif Vengattil and Joseph Menn

BANGALORE/SAN FRANCISCO (Reuters) - Profanities and other offensive content that basic word-filtering tools are designed to catch can be found in some game titles and user profiles on children's gaming platform Roblox, searches of the website show, despite the company’s "no tolerance" policy and assurances it has safeguards to enforce it.

Powered by user-created games, Roblox is on course for a multibillion-dollar stock market debut before year end, riding the lockdown entertainment boom with its appeal as a place for safe fun and interactions for the youngest gamers.

But parenting groups and investors alike said they were concerned about whether the company's automated systems to moderate content can effectively delete potentially offensive language and images that pop up on the platform.

Simple Google (NASDAQ:GOOGL) keyword searches of its site - conducted twice by Reuters since the company announced its stock market plans in October - turned up more than 100 examples of abusive language or imagery. One profile, for example, included "shut up and rape me daddy" in the profile description line, while another had "MOLESTINGKIDSISFUNTOME."

In response to written questions, company spokeswoman Teresa Brewer said in a statement that Roblox “has no tolerance for inappropriate content, which is why we have a stringent safety system, including proprietary text filtering technology, third-party machine learning solutions, and customized rules on what to block, which we update daily."

Last month, Roblox removed the examples within hours of Reuters sharing them with the company. Roblox has said it has 1,600 people working full time to eliminate inappropriate content on the platform.

Roblox offers account controls for parents to restrict how their kids can interact with others on the site. It also lets parents limit the child to a curated list of games vetted for kids under the age of 13. Reuters did not find any inappropriate content on such games.

All sites that rely on users to create material must grapple with how much effort to expend policing that content, and even if that is enormous, there could still be inappropriate posts. Unlike Twitter (N:TWTR) and Facebook Inc (O:FB), which publish quarterly transparency reports about the types and volumes of purged content, Roblox does not provide such data. That makes it difficult to tell how common it is.

Roblox is a free platform which offers millions of games, many of them created by its own young users through a simple programming tool that the company provides. It has been credited with developing kids’ logic and creativity. Like Microsoft Corp 's (O:MSFT) Minecraft, Roblox allows users to create and share 3D gaming content via simple tools and send messages to others.

The simplicity of many Roblox games stands in contrast to popular videogame hits like Fortnite or Apex Legends, which depict killing competitions and target teens. Roblox advisor Larry Magid said that three-fourths of U.S. children between nine and 12 used the platform.

Reuters picked about 20 words commonly considered offensive and looked for them using the site's own search tool, and also through Google's system for searching within a specific site. Roblox's tool revealed no hits, because filters were preventing users from actively looking for problematic content while playing Roblox games. However, the Google search showed that kids could see the problematic profiles and descriptions in a variety of ways, including through friend invitations and group activities.

Most of the examples Reuters found on Roblox included deliberate misspelling of obscenities, or the n-word, which industry veterans say should not make it past standard filtering software.

NBC reported last year that it found neo-Nazi and racist profiles on the site, which Roblox later removed.

Yet early this year, an industry expert who asked not to be named, sent Roblox head of safety Remy Malan a dozen examples of games with racial slurs or the word "Jew" in the title, including some with concentration camp uniforms or other imagery, according to screen shots of the email seen by Reuters.

The examples were confirmed by Reuters and dated as far back as 2009. Some of them were deleted after Reuters described them to Roblox in October. Malan did not respond to the expert or to a Reuters request for comment.

Tech and entertainment watchdog Common Sense Media has lifted its suggested age for Roblox players to 13 years old over the last few years, after abusive language in profiles and sexual content in games kept appearing on Roblox after the company said it would remove it, according to Jeff Haynes, who oversees video gaming coverage for the nonprofit.

Five online safety experts who reviewed the examples found by Reuters said they were surprised such profiles and wording managed to slip through when rudimentary filtering systems can catch and remove such content.

Magid, a Roblox advisor and CEO of the nonprofit ConnectSafely.org - which takes funding from Roblox and other companies to promote safety guidelines for parents - said the examples Reuters had found showed the safeguards did not fully work.

"I think scale is part of it. What I don't understand is why the software didn't pick it up," he told Reuters.

As its stock listing draws near, the company could come under closer public scrutiny from Wall Street, said John Streur, chief executive of Calvert Research and Management, which focuses on socially responsible investing.

© Reuters. FILE PHOTO: The spread of the coronavirus disease (COVID-19) in Manchester

"From an investor perspective, it will be a major problem if the headlines months from now reveal that the company is unable to manage the risk of its platform," Streur told Reuters. Roblox declined to respond to comment on that view.

Latest comments

Risk Disclosure: Trading in financial instruments and/or cryptocurrencies involves high risks including the risk of losing some, or all, of your investment amount, and may not be suitable for all investors. Prices of cryptocurrencies are extremely volatile and may be affected by external factors such as financial, regulatory or political events. Trading on margin increases the financial risks.
Before deciding to trade in financial instrument or cryptocurrencies you should be fully informed of the risks and costs associated with trading the financial markets, carefully consider your investment objectives, level of experience, and risk appetite, and seek professional advice where needed.
Fusion Media would like to remind you that the data contained in this website is not necessarily real-time nor accurate. The data and prices on the website are not necessarily provided by any market or exchange, but may be provided by market makers, and so prices may not be accurate and may differ from the actual price at any given market, meaning prices are indicative and not appropriate for trading purposes. Fusion Media and any provider of the data contained in this website will not accept liability for any loss or damage as a result of your trading, or your reliance on the information contained within this website.
It is prohibited to use, store, reproduce, display, modify, transmit or distribute the data contained in this website without the explicit prior written permission of Fusion Media and/or the data provider. All intellectual property rights are reserved by the providers and/or the exchange providing the data contained in this website.
Fusion Media may be compensated by the advertisers that appear on the website, based on your interaction with the advertisements or advertisers.
© 2007-2024 - Fusion Media Limited. All Rights Reserved.