The chief technology officer of Meta, the newly named parent company of Facebook, said virtual reality harassment was an “existential threat” to them.
An internal memo from March, seen by the Financial Times by Andrew Bosworth said he wanted Meta to have “almost Disney security levels” but that virtual reality can often be a “toxic environment”, especially for women and minorities.
If not suppressed, it could “completely push mainstream customers out of the medium,” but also said that it is virtually impossible to moderate user language and behavior to a meaningful extent.
Bozworth reportedly advised in the memo that Facebook should apply its current community rules, but said “a stronger tendency to enforce along some sort of warnings, successively prolonged exposures and ultimately expulsion from multi-user areas”.
Users may need to have a single account with Meta as they could be banned from using multiple avatars across platforms.
“The theory here has to be that we can change the culture so that we don’t have to take these enforcement actions too often in the long run,” he added.
Facebook is developing a social reality game called Horizon Worlds that constantly records what is happening in the Metaverse – which is stored on Facebook’s Oculus headset – which sends data to Facebook when users choose to moderate the platform.
The company relies on artificial intelligence to moderate its platform, but said that Financial Times that it “explores how best to use AI” in Horizon Worlds and that it was “not built yet”.
Facebook’s AI has received multiple criticisms for failing to combat hate speech on the platform.
A meta spokesperson said The independent one that it was discussed how this security and privacy can be guaranteed.
“Meta will not build, own, or execute the Metaverse on its own. We’re starting discussions early on our vision for the Metaverse, before any of the technologies even exist, ”they said.
“This will not be the job of a single company alone. It will take collaboration across the industry and with experts, governments and regulators to get it right. “