Roblox Augments Chat WIth Real-Time AI Translation Across 16 Languages

Stefano Corazza: AI will enable new Roblox users to create much faster

Users can describe environments, objects, lighting, terrain, and interactive behaviors to iterate visually. Roblox is also working on a tool to generate custom 3D avatars from images that can be imported and customized. Roblox also announced work on applying generative AI to its voice moderation to catch real-time violations of its rules. Instead, it summarizes audio sequences to understand context and intent versus just keywords.

As we continue to grow, we are investing in the tools and resources for developers and creators to build the next generation of experiences users can enjoy on the platform. Luxury fashion continues to gravitate toward Roblox, an online game that allows brand partners to build custom virtual worlds for shoppers to explore. Roblox players control avatars that can don different outfits and participate in a variety of in-game activities for rewards.

NFTevening is a renowned and award-nominated media platform dedicated to reporting on the cryptocurrency industry. Its journalists adhere to a rigorous set of editorial standards, guided by principles designed to uphold integrity, ensure editorial independence, and maintain unbiased reporting across all its publications. Eric has been a professional writer and editor for more than a dozen years, specializing in the stories of how science and technology intersect with business and society. To support these ongoing performance efforts, Roblox is sharing an early peek at a novel technology, Harmony, which optimizes all aspects of engine streaming on both client and server. Both the Avatar Auto Setup and Texture Generator have been released globally today, March 18, available in alpha and public beta respectively. They can be found within Roblox Studio, the platform’s advanced development environment.

Roblox creators can now make and sell limited-run avatar gear

“We’ll provide these capabilities in a resource-efficient way, so we can make them available to everyone on the platform.” The 3D environment generator is part of Roblox’s broader AI integration strategy. The company reportedly uses around 250 AI models across its platform, including one that monitors voice chat in real time to enforce content moderation, which is not always popular with players. Making it easier for creators to build games is part of its mission, and Roblox provides creators with a platform that enables end-to-end tools, services and support to help them build the most immersive 3D experiences, Sturman said. For certain, there is pressure for Roblox to respond to the wave of excitement around generative AI and show that it isn’t going to be passed by in this technology wave.

Roblox is developing an AI “3D foundational model” that will be open source and create 3D assets through text, video and 3D prompts. Baszucki describes this as an “incubation project” with around 40 dedicated employees, and says they’re only three months down the road on it. He then shows an overhead view of a map being created through simple text prompts, then becoming a desert, then prompted into becoming a forest scene (with both a text and image prompt).

Violation notifications aim to curb harmful behavior through immediate feedback. The English model is coming soon, with additional languages to be added later. It also launched AI-enabled toxicity monitoring for voice chat and real-time translation of text chat. The outpouring of engagement from users resulted in 19.7 billion translated messages so far— about one third of the messages sent on Roblox — including valuable user feedback from international markets for creators. The upcoming AI tool could potentially streamline content creation on the platform, possibly accelerating Roblox’s path toward its revenue goal. “We see a powerful future where Roblox experiences will have extensive generative AI capabilities to power real-time creation integrated with gameplay,” Roblox said in a statement.

In an interview with The Verge, Roblox CTO Daniel Sturman described how the tool might be able to create basic gameplay behaviors like teleporting you to a place if you touch a door. The Roblox Assistant can also help with coding and answer questions about developing on Roblox, which could be useful tools for creators on the platform. Implementing these AI tools has led to a noteworthy shift in development, changing the game for many. A total 36 percent of beta users have already leveraged the main AI tool – the Material Generator – with more than 70 thousand images created through it per day. In fact, 50 percent more users are creating variations of materials daily than were doing so prior to the tool’s launch.

Today’s Tech News Roundup:

This new creation would both look like a red sports car but also have all the behavior coded into it to be driven through a 3D virtual world, he said. For example, some creators know how to code, but may have limited experience creating high-fidelity 3D models. Others may be more experienced with model design, but less experienced with code.

He noted that generative AI is currently focused on pictures and videos, not 3D creation. But, in Roblox, you need 3D objects, so if you see a tree, it needs to behave like a tree and also be visible from all sides. “A creator could say I want to create a world that is in the Scottish Highlands with castles and a stormy day, with a dragon background, and I want all of this in a steampunk steam style. At the Roblox Developer Conference a few months back, we announced our work to build a 3D Foundational Model, an open source 3D AI generative model.

• Back in February, Roblox revealed its vision for generative AI in Roblox Studio, hoping the tech would empower everyone to become creators.
• AI-powered NPCs that don’t need a script could make games—and other worlds—deeply immersive.
• Researchers have devised a way to make computer vision systems more efficient by building networks out of computer chips’ logic gates.

Baszucki anticipates a diverse array of experiences stemming from the integration of AI tools. Both seasoned developers and newcomers will have the tools to craft immersive 3D environments. The CEO also envisions the potential for “dynamically personalized” gaming experiences, tailored to each player’s preferences. Visual Studio and other AI-enabled programming environments typically write code in response to a developer’s comment or when the user starts typing. The startup Replit, which makes a popular online programming tool, recently launched a chatbot-like interface that will not only write code but answer programming questions. Roblox, which has been trying to appeal to older audiences in the past few years, has been working with generative AI models to enhance user experience.

For predictions about AI in entertainment, we see the very near-term potential that we’ve already started to hint at with our new Roblox releases. Enabling free human-to-human connection that transcends cultural boundaries. The recent launch of automated text chat translation, which covers translation across 16 languages pairwise translation problems, was solved by one AI system and is completely transparent to users. At first glance, this foundational model seems like it could be a great thing for those who want to create game worlds quickly without having to dabble too much with code while focusing more on the creative side of things.

Roblox announces AI tool for generating 3D game worlds from text – Ars Technica

Roblox announces AI tool for generating 3D game worlds from text.

Posted: Mon, 09 Sep 2024 07:00:00 GMT [source]

“To bring a creator’s idea to life, we need a faster, easier way to communicate and refine, essentially collaborating with an AI assistant that’s more of a partner and less of a scavenger hunt,” added McGuire. Roblox is looking to take its artificial intelligence capabilities to the next level with “4D generative AI”. To make its platform a destination for people to discover new music, Roblox will roll out a new “What’s Playing” and “Music Charts” feature where people will be able to find trending songs from breakout artists. Roblox is also planning an integration with music distribution service DistroKid to give artists a way to upload and share their music on the platform. While Roblox already has social features that allow users to interact with each other, the company is introducing new ways for users to do so.

We are comfortable trying new ideas, sometimes even making mistakes, and iterating tirelessly until we get it perfect. Take code assist as an example – we’ve seen 300 million tokens, which are similar to words of source code, generated for developers. We then track how many of those developers accepted, rejected, and accepted and modified.

“There’s actually going to be a really fascinating interplay between our creator community today, generating more and more assets, more and more ideas that can help you compose these things more quickly,” added Lim. “We think of generative AI as a tool. Just like you might have a paintbrush, you have a generative AI,” Tornow said. “We think you’ll be able to make a lot of amazing things with it. And you’ll love it. But you still have to be a responsible creator.” “I think what we have seen is a transformation where a lot of the strictly technical skills will be picked up by AI, and then it will leave creators more high-level controls,” Corazza says. “We will enable a lot more people to just manifest their ideas in the metaverse.” Another tool uses AI to moderate voice conversations in real time, which could cut down on toxicity on the platform.

Roblox has already made its way onto Quest VR headsets, launching in beta this year and now moving to a final version on Meta’s app store this month. Roblox just said at its developer conference that the app is arriving on the PlayStation in October, a move that further pushes the platform’s multiverse of little gaming worlds beyond phones, tablets and PCs. The amount of inserted code for beta users has risen by 35 percent while deleted code suggestions have fallen by 14 percent, suggesting a notable streamlining of the coding process. Roblox has enhanced its in-game chat feature with real-time translations across 16 different languages by leveraging AI. Users are now able to seamlessly communicate with others who speak a different language through automatic translations that appear in almost as soon as they are submitted. I think it will enable new users to get started much faster and, at the same time, it will significantly increase the productivity of existing creators.

But they may not know that the major credit card companies aren’t the only payment processors. Canadian payment gateway provider Slim CD is notifying customers of a data breach that was discovered in June 2024. The company believes attackers had access to the systems as far back as August 2023. The attackers had access to credit card numbers and expiration dates, but not the card verification number. We give you the inside scoop on what companies are doing with generative AI, from regulatory shifts to practical deployments, so you can share insights for maximum ROI. The company is also introducing forums later this year to give users a dedicated space to share feedback, discuss gameplay and report any issues they encounter.

Roblox announced a generative AI model for creators at its annual developers conference – Axios

Roblox announced a generative AI model for creators at its annual developers conference.

Posted: Mon, 09 Sep 2024 07:00:00 GMT [source]

Yes, that is what Roblox calls their upcoming open-source generative AI platform. As demonstrated by the video above, you can see that the 3D foundation model created a racetrack with different environments, such as a desert and a forest. Imagine a virtual D&D game where the world is coalescing into existence as the dungeon master describes it. Roblox today revealed more details about its work on AI tools, in particular its moves towards creating 4D generative AI. According to the company’s announcement, the fourth dimension of generative AI is interaction, meaning it’s working on AI creations that can interact dynamically with the world in which they exist.

He was the founder and CEO of Mixamo, a character animation company acquired by Adobe. With a strong academic background, including a PhD from the University of Padova and postdoctoral work at Stanford in computer vision and biomechanics, Corazza has been influential in democratising 3D content creation and immersive experiences. He’s also an angel investor and startup advisor, and creates music and large-scale artwork.

Their version of Minecraft is generated in real time, in a technique known as next-frame prediction. They did this by training their model, Oasis, on millions of hours of Minecraft gameplay and recordings of the corresponding actions a user would take in the game. The AI is able to sort out the physics, environments, and controls of the game from this data alone.

Roblox is finally coming to PlayStation

Roblox chief product officer Manuel Bronstein told TechCrunch in an interview that the company believes this change will encourage more traditional game developers to bring their games to the platform. And that’s where I’m focused – on building technology that will enable the creation of anything, anywhere, by anyone, and AI is a great way to support that. We are also exploring exciting new upgrades, like voice chat translation so that a user in France and a user in Indonesia, for example, would be able to have a fluent conversation, live, on Roblox. AI translations can turn Roblox into a real communication hub for people all over the world. We’ve recently gone one-step further to launch a real-time translation API that works in-game to translate all user-generated text, not just chats. For example, if a sign in a scene made by Korean speaker reads “식료품점”, for an English speaker it would automatically read “Grocery Store”.

While some users have lauded Roblox for trying to make accessible game design more powerful through AI, others think that an over-reliance on machines could kill creativity and undermine human developers who have spent years learning the craft. The company is also investing heavily into generative AI tools to help creators make experiences more easily, including a new Roblox Assistant AI chatbot. According to a recent poll by a16z, 87% of studios are using generative AI tools like Midjourney to create in-game environments. Others are using it for game testing or looking for bugs, while Ubisoft is experimenting with using AI to create different basic dialogue options. Texture Generator, meanwhile, lets users input text prompts to change 3D objects’ textures with detail, such as a wooden texture prompt on a chest considering sharp corners and “features like the wooden planks and the lock”.

Also, all of our safety pipelines, image, audio, voice, text, and 3D are running on our own platform, doing inference on our own platform at significant efficiencies of cost and driving quality there. The comments suggest Roblox does not plan to pay OpenAI or any of its many foundation model competitors for training or inference. The economics will be far stronger if Roblox can efficiently use its own infrastructure. He said that Roblox with share more at his talk on the Tech Stack for the Metaverse at Roblox’s upcoming DeveloperWeek.

We think experiences, for example, a fashion design experience is going to migrate all the way from using a virtual sewing machine and scissors to purely based text prompts. And ultimately, we’ll enter an age on Roblox where anyone can make their avatar or clothing 100% through text prompts. So if I or you wanted to build a piece of clothing, we could describe it. To clarify, generative AI is a form of artificial intelligence that learns from extensive datasets. Therefore, Roblox users will be able to craft intricate worlds and games by merely typing their ideas. Furthermore, it democratizes the development space, making it accessible to a broader range of individuals.

This year, brands such as e.l.f. Cosmetics, Fandango, Walmart, and Warner Bros. started testing commerce on Roblox. People aged 13 or older discovered clothing and beauty products within experiences — and with a few simple clicks, these physical items showed up on their doorsteps. Some people even bought movie tickets for the Beetlejuice sequel that comes out today, via a virtual Fandango box office in the [Beetlejuice] Escape the Afterlife experience from Warner Bros. For sessions with lower frames per second (FPS) on two to three gigabyte Android devices, Roblox improved average frames per second (FPS) by 24%.