MB OS: How Mercedes-Benz’s New OS with AI and Enhanced 3D Features

Mercedes-Benz has developed a new operating system, called MB.OS, that promises to revolutionize the driving experience. MB.OS, which is different from the MBUX infotainment system, debuted at CES 2024 with a range of innovative features, such as an AI virtual assistant, 3D navigation, and immersive entertainment.

Meet the MBUX Virtual Assistant

One of the highlights of MB.OS is the MBUX Virtual Assistant, which uses generative AI and a proprietary large language model to interact with the driver in a natural and personalized way. The MBUX Virtual Assistant can understand and respond to natural language commands, such as “I’m hungry” or “I’m cold”, and provide detailed suggestions based on the driver’s preferences, habits, and mood.

For example, if the driver asks for a restaurant recommendation, the MBUX Virtual Assistant will not only list some nearby options but also summarize the menu and reviews to help the driver make a choice. The MBUX Virtual Assistant will also anticipate the driver’s needs and offer helpful functions and routes, such as booking a parking spot in advance or adjusting the calendar if the driver is late.

The MBUX Virtual Assistant can also adapt to the driver’s emotional state and adjust its tone and style accordingly. If the driver is frustrated, the MBUX Virtual Assistant will be more concise and direct. If the driver is happy, the MBUX Virtual Assistant will be more friendly and conversational. The MBUX Virtual Assistant can even express emotions through its “face”, which is a star field on the center display that changes colors and icons to convey “like”, “celebrate”, “laugh”, and “confirm”.

Experience 3D Navigation in MB OS

Another feature of MB.OS is the 3D navigation, which uses a gaming engine to create realistic and detailed graphics and directions. The 3D navigation display integrates driver assistance information, such as surrounding vehicles and road signs, to enhance the driver’s safety and confidence. The 3D navigation display also provides specific lane guidance and augmented-reality instructions in real-time.

The 3D navigation also shows the environment, such as buildings, time of day, and weather conditions, to help the drivers orient themselves and make better decisions. Mercedes-Benz claims that the 3D navigation will reduce the driver’s confusion and stress, especially in complex urban areas.

Enjoy Immersive Entertainment

MB.OS

MB.OS also upgrades the MBUX infotainment system with built-in Audible and Amazon Music, allowing the driver to access a variety of books, radio dramas, and music. When playing content that is Dolby Atmos–capable, the audio system will synchronize the speakers, ambient lighting, and in-seat exciters to create a more immersive experience.

The MBUX infotainment system also partners with Sony Pictures Entertainment and Antstream to offer streaming video and arcade-style video games. The driver can enjoy popular titles like Gran Turismo and Spider-Man: Into The Spider-Verse, as well as retro arcade games, including a running game developed with Mercedes-Benz. These functions are only available when the car is parked or using Level 3 driver assistance.

Coming Soon to a Dealership Near You

The first car to feature MB.OS will be the production version of the Mercedes-Benz Concept CLA-Class, which is expected to launch later this year. The Concept CLA-Class is based on the MMA platform, which is optimized for an EV, but also supports ICE powertrains.

MB.OS will gradually roll out to other Mercedes-Benz models as they are updated and redesigned. Some of the MB.OS features will also be available via over-the-air updates as part of the MBUX infotainment package.

MB.OS is Mercedes-Benz’s latest innovation to enhance the driving experience with AI and 3D technologies. MB.OS aims to provide more natural, personalized, and immersive interactions between the driver and the car.