Sony Corporation announced development of an immersive spatial content creation system, which includes an XR head-mounted display equipped with high-quality 4K OLED Microdisplays and video see-through function, and a pair of controllers optimized for intuitive interaction with 3D objects and precise pointing. The system is aimed at supporting creators in sophisticated 3D content creation. Sony plans to collaborate with developers of a variety of 3D production software, including in the entertainment and industrial design fields.

At launch, Sony is exclusively partnering with Siemens, a leader in industrial technology, to introduce a new solution for immersive design and collaborative product engineering using software from the Siemens Xcelerator open digital business platform. The system will be available later in 2024. Sony and its partners will announce further details including specs, launch date and regions, pricing, sales channels, and software compatibility.

This spatial content creation system, equipped with an XR head- mounted display with 4K OLED Microdis displays and Sony's proprietary rendering technology, enables real-time, high-definition and realistic rendering of textures of 3D objects and facial expressions of human characters. In addition to video see-through functionality and spatial recognition with six cameras and sensors in total, the system features a ring controller that allows users to intuitively manipulate objects in virtual space, as well as a pointing controller that enables precise pointing, allowing creators to craft in virtual space with controllers and keyboards, all while wearing the head-mounted display. Creators will not only be able to see real-scale 3D models in an Extended Reality (XR) environment with the high-definition display, but also create and modify 3D models in it.

Through integration with third-party 3D creation applications, it also supports remote, real-time review between locations, making this an intuitive and immersive tool for the entire process of spatial content creation. The device features Snapdragon®? XR2+ Gen 2 Platform, the latest XR processor by Qualcomm Technologies Inc. The processor unlocks the power of the 4K OLED Microdisplays to deliver stunning image quality, as well as provides user and space tracking for seamless XR experiences, offering creators a high-performance platform for their creative workflow.

Sony has released technologies that support workflow and quality of spatial content creation and facilitate use of 3D CG in various creative fields. Mobile motion capture system "mocopi?," with small and lightweight sensors and a dedicated smartphone app, enables full-body motion tracking, using Sony's proprietary technologies. Spatial Reality Displays provide highly realistic, three-dimensional content without the use of special glasses or Virtual Reality (VR) headsets, for spatial content creation and review process.

By introducing this system and collaborating with 3D creation software developers, Sony aims to further empower spatial content creators to transcend boundaries between the physical and virtual realm for more immersive creative experiences.