The world of 3D modeling and AI just got a major boost! Fei-Fei Li's World Labs has secured a massive $200 million investment from Autodesk, a leading software design company. This partnership is a game-changer, as it brings together two innovative forces to explore the potential of immersive 3D environments and their applications. But here's where it gets exciting: World Labs' AI systems, known as world models, can generate and understand these 3D spaces, and Autodesk's tools are a perfect fit to enhance and utilize these models.
The deal is part of World Labs' larger funding round, and the startup is already making waves. With its first commercial product, Marble, released last year, users can now create and edit 3D environments, pushing the boundaries of what's possible. Autodesk's investment is a clear sign of the commercial potential and impact of World Labs' technology.
Autodesk, a giant in 3D CAD software, has its fingers in various industries, from architecture to entertainment. Their focus on the built world makes this partnership a natural progression, as advanced spatial AI can enhance and revolutionize these fields. As Li puts it, "Autodesk has always helped people think spatially and solve real-world problems. Together, we aim to build physical AI that empowers creativity and provides designers and creators with powerful tools."
As part of the deal, Autodesk will advise World Labs and collaborate at a research and model level. This collaboration is still in its early stages, but the potential is immense. Daron Green, Autodesk's chief scientist, envisions a future where their technologies complement each other seamlessly. For instance, a user could start with a World Labs model of an office layout and then use Autodesk's tools to refine specific design elements, like the desk's design.
The partnership will initially focus on media and entertainment, an area where most world model developers, like Google DeepMind and Runway, are also making their mark. Autodesk already works closely with major media production companies and has been training models for character animation. Green sees a natural synergy between these world models and Autodesk's existing work, as they both involve understanding and creating physical environments for characters to interact within.
This collaboration supports Autodesk's broader goal of integrating AI features across its software. Their neural CAD models, trained on geometric data, can generate working 3D models with an understanding of real-world functionality. World Labs' models can further enhance this capability, providing a more comprehensive digital representation of the physical world.
Green believes that the future of design and AI lies in combining various systems, including large language models and world models. As Li states, "AI must understand worlds, not just words. Worlds are governed by rules and dynamics, and bridging the semantic and physical aspects is the next big challenge for AI."
This partnership is a step towards that future, and we can't wait to see the innovative designs and immersive experiences that will emerge from this collaboration. So, what do you think? Will this partnership revolutionize the way we design and interact with digital worlds? Share your thoughts in the comments below!