Stability AI and Tripo AI join forces to release TripoSR, a game-changing technology that generates high-quality 3D models from single images in under a second.
In a groundbreaking development, Stability AI and Tripo AI have partnered to introduce TripoSR, a cutting-edge 3D object reconstruction model capable of generating high-quality 3D models from a single image in less than a second. This innovative technology is set to revolutionize various industries, including entertainment, gaming, industrial design, and architecture, by providing a fast and accessible solution for visualizing detailed 3D objects.
Key Takeaways:
- TripoSR, developed in partnership with Tripo AI, generates high-quality 3D models from a single image in under a second.
- The model runs on low inference budgets, making it accessible and practical for a wide range of users and applications, even without a GPU.
- The model weights and source code are available for download under the MIT license, allowing for commercialized, personal, and research use.
Performance and Accessibility
TripoSR outperforms other open image-to-3D models, such as OpenLRM, by generating draft-quality 3D outputs (textured meshes) in around 0.5 seconds when tested on an Nvidia A100. Not only is TripoSR faster, but it is also more accessible, as it can run efficiently even without a GPU. This accessibility makes it an ideal solution for a wide range of users and applications.
Technical Improvements and Data Preparation
The development of TripoSR involved several technical improvements over the base LRM model, including channel number optimization, mask supervision, and a more efficient crop rendering strategy. The training data preparation incorporated diverse data rendering techniques to better represent real-world images, significantly improving the model’s ability to generalize. A CC-BY, higher-quality subset of the Objaverse dataset, was carefully curated for the training data. For more details on the technical aspects, refer to the technical report.
An Invitation to Explore and Contribute
Stability AI and Tripo AI invite developers, designers, and creators to explore TripoSR’s capabilities, contribute to its evolution, and discover its potential to transform their work and industries. The code for the TripoSR model is now available on Tripo AI’s GitHub, and the model weights are available on Hugging Face.
You can read the technical report for more details.Â
Source: Stability AI
Grow your business with AI. Be an AI expert at your company in 5 mins per week with this Free AI Newsletter