In 2024, the landscape of generative AI tools for creating 3D assets is growing quickly with rapid advancements that are allowing a much lower entry point for researchers and content creators needing 3D assets for their Vizard and SightLab VR Pro projects. Here’s a brief overview of some of the key tools, with links to tutorials for some.
Skybox Blockade Labs Interior
Built off of Luma’s generative 3D foundation model, Genie allows you to quickly transform written ideas into three-dimensional models, as well as manipulate backgrounds, animations, and sequences. Produces high quality 3D models and textures.
Download as .glb, open in Inspector and toggle lighting off of mesh to use in Vizard and SightLab VR Pro.
3d.csm.ai
3D CSM (Common Sense Machines) generates 3D models from either images or videos. You can use their Discord server to directly connect with your Midjourney account (a popular AI image creation tool) or directly upload images. For best results it is suggested that you have images that have a solid color background (can prompt for this if using an image generator like Midjourney, Leonardo.ai, Dall-E 3 or others).
ZoeDepth
ZoeDepth is a deep learning model for metric depth estimation from a single image.
Skybox Blockade Labs
Skybox AI uses AI to generate full 360 degree panoramic images, and with the newest release now includes the ability to turn these 360 images into full 3D meshes.
Meshy AI
Turn text and images into captivating 3D assets in under a minute.Featuring text to 3D, image to 3D, AI texturing and text to Voxel.
The textures with Meshy seem to respond better to lighting, so there is no need to toggle off lighting on the mesh for it to look correct with Vizard and SightLab VR Pro.
Create high quality 3D models from a text prompt, including avatars with rigged skeletons, objects, animals, humans and more.
Additional Options
Avatars
