3D Modelling software pipeline based on AI and using digital photo archives
The AI 3D Builder is designed to transform two-dimensional images into complete, usable 3D models. Its goal is to drastically reduce the time required to create 3D assets by automating a process that traditionally demands expertise in modelling, texturing, and rendering. At the heart of this pipeline lies Trellis, a system based on an AI architecture that employs Structured Latents (SLAT) representation, enabling the system to capture visual characteristics and implicit spatial relationships to reconstruct 3D geometry coherently and realistically.
The tool is realized by Swing:It. It is completely open and free of charge, and is demonstrated in the project through the Girona Walls scenario.
In a nutshell
What is the AI 3D Builder?
AI 3D Builder is a 3D modelling pipeline that helps users create 3D models from 2D images, such as archival photographs or documentation images.The tool lowers the entry barrier for creating 3D content from existing collections.
Who is the AI 3D Builder for?
- Cultural Heritage Professionals
- Researchers
- Institutions without in-house 3D infrastructure or expertise
Key features
- Upload sets of 2D images
- AI-assisted 3D reconstruction
- Configurable quality and processing options
- Export to open, industry-standard binary file format for 3D models (GLB)
- Optional refinement by advanced users
What do you need?
- Image sets (minimum quality requirements)
- Web access
- No prior 3D modelling experience required
- A 2D image editor such as Photoshop, Photopea (web based) etc.
- A 3D model editor such as Blender, Maya, etc. installed
Output
- A reusable 3D model in industry standard GLB/GLTF format.
Example of user story
A city archive has a collection of digitised images showing views of a lost building. They would like to prepare a 3D representation of the building based on the visual evidence for research and valorisation of the collection and archive.
- Archivists select and prepare photographs (based on AI 3D Builder guidelines).
- Images are uploaded to the AI 3D Builder image-to-3D generation model.
- The images are processed, and the results are exported.GLB format.
- The 3D model can be adjusted as needed in any 3D modelling application accepting .GLB format files.
- The final 3D model is exported and available for use as needed.
Manual and Documentation
- Download the AI 3D Builder factsheet (PDF)
- Download the User Manual (PDF)
- Sign up and Access the tool at this link
- For developers: source code on GitHub