50. Cristian Duguet - Nuvo - Building the next generation of 3D Foundation Models

## Summary

I am sure my dear listener, you have heard about genAI that is driven by gigantic foundations models like GPT4 or Stable Diffusion. Generating Texts, Images and even Videos. But what about the 3D Space? What about 3D models that are used as digital twins for the metaverse, for digital cities that are required for self-driving cars to navigate safely in an metropolitan area?

What does 3D genAI look like today?

Well to give us an insight into what is possible today and what they are building for tomorrow, I have Cristian Duguet on the show. Co-Founder of Nuvo. A company that is focused on building the 3D Foundation models of the future.

On the show Cristian will explain to use some of the limitations of current 3D reconstructions from 2D images or sensors. Like issues with shiny surfaces or transparent materials, but as well, how we are currently lacking a good 3D representation for future foundation models.

We will discuss how one at the moment has to choose between two conflicting representations. 3D point clouds and 3D meshes. Where point clouds are easy to create from real world object with sensors like the newest IPhone, but are required in high density and therefore compute in order to generate photo realistic renderings.

Where 3D meshes on the other hand, made up of polygons in 3D space, need far less points and provide a very easy way to modify and change 3D objects, but are difficult to generate out of sensor data.

Cristian explains what is needed to build future foundation models and how they will be able to combine the benefits of point clouds and 3D meshes, as well how Nuvo are working towards building those next generation 3D foundation models.

---

## TOC

00:00:00 Beginning

00:02:27 Guest Introduction

00:06:40 Nuvo 3D

00:17:56 What motivates the demand in 3D models

00:25:50 GenAI for 3D present and future

00:40:14 How Nuvo wants to build 3D foundation models

00:52:24 How will future foundation models look like

## Sponsors

- Quantics: Supply Chain Planning for the new normal - the never normal - https://quantics.io/

- Belichberg GmbH: We do digital transformations as your innovation partner - https://belichberg.com/

## References

Cristian Duguet - https://www.linkedin.com/in/cristianduguet/