Photogrametry or similar technique

[joiec...@gmail.com]

I know surely this is not related to MAYA in any way, but I just wanted to know your opinion on a challenge I have.

I'd need to create a 3D model from a truck in a garage, just for putting it in a web browser.

So the situation is like this:

• A truck enters the garage and stops at a defined point
• Som cameras may take a photograph from each camera's position
• A kind of photogrametry software reconstructs the truck in 3D, not only the surface but also its color
• Export compatible 3D object (this is the easiest part I guess)
• MOST important. Create following trucks without (or almost no) human intervention

Right now the garage has 6 cameras, but several others can be bought, so we would go to the lowest possible number allowed for 3D reconstruction.

The critial issue is the last one. So do you know of any software that can reuse the process of one truck to another one, KNOWING that the position of each camera is the same for all?

The plan could be to find the correct workflow for one truck and apply the settings to every other one in the future.

Do you have any crazy ideas?, Don't by shy to share your thoughts please :)

Thanks in advance.

[Anthony Enos]

If this is meant to be a seamless experience starting with the truck driving in and transitioning into the 3D model, it’s going to be challenging. For one, I’d be surprised if 6 cameras would give a decent photogrammetry result. Even 36 cameras might require a good amount of cleanup IMO, but someone with more photogrammetry experience may have a better answer.

Is there an option to either keep it pure shoot or pure CG? As a shoot, it would require a motorized camera rig or bullet time rig to capture an arc of the car. It wouldn’t be 3D, and maybe not full 360, but it would be visually consistent. Obviously, it adds cost to the shoot. For full CG, access to the CAD models would probably be necessary, but again you’d have consistency between the car driving in and the 3D model, as they would be the same.

There is cool AI tech that reconstructs a full 3D model from a single photograph, but it may not be not accurate enough for an automotive client. Nvidia has a plug-in for Omniverse called GANverse 3D. This demo actually is using a car base model and single photographs to re-model it as far as I can tell. I’m not sure of the export process if any: https://youtu.be/gz5E9wszZSI

Here is the link to the software: https://docs.omniverse.nvidia.com/prod_extensions/prod_extensions/ext_ganverse3d.html

If Nathan Shipley is here, he’s played with some similar underlying tech and may know of some other AI solutions for photo based model construction.

On Dec 16, 2021, at 2:20 AM, joiec...@gmail.com <joiec...@gmail.com> wrote:



--
You received this message because you are subscribed to the Google Groups "maya_he3d" group.
To unsubscribe from this group and stop receiving emails from it, send an email to maya_he3d+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/maya_he3d/7e080cda-31cc-45c4-a830-023ca4ff1083n%40googlegroups.com.

[Anthony Enos]

It turns out the Nvidia AI I mentioned is only trained on sedans. Bummer.

On Dec 16, 2021, at 6:11 AM, Anthony Enos <ANTHO...@gmail.com> wrote:



[joiec...@gmail.com]

Thank you.

This challenge is not CG related, there is only the need for a 3D model of the truck in the garage (and ONLY the truck, not the garage)

I see I should have mentioned I will be putting the resulting 3D model in a webGL page for viewing, like sketchfab does, so the client will access that page and see the truck and rotate it in order to see it from desired point of view (above the ground thankfully).

I studied your first advise and designed a kind of motorized camera rig that would go around the truck in order to do a 360-ish turntable, but is is so expensive if I want to do it right (just the structure itself would cost like 80k€)

So I'm going the photogrammetry route.

The main goal for the client is to be able to reuse the settings developed for a single truck for following ones, because it would be like 200 per year or so...