AI for 3D images and videos (to view in VR)

This is for discussion and development of non-commercial open source VR/AR projects (e.g. Kickstarter applicable, etc). Contact MTBS admins at customerservice@mtbs3d.com if you are unsure if your efforts qualify.
Post Reply
CameraTraveler
One Eyed Hopeful
Posts: 6
Joined: Sun Dec 18, 2022 6:31 pm

AI for 3D images and videos (to view in VR)

Post by CameraTraveler »

I've seen AI algorithms that can generate 360 images from text prompts and other AI algorithms that can create 3D depth maps from 2D images (to view in VR)

#1 Looking for a workflow that brings it together in a way that can turn text to 2D (180 or 360) > depth map > stereographic (side by side) 180/360 image.

#2 Also interested in turning a exisiting 2D 180 or 360 videos into 3D 180/360 videos.

#3 Finally curious if AI inpainting is able to extend out 16:9 landscape images into much wider but correct single point FOV 180 or 360 images?

Ideas?
User avatar
nimatoed
One Eyed Hopeful
Posts: 18
Joined: Mon Oct 28, 2013 9:09 pm

Re: AI for 3D images and videos (to view in VR)

Post by nimatoed »

You should look into Blockade Labs, they have a tool that'll do text-to-360 with depth.

My company also has an image to depth and image to 3D tool called LeiaPix Converter: http://convert.leiapix.com

We will be releasing an API in the coming weeks so any app can hit our media cloud and get back a depth map or send an image and receive back a 3D image.

We also already have 2D 360 to 3D 360 automatic conversion, but it's only available on the Lume Pad 2 tablet in the LeiaPlayer app for now.
treeeddd
Cross Eyed!
Posts: 121
Joined: Wed Jun 08, 2022 3:30 pm

Re: AI for 3D images and videos (to view in VR)

Post by treeeddd »

I assume you are doing stable diffusion? In automatic1111 webui, there is an extension called depthmap, this can convert 2d images to 3d using different depthmaps. The depthmaps can be very good, and the 3d image conversion is also very good. It's very easy to do. Doing video is the same method, but each frame is converted.

This thread on avsforum uses depthmap to convert video into 3d: https://www.avsforum.com/threads/a-new- ... i.3228063/

So far these are the best methods I find to convert 2d to 3d images. Some programs like 3dcombine and https://stereo.jpn.org/eng/, can use depthmaps to convert 2d images to 3d.

There can be some post processing of the depthmap images to have less artifacts in the 3d images as well.
Lillian
One Eyed Hopeful
Posts: 8
Joined: Thu Jul 25, 2024 1:02 pm

Re: AI for 3D images and videos (to view in VR)

Post by Lillian »

The challenge in planet clicker is to turn a barren world into a thriving ecosystem. Clicking to gather resources is vital, as these resources are used to unlock upgrades and make the planet more sustainable.
Angel17
One Eyed Hopeful
Posts: 3
Joined: Thu Apr 18, 2024 6:26 am

Re: AI for 3D images and videos (to view in VR)

Post by Angel17 »

This is great. indianapolis paving Thanks for sharing this one.
KeziahSkinner
One Eyed Hopeful
Posts: 4
Joined: Fri Jun 07, 2024 3:39 am

Re: AI for 3D images and videos (to view in VR)

Post by KeziahSkinner »

These are fascinating projects, and AI technology has advanced to a world of goo point where each of these workflows is achievable, though they require combining different AI tools and techniques.
Lillian
One Eyed Hopeful
Posts: 8
Joined: Thu Jul 25, 2024 1:02 pm

Re: AI for 3D images and videos (to view in VR)

Post by Lillian »

AI's ability to transform complex tasks like 3D image and video creation for whopper clicker VR is truly impressive, streamlining workflows and opening new creative possibilities with remarkable precision and efficiency!
Post Reply

Return to “VR/AR Research & Development”