I've seen AI algorithms that can generate 360 images from text prompts and other AI algorithms that can create 3D depth maps from 2D images (to view in VR)
#1 Looking for a workflow that brings it together in a way that can turn text to 2D (180 or 360) > depth map > stereographic (side by side) 180/360 image.
#2 Also interested in turning a exisiting 2D 180 or 360 videos into 3D 180/360 videos.
#3 Finally curious if AI inpainting is able to extend out 16:9 landscape images into much wider but correct single point FOV 180 or 360 images?
Ideas?
AI for 3D images and videos (to view in VR)
-
- One Eyed Hopeful
- Posts: 6
- Joined: Sun Dec 18, 2022 6:31 pm
- nimatoed
- One Eyed Hopeful
- Posts: 18
- Joined: Mon Oct 28, 2013 9:09 pm
Re: AI for 3D images and videos (to view in VR)
You should look into Blockade Labs, they have a tool that'll do text-to-360 with depth.
My company also has an image to depth and image to 3D tool called LeiaPix Converter: http://convert.leiapix.com
We will be releasing an API in the coming weeks so any app can hit our media cloud and get back a depth map or send an image and receive back a 3D image.
We also already have 2D 360 to 3D 360 automatic conversion, but it's only available on the Lume Pad 2 tablet in the LeiaPlayer app for now.
My company also has an image to depth and image to 3D tool called LeiaPix Converter: http://convert.leiapix.com
We will be releasing an API in the coming weeks so any app can hit our media cloud and get back a depth map or send an image and receive back a 3D image.
We also already have 2D 360 to 3D 360 automatic conversion, but it's only available on the Lume Pad 2 tablet in the LeiaPlayer app for now.
-
- Cross Eyed!
- Posts: 121
- Joined: Wed Jun 08, 2022 3:30 pm
Re: AI for 3D images and videos (to view in VR)
I assume you are doing stable diffusion? In automatic1111 webui, there is an extension called depthmap, this can convert 2d images to 3d using different depthmaps. The depthmaps can be very good, and the 3d image conversion is also very good. It's very easy to do. Doing video is the same method, but each frame is converted.
This thread on avsforum uses depthmap to convert video into 3d: https://www.avsforum.com/threads/a-new- ... i.3228063/
So far these are the best methods I find to convert 2d to 3d images. Some programs like 3dcombine and https://stereo.jpn.org/eng/, can use depthmaps to convert 2d images to 3d.
There can be some post processing of the depthmap images to have less artifacts in the 3d images as well.
This thread on avsforum uses depthmap to convert video into 3d: https://www.avsforum.com/threads/a-new- ... i.3228063/
So far these are the best methods I find to convert 2d to 3d images. Some programs like 3dcombine and https://stereo.jpn.org/eng/, can use depthmaps to convert 2d images to 3d.
There can be some post processing of the depthmap images to have less artifacts in the 3d images as well.
-
- One Eyed Hopeful
- Posts: 8
- Joined: Thu Jul 25, 2024 1:02 pm
Re: AI for 3D images and videos (to view in VR)
The challenge in planet clicker is to turn a barren world into a thriving ecosystem. Clicking to gather resources is vital, as these resources are used to unlock upgrades and make the planet more sustainable.
-
- One Eyed Hopeful
- Posts: 3
- Joined: Thu Apr 18, 2024 6:26 am
Re: AI for 3D images and videos (to view in VR)
This is great. indianapolis paving Thanks for sharing this one.
-
- One Eyed Hopeful
- Posts: 4
- Joined: Fri Jun 07, 2024 3:39 am
Re: AI for 3D images and videos (to view in VR)
These are fascinating projects, and AI technology has advanced to a world of goo point where each of these workflows is achievable, though they require combining different AI tools and techniques.
-
- One Eyed Hopeful
- Posts: 8
- Joined: Thu Jul 25, 2024 1:02 pm
Re: AI for 3D images and videos (to view in VR)
AI's ability to transform complex tasks like 3D image and video creation for whopper clicker VR is truly impressive, streamlining workflows and opening new creative possibilities with remarkable precision and efficiency!