I am building an AR display using the Rift and attaching two webcams to the front. I have two 120 degree webcams and am texturing two planes in my Unity scene with live the video feed using WebCamTexture. The plane has the same 1:1.78 aspect ratio as the webcam feed.
However, simply projecting the webcam video onto this flat plane of course suffers from normal barrel distortion of cheap cameras. This distortion is particularly pronounced as the cameras have a wide (120 degree) field-of-view lens.
I assume a shader would be the best way to correct for this distortion. The other possibility would perhaps be projecting the webcam video onto a mesh geometry that is the inverse of the webcam lens distortion. However, the shader approach seems to be the more general solution.
Does anyone have any ideas to get started on this? I have calibrated my camera with OpenCV and so I have the camera's distortion coefficients.
Shader to undistort webcam video for AR Rift
This is for discussion and development of non-commercial open source VR/AR projects (e.g. Kickstarter applicable, etc). Contact MTBS admins at customerservice@mtbs3d.com if you are unsure if your efforts qualify.
Return to “VR/AR Research & Development”
Jump to
- Important Reading
- ↳ Get full access to MTBS and its community by registering with the links below:
- ↳ MTBS-Gallery
- MTBS' Official Article Threads & Forum Announcements
- ↳ MTBS Forum Announcements & FAQ
- ↳ MTBS News
- ↳ Neil's Messy Basement
- ↳ MTBS Articles
- ↳ MTBS Editorial User Remarks
- ↳ MTBS Game Review User Remarks
- ↳ MTBS Interview User Remarks
- ↳ MTBS-TV
- ↳ MTBS Member Blogs
- ↳ MTBS Newswire
- ↳ Contest Entry
- General Forums
- ↳ General Discussion
- ↳ MTBS Website Ideas
- ↳ User Contributed Immersive Technology News & Announcements
- ↳ Italian
- ↳ German
- ↳ French
- ↳ Russian
- ↳ Spanish
- ↳ Do it Yourself!
- MTBS Supported Projects
- ↳ Official Vireio Perception
- ↳ Vireio Perception 4.X
- ↳ Vireio 4.X Game Support
- ↳ Vireio Perception 3.X and BELOW
- ↳ Development / General Discussion
- ↳ Game Support
- ↳ Config & Shader Profiles
- ↳ VRBoost Profiles
- ↳ FreePIE
- ↳ Minecrift
- General Virtual Reality Discussion
- ↳ General VR/AR Discussion
- ↳ Game Settings
- ↳ General Discussion
- ↳ VR/AR Research & Development
- ↳ Physical VR Tools
- ↳ 360-Degree VR Filmmaking / Discussion
- Immersive Technology Products
- ↳ HTC Vive
- ↳ Oculus VR
- ↳ Sony PSVR
- Stereoscopic 3D Entertainment, Hardware & Software
- ↳ General Stereoscopic 3D Discussion
- ↳ I'm New To Stereoscopic 3D!
- ↳ 3D Displays
- ↳ 3D HDTVs
- ↳ 3D Monitors
- ↳ 3D Glasses
- ↳ 3D Projectors
- ↳ DDD
- ↳ Best Game Settings (DDD)
- ↳ DDD Tridef Ignition Driver Forums
- ↳ NVIDIA
- ↳ S-3D Game Settings (NVIDIA GeForce 3D Vision)
- ↳ NVIDIA GeForce 3D Vision Driver Forums
- ↳ Nvidia 3D Vision Fixes, Solutions and Troubleshooting
- ↳ Old School S-3D Solution Support
- ↳ Nvidia Legacy Drivers
- ↳ iZ3D Legacy Drivers
- ↳ 3D Console Gaming
- ↳ 3D Movies (Blu-Ray and Theater)
- ↳ GameGrade3D Discussion
- ↳ Stereoscopic 3D Hardware Technical Support
- ↳ Favorite Online S-3D Videos
- Technical Support
- ↳ General Hardware & Software Technical Support
- ↳ General AMD/ATI Discussion
- ↳ General NVIDIA discussion