Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

external cameras? #8

Open
gagagu opened this issue Apr 13, 2023 · 5 comments
Open

external cameras? #8

gagagu opened this issue Apr 13, 2023 · 5 comments

Comments

@gagagu
Copy link

gagagu commented Apr 13, 2023

Hi,
i'm using a Pimax 8kx which has no cameras. Is it possible to use two external cameras (small webcams, each for every eye) with your software? I want to see my enviroment in game but blended like a greenscreen.
Why?
I want to use it with the microsoft flight simulator to see my self made cockpit parts in game. I want to make everything green that i dont want to see in game.
Is it possible with your software? Thx

@Rectus
Copy link
Owner

Rectus commented Apr 13, 2023

Unfortunately webcams are not supported. Cameras currently need a SteamVR driver to work, and currently the only ones available are built in to HMD drivers.

I've been thinking about trying to write a SteamVR driver for generic webcams, but I don't have any experience with the driver-side interface, so I'm not sure how hard it would be. The biggest issues seem to be if or how to get an exact timestamp for each frame, and how to align the camera with the HMD tracking space.

@gagagu
Copy link
Author

gagagu commented Apr 13, 2023

Hi, thx for reply. Do you really need to align the cameras in space? The cameras are fixed added to the headset. You can add a menu to align the images (right, left, top, bottom). Why a SteamVr driver is needed? Isn't it possible to grap the webcam frame from windows?
Sadly i only have limited programming knowledge, mostly c#, java, and html for database programming.

@Rectus
Copy link
Owner

Rectus commented Apr 13, 2023

It would be possible to just use the Windows camera API, although it would still be almost as much work. I would rather use the SteamVR system though, since it provides readily available predicted poses for the cameras. It's not necessary for having the cameras attached to the HMD, but I'd rather be able to have static cameras, and moveable cameras attached to trackers as well.

The frame timestamp is the most difficult part, since it has to be very accurate to reproject the image correctly. I don't think there is any good way of getting them though, since most consumer cameras don't seem to be generating them.

@Rectus
Copy link
Owner

Rectus commented Oct 2, 2024

I released an update with some basic webcam support. It only supports a single monocular camera at the moment though.

@Rectus
Copy link
Owner

Rectus commented Nov 12, 2024

Updated with stereo camera support.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants