Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about auxiliary plane path rendering #1

Open
Woo-Seok-Kim opened this issue May 31, 2023 · 2 comments
Open

Question about auxiliary plane path rendering #1

Woo-Seok-Kim opened this issue May 31, 2023 · 2 comments

Comments

@Woo-Seok-Kim
Copy link

Thanks for great work! I'm also interested in reconstructing 3D scene with glass reflection.
I'd like to ask some questions about NeuS-HSV's auxiliary plane module(Sorry if I misunderstood your explanation).

In Section 3.3, weights of auxiliary plane is calculated by using volume density σ, which is output of auxiliary plane module network. But as described in Figure 5(a), auxiliary plane module network has view direction v as input and {volume density σ, distance between camera center and plane, plane normal} as output, so volume density σ is not calculated for each sampled points along plane path. But in equation(6), it seems that plane path's weight is calculated using same equation as NeRF, by using each point's density. How do you get density of each sampled points from auxiliary plane module network?

@JiaxiongQ
Copy link
Owner

Thanks for your interest!
Before being fed into the auxiliary plane module network, the view direction is expanded to have the same shape as sampled points. Then we can use the same equation as NeRF to calculate the rendering weights.

@Woo-Seok-Kim Woo-Seok-Kim closed this as not planned Won't fix, can't repro, duplicate, stale May 31, 2023
@Woo-Seok-Kim Woo-Seok-Kim reopened this May 31, 2023
@Woo-Seok-Kim
Copy link
Author

Woo-Seok-Kim commented May 31, 2023

Thanks for your kind reply.
After expanding view direction, is it concatted with sampled point’s position or something?(I thought that view direction does not change along a ray, so if only view direction is fed to network it will lead to same outputs of all points, and same density of all points in same ray)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants