Generate Depth Images of TUM-RGBD Dataset

[czeyveli1]

Hello everyone,
First of all, congratulations on the amazing work!

I have a question about obtaining depth datasets for different datasets. I would like to generate depth images from the TUM-RGBD dataset. For instance, in the TUM-RGBD dataset, there is a scene called "fr1/desk," which contains 613 RGB images with a resolution of 640×480. How can I generate the corresponding depth dataset using your project? I couldn’t fully understand the process.

[haofeixu]

Hi, thanks for your kinds words.

For depth prediction, you might want to check out the script in our unimatch repo: https://github.com/autonomousvision/unimatch/blob/master/scripts/depthsplat_depth_demo.sh

You can refer to the data loading example on scannet and modify it accordingly to load your data.

[czeyveli1]

Can I use the DepthSplat repo to generate a stereo depth model? Actually, I don’t just want to obtain a depth dataset—I can already do that using the DepthAnything model. Instead, I want to generate a scale-consistent depth dataset.

[haofeixu]

Hi, if you only want to generate depths with consistent scales, the unimatch demo code would be easier to use, and the dataloader is easy to set up.