Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No result output from training? #36

Open
yuancaimaiyi opened this issue Dec 13, 2023 · 3 comments
Open

No result output from training? #36

yuancaimaiyi opened this issue Dec 13, 2023 · 3 comments
Labels
enhancement New feature or request

Comments

@yuancaimaiyi
Copy link

@hugoycj
Hi,awesome work,but there is no result output from my training here. What could be the problem? Thank you.
图片

@hugoycj
Copy link
Owner

hugoycj commented Dec 13, 2023

The output will be automatically saved under the exp folder, with a name like exp/neuralangelo-colmap_sparse-wmask-*/@20231207-111559/save/it20000-mc512.obj.

If you would like to export a high resolution mesh additionally, you could run by

python export.py --exp_dir exp/neuralangelo-colmap_sparse-wmask-*/@20231207-111559 --res 1024

The results will be automatically saved under results folder

@hugoycj hugoycj added the question Further information is requested label Dec 13, 2023
@yuancaimaiyi
Copy link
Author

@hugoycj
update:
In addition, I still have two questions that I need your help with。
Question 1: Coordinate System Issue
(1) Regarding the coordinate system issue: As you can see in the diagram below, under the same pose, one is the result of colmap mesh, and the other is the result of Instant-angelo. In theory, they should coincide, but there seems to be a mismatch in coordinates and scale. Just to clarify (I consider myself a beginner in NERF because I have been focusing on traditional algorithms for a long time), I would like to know how I can align the results of the two. This is the first question.
colmap mesh :
图片
instant-angelo mesh :
图片

Question 2: Handling Unbounded or Forward Motion Scenes(outdoor)

(2) Can you handle unbounded scenes or, in other words, forward motion scenes? As you can see in (1), it is an object-centric scene, and the performance is decent. However, when I scanned an unbounded scene with my phone, the sparse model looks like the one below, and it seems that Instant-angelo fails to reconstruct the scene. I would like to ask, for this type of case (2), which parameters need to be adjusted to handle it? Or is Instant-angelo specifically designed for object-centric scenes?
unbound sparse model:
图片
instant-angelo mesh :
图片
图片

@hugoycj
Copy link
Owner

hugoycj commented Dec 18, 2023

Apologies for the delayed response. Regarding the first question, we normalize the pose to a canonical space in order to ensure that the entire reconstruction area is within a coordinate range of (-1, 1). As a result, there should be a corresponding conversion from canonical space back to the original coordinates. I will be adding an option for this in the export scripts tomorrow.

As for the second question, the current pipeline is specifically designed for outside-in (similar to mipnerf360) reconstruction and has not been tested for inside-out (such as scannet) scenarios. Therefore, we cannot guarantee successful reconstruction for indoor scenes. It's possible that a different pipeline tailored for indoor scene reconstruction, such as monosdf and nicer-slam, may yield better results.

@hugoycj hugoycj added enhancement New feature or request and removed question Further information is requested labels Dec 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants