Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

excuse me, I used the pre packaged model provided in readme for inference without making any changes to the code, and the result I obtained was fuzzy without any changes to the code. What could be the reason for this? #14

Open
songofjoy opened this issue Dec 25, 2024 · 4 comments
Assignees

Comments

@songofjoy
Copy link

excuse me, I used the pre-trained model provided in readme for inference without making any changes to the code, and the result I obtained was fuzzy without any changes to the code. What could be the reason for this?

pre-trained model:
dl3dv_480p.ckpt

run :

dl3dv; requires at least 22G VRAM

python -m src.main +experiment=dl3dv_mvsplat360
wandb.name=dl3dv_480P_ctx5_tgt56
mode=test
dataset/view_sampler=evaluation
dataset.roots=[datasets/dl3dv_tiny]
checkpointing.load=checkpoints/dl3dv_480p.ckpt

@donydchen
Copy link
Owner

Hi @songofjoy, would you mind sharing some of your results here? MVSplat360 is, of course, not a perfect solution for every scene, but the released model should be able to render results similar to those in the demo video. If the results you obtained are much worse, then something unexpected might happen in the working environment.

@songofjoy
Copy link
Author

ImagesGSplat
ImagesRefined0

@donydchen
Copy link
Owner

Hi @songofjoy, I just rerun the test on my machine using the latest released codes. Below are the outputs I obtained regarding the two images you shared.

Screenshot 2024-12-26 at 4 37 35 PM
Screenshot 2024-12-26 at 4 37 49 PM

These align well with the results posted in #9 by other users. Hence, the errors might be caused by your experimental environment. I reckon the 3DGS rendering is correctly set on your side, and the problem comes from the SVD part.

You might reinstall the mvsplat360 virtual environment and see whether it resolves the issue. FYI, I use the latest 3DGS renderer and SVD codes. Hope it helps.

@donydchen donydchen self-assigned this Dec 26, 2024
@songofjoy
Copy link
Author

Thank you very much, I will try to reconfigure the running environment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants