UP-NeRF: Unconstrained Pose-Prior-Free
Neural Radiance Fields
Injae Kim*, Minhyuk Choi*, Hyunwoo J. Kim†
Korea University
MLV Lab
Korea University
MLV Lab
NeurIPS 2023
Neural Radiance Field
Korea University
MLV Lab
NeurIPS 2023
Unposed-NeRF
BARF (ICCV23)
NoPe-NeRF (CVPR23)
Korea University
MLV Lab
NeurIPS 2023
Unconstrained Images
Phototourism dataset
Challenges
Korea University
MLV Lab
NeurIPS 2023
Unconstrained Images
Phototourism dataset
LLFF dataset
Challenges
Korea University
MLV Lab
NeurIPS 2023
Unconstrained Images
Challenges
Korea University
MLV Lab
NeurIPS 2023
Unconstrained Images
Challenges
Korea University
MLV Lab
NeurIPS 2023
UP-NeRF
Challenges
Challenges
Candidate Head
Korea University
MLV Lab
NeurIPS 2023
Candidate Head
Given image
Red frustum: estimated pose
Black frustum: ground-truth poses
Given image
Entire scene
Korea University
MLV Lab
NeurIPS 2023
Candidate Head
Korea University
MLV Lab
NeurIPS 2023
Candidate Head
Candidate representation
Shared representation
Korea University
MLV Lab
NeurIPS 2023
Candidate Head
Feature & Image
Pose
GT Image
GT feature
Without candidate
UP-NeRF
Korea University
MLV Lab
NeurIPS 2023
Feature Surrogate
Challenges
Feature Surrogate
Challenges
Korea University
MLV Lab
NeurIPS 2023
Feature Surrogate
Korea University
MLV Lab
NeurIPS 2023
UP-NeRF
Challenges
Challenges
Korea University
MLV Lab
NeurIPS 2023
Transient-aware Depth Prior
Korea University
MLV Lab
NeurIPS 2023
Isolated Transient Network
The gradient of transient occluder does not flow into learnable camera pose parameters.
Korea University
MLV Lab
NeurIPS 2023
Conclusion
Challenges
Challenges
Korea University
MLV Lab
NeurIPS 2023
Conclusion
Feature & Image
Pose
GT Image
GT feature
BARF
UP-NeRF
Colored frustum: estimated pose
Black frustum: ground-truth poses
Korea University
MLV Lab
NeurIPS 2023
https://mlvlab.github.io/upnerf
Korea University
MLV Lab
NeurIPS 2023