Ziyang Xie

I am currently an MSCS student at the University of Illinois at Urbana-Champaign (UIUC). I’ve been working closely with Prof. Bolei Zhou and Prof. Shenlong Wang on various projects related to 3D vision, embodied ai and autonomous driving.

I’m also the tech-cofounder of Manifold-S. A startup that aims to provide a comprehensive solution for controllable 3D reconstruction and generation. Please check out our website for more information.

Previously, I completed my undergraduate studies at Fudan University, where I specialized in computer science and was actively involved in the Zhang Vision Group led by Prof. Li Zhang. During the spring of 2022, I completed an autonomous research internship at SenseTime, a leading company in the field of artificial intelligence.

My research interests encompass various areas within 3D vision, multi-view geometry and autonomous driving. I have a strong research experience in 3D scene reconstruction / generation, and neural rendering.

News

May 5, 2024	This summer, I will be joining Prof. Bolei Zhou’s group at UCLA as a research intern.
Jan 16, 2024	One new paper accepted for ICLR 2024 Spotlight Presentation! 🎉
Oct 30, 2023	Glad to be invited to serve as a reviewer for CVPR 2024!
Jul 14, 2023	One new paper accepted by ICCV 2023!
Apr 15, 2023	Join UIUC as a Computer Science Master student (MSCS)!

Publications

Vid2Sim: Realistic and Interactive Simulation from Video for Urban Navigation

Ziyang Xie, Zhizheng Liu, Zhenghao Peng, Wayne Wu, and Bolei Zhou

Under Review, 2024

Project Page Bib

@article{xie2024vid2sim,
  title = {Vid2Sim: Realistic and Interactive Simulation from Video for Urban Navigation},
  author = {Xie, Ziyang and Liu, Zhizheng and Peng, Zhenghao and Wu, Wayne and Zhou, Bolei},
  page = {https://metadriverse.github.io/vid2sim/},
  journal = {Under Review},
  year = {2024}
}

S-NeRF++: Autonomous Driving Simulation via Neural Reconstruction and Generation

Yurui Chen, Junge Zhang, Ziyang Xie, Wenye Li, Feihu Zhang, and 2 more authors

Preprint, 2024

arXiv Bib

@article{yurui2023snerf++,
  title = {S-NeRF++: Autonomous Driving Simulation via Neural Reconstruction and Generation},
  author = {Chen, Yurui and Zhang, Junge and Xie, Ziyang and Li, Wenye and Zhang, Feihu and Lu, Jiachen and Zhang, Li},
  journal = {Preprint},
  year = {2024}
}

Frozen transformers in language models are effective visual encoder layers

Ziqi Pang, Ziyang Xie*, Yunze Man*, and Yu-Xiong Wang

ICLR, 2024 | Spotlight*

arXiv Code Bib
@article{pang2023frozen, author = {Pang, Ziqi and Xie*, Ziyang and Man*, Yunze and Wang, Yu-Xiong}, journal = {ICLR}, year = {2024} }

MV-Map: Offboard HD-Map Generation with Multi-view Consistency

Ziyang Xie*, Ziqi Pang*, and Yu-Xiong Wang

ICCV, 2023

arXiv Code Bib

@article{ziyang2023mvmap,
  title = {MV-Map: Offboard HD-Map Generation with Multi-view Consistency},
  author = {Xie*, Ziyang and Pang*, Ziqi and Wang, Yu-Xiong},
  journal = {ICCV},
  year = {2023}
}

S-NeRF: Neural Radiance Fields for Street Views

Ziyang Xie*, Junge Zhang*, Wenye Li, Feihu Zhang, and Li Zhang

ICLR, 2023

Project Page Bib

@article{ziyang2023snerf,
  title = {S-NeRF: Neural Radiance Fields for Street Views},
  author = {Xie*, Ziyang and Zhang*, Junge and Li, Wenye and Zhang, Feihu and Zhang, Li},
  page = {https://ziyang-xie.github.io/s-nerf/},
  journal = {ICLR},
  year = {2023}
}