Xin Lai 赖昕

Ph.D. Candidate

Department of Computer Science and Engineering
The Chinese University of Hong Kong (CUHK)
Email: xinlai@cse.cuhk.edu[dot]hk

Biography [CV]

I am currently a final-year Ph.D student at the Department of Computer Science and Engineering (CSE), Chinese University of Hong Kong (CUHK), supervised by Prof. Jiaya Jia. Before that, I received the Bachelor's Degree at Harbin Institute of Technology (HIT) in 2020.

My current research interest includes Multi-modal LLM, 3D Point Cloud / 2D Image Scene Understanding, particularly in:

1. Enabling multi-modal LLMs with downstream vision tasks capabilities;

2. Repurposing Transformer for 3D point cloud processing.

Selected Publications [Google Scholar]

	LISA: Reasoning Segmentation via Large Language Model Xin Lai, Zhuotao Tian, Yukang Chen, Yanwei Li, Yuhui Yuan, Shu Liu, Jiaya Jia CVPR, 2024 (Oral, 3.3% acceptance rate) [paper\|code] Over 1,400 GitHub Stars! Reported by technology media such as Twitter, 量子位, 机器之心, CVer.
	Mask-Attention-Free Transformer for 3D Instance Segmentation Xin Lai, Yuhui Yuan, Ruihang Chu, Yukang Chen, Han Hu, Jiaya Jia ICCV, 2023 [paper\|code]
	Spherical Transformer for LiDAR-based 3D Recognition Xin Lai, Yukang Chen, Fanbin Lu, Jianhui Liu, Jiaya Jia CVPR, 2023 [paper\|code]
	Stratified Transformer for 3D Point Cloud Segmentation Xin Lai, Jianhui Liu, Li Jiang, Liwei Wang, Hengshuang Zhao, Shu Liu, Xiaojuan Qi, Jiaya Jia CVPR, 2022 [paper\|code] A pioneering fully transformer-based 3D fundamental network.
	DecoupleNet: Decoupled Network for Domain Adaptive Semantic Segmentation Xin Lai, Zhuotao Tian, Xiaogang Xu, Yingcong Chen, Shu Liu, Hengshuang Zhao, Liwei Wang, Jiaya Jia ECCV, 2022 [paper\|code]
	Semi-supervised Semantic Segmentation with Directional Context-aware Consistency Xin Lai, Zhuotao Tian, Li Jiang, Shu Liu, Hengshuang Zhao, Liwei Wang, Jiaya Jia CVPR, 2021 [paper\|code]

Open-source Projects

Sparse Transformer

Xin Lai, Fanbin Lu, Yukang Chen

Open-source Library

[code]

Fast, memory-efficient, and easy-to-use implementation for window-based 3D Transformer, well optimized by low-level CUDA code.

Experiences

July 2023 - Jan. 2024, Tencent Co.,Ltd.
Internship, Mentor: Dr. Yanpei Cao

Dec. 2022 - May 2023, Microsoft Research Asia (MSRA)
Collaboration, Mentor: Dr. Yuhui Yuan, Dr. Han Hu

Honors and Awards

Outstanding Reviewer, CVPR, 2023
Postgraduate Scholarship, CUHK, 2020-2024
Outstanding Graduate, HIT, 2020
National Scholarship (Top 1%), China, 2018
Fung Scholarship, Hong Kong, 2018
Provincial Merit Student (Top 2%), China, 2018
People's Scholarship, HIT, 2016-2018

Professional Services

Conference Services:
International Conference on Learning Representations (ICLR’24)
Winter Conference on Applications of Computer Vision (WACV’24)
Conference and Workshop on Neural Information Processing Systems (NeurIPS’23)
IEEE Conference on Computer Vision and Pattern Recognition (CVPR’22,23)
IEEE International Conference on Computer Vision (ICCV’21,23)
European Conference on Computer Vision (ECCV’22)

Journal Reviews:
IEEE Transactions on Image Processing (TIP)
Pattern Recognition (PR)

Teaching

2021-2022	Fall	ENGG 1110: Problem Solving By Programming
2020-2021	Spring	CSCI 3251: Engineering Practicum
2020-2021	Fall	ENGG 1110: Problem Solving By Programming

	LISA: Reasoning Segmentation via Large Language Model Xin Lai, Zhuotao Tian, Yukang Chen, Yanwei Li, Yuhui Yuan, Shu Liu, Jiaya Jia CVPR, 2024 (Oral, 3.3% acceptance rate) [paper\|code] Over 1,400 GitHub Stars! Reported by technology media such as Twitter, 量子位, 机器之心, CVer.
	Mask-Attention-Free Transformer for 3D Instance Segmentation Xin Lai, Yuhui Yuan, Ruihang Chu, Yukang Chen, Han Hu, Jiaya Jia ICCV, 2023 [paper\|code]
	Spherical Transformer for LiDAR-based 3D Recognition Xin Lai, Yukang Chen, Fanbin Lu, Jianhui Liu, Jiaya Jia CVPR, 2023 [paper\|code]
	Stratified Transformer for 3D Point Cloud Segmentation Xin Lai, Jianhui Liu, Li Jiang, Liwei Wang, Hengshuang Zhao, Shu Liu, Xiaojuan Qi, Jiaya Jia CVPR, 2022 [paper\|code] A pioneering fully transformer-based 3D fundamental network.
	DecoupleNet: Decoupled Network for Domain Adaptive Semantic Segmentation Xin Lai, Zhuotao Tian, Xiaogang Xu, Yingcong Chen, Shu Liu, Hengshuang Zhao, Liwei Wang, Jiaya Jia ECCV, 2022 [paper\|code]
	Semi-supervised Semantic Segmentation with Directional Context-aware Consistency Xin Lai, Zhuotao Tian, Li Jiang, Shu Liu, Hengshuang Zhao, Liwei Wang, Jiaya Jia CVPR, 2021 [paper\|code]

Xin Lai 赖 昕