G’day mate 👋!

About me

---

I am a final-year Ph.D. student in the Department of DSAI at the Faculty of IT, Monash University, supervised by Asst. Prof. Bohan Zhuang and Prof. Jianfei Cai. Before joining Zip Lab, I obtained my M.Phil. and Bachelor’s degrees from the University of Sydney under the supervision of Prof. Dacheng Tao and Dr. Jing Zhang. My research interests include efficiency problems in deep learning scenarios, multi-modal LLMs, and segmentation tasks.

News!

---

• [03/2024] Our paper ESTA on model stitching and adaptation got accepted by CVPR 2024!
• [12/2023] Our paper SPViT on visual Transformer pruning got accepted by TPAMI!
• [11/2023] I have joined TikTok Sydney as a research engineer intern working on efficient video LLMs!
• [09/2023] Our paper MPVSS on efficient video segmentation got accepted by NeurIPS 2023!
• [08/2023] Our paper SPT on adaptive parameter-efficient fine-tuning got accepted by ICCV 2023 for oral presentation!
• [07/2023] Our paper EOPNet on data-efficient human parsing got accepted by TPAMI!
• [02/2023] Our survey paper on efficient training of transformers got accepted by IJCAI 2023!
• [02/2023] Our paper FASeg on adaptive semantic segmentation got accepted by CVPR 2023!
• [09/2022] Our paper Ecoformer on energy-saving attentions got accepted by NeurIPS 2022!
• [12/2021] Our paper LIT on efficient transformer architectures got accepted by AAAI 2022!
• [07/2021] Our paper HVT on efficient transformer architectures got accepted by ICCV 2021!
• [12/2020] Our paper POPNet on data-efficient human parsing got accepted by AAAI 2021!
• [12/2019] Our paper Grapy-ML on cross-dataset human parsing got accepted by AAAI 2020!

Papers

---

Efficient Stitchable Task Adaptation [CVPR 2024]

Haoyu He, Zizheng Pan, Jing Liu, Jianfei Cai, Bohan Zhuang

PDF / Code

Pruning Self-attentions into Convolutional Layers in Single Path [TPAMI 2024]

Haoyu He, Jing Liu, Zizheng Pan, Jianfei Cai, Jing Zhang, Dacheng Tao, Bohan Zhuang

PDF / Code

Mask Propagation for Efficient Video Semantic Segmentation [NeurIPS 2023]

Yuetian Weng, Mingfei Han, Haoyu He, Mingjie Li, Lina Yao, Xiaojun Chang, Bohan Zhuang

PDF / Code

Sensitivity-Aware Visual Parameter-Efficient Tuning [ICCV 2023] (oral)

Haoyu He, Jianfei Cai, Jing Zhang, Dacheng Tao, Bohan Zhuang

PDF / Code

End-to-end One-shot Human Parsing [TPAMI 2023]

Haoyu He, Jing Zhang, Bohan Zhuang, Jianfei Cai, Dacheng Tao

PDF / Code

A Survey on Efficient Training of Transformers [IJCAI 2023]

Bohan Zhuang, Jing Liu, Zizheng Pan, Haoyu He, Yuetian Weng, Chunhua Shen

PDF

Dynamic Focus-aware Positional Queries for Semantic Segmentation [CVPR 2023]

Haoyu He, Jianfei Cai, Zizheng Pan, Jing Liu, Jing Zhang, Dacheng Tao, Bohan Zhuang

PDF / Code

EcoFormer: Energy-Saving Attention with Linear Complexity [NeurIPS 2022] (highlight)

Jing Liu, Zizheng Pan, Haoyu He, Jianfei Cai, Bohan Zhuang

PDF / Code

Less is More: Pay Less Attention in Vision Transformers [AAAI 2022]

Zizheng Pan, Bohan Zhuang, Haoyu He, Jing Liu, Jianfei Cai

PDF / Code

Progressive One-shot Human Parsing [AAAI 2021] (oral)

Haoyu He, Bohan Zhuang, Jing Zhang, Jianfei Cai, Dacheng Tao

PDF / Code

Grapy-ML: Graph Pyramid Mutual Learning for Cross-dataset Human Parsing [AAAI 2020] (oral)

Haoyu He, Jing Zhang, Qiming Zhang, Dacheng Tao

PDF / Code

Services

---

Reviewer for CVPR, ECCV, ICCV, NeurIPS, AAAI, TPAMI, and TMM.

Teaching

---

Teaching associate for

• COMP5318 - Machine Learning and Data Mining (USYD, 2020)
• COMP5349 - Cloud Computing (USYD, 2020)
• FIT5047 - Fundamentals of Artificial Intelligence (Monash, 2023).
• FIT5201 - Machine Learning (Monash, 2023)