I am a PhD student at Language Technologies Institute in CMU, advised by Jaime Carbonell. Sadly, Jaime passed away in 2020 and I have been working with Yulia Tsvetkov and Emma Strubell since then. Jaime will always be my advisor and deeply missed.
Previously, I obtained my B.S. in Computer Science and Mathematics at CMU.
My research work are supported by Carnegie Mellon's Presidential Fellowship.
Transfer Learning, Meta Learning, Natural Language Processing, Computer Vision.
Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models.
Zirui Wang, Yulia Tsvetkov, Orhan Firat, Yuan Cao.
ICLR 2021 (Spotlight). [arxiv]
Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Framework.
Zirui Wang*, Jiateng Xie*, Ruochen Xu, Yiming Yang, Graham Neubig, Jaime Carbonell.
ICLR 2020. [arxiv] [code] [presentation]
Characterizing and Avoiding Negative Transfer.
Zirui Wang, Zihang Dai, Barnabás Póczos, Jaime Carbonell.
CVPR 2019. [arxiv]
CMU Presidential Fellowship, 2020-2021.
CMU LTI Research Fellowship, 2017-present.
Teaching Assistant @ CMU