Lei Li

Carnegie Mellon University

Language Technology Institute
Assistant Professor

Research area: natural language processing, machine learning.

Topics:

  • Large Language Models
    • LLM agent, code generation, tool use, cooperation, reasoning, factuality
    • security, privacy, copyright of LLM 
    • Efficient LLM Systems
  • Multilingual NLP
    • machine translation
    • speech translation, .
    • multilingual transfer
  • AI for Science
    • AI for Drug discovery, Molecule Design
    • Generative Algorithms for Protein Design

Bio

  • CGMH: A method for controllable text generation from specified keywords. [arxiv]
  • Analyzing anisotropic sentence embeddings from pre-trained language models. [arxiv]
  • Data-efficient methods for many-to-many neural machine translation. [mRASP, mRASP2]
  • Glancing Transformer (GLAT): non-autoregressive translation models are equally good as autoregressive Transformer. [arxiv]
  • VOLT: Learning vocabulary via optimal transport (ACL 2021 Best Paper). [arxiv]
  • SOLO: Fast and accurate object instance segmentation. [SOLO, SOLOv2]