[about]   [papers]   [travels]  

my face

Chenglei Si

[email] [scholar] [twitter] [github]
Undergrad at UMD CLIP & LSC
Incoming PhD at Stanford NLP


I am advised by Jordan Boyd-Graber at the University of Maryland, while also working closely with Hal Daumé III, He He, Danqi Chen, and Sherry Wu. In summer 2022, I did a research internship at Microsoft hosted by Zhe Gan. Before that, I got into NLP research by working with Min-Yen Kan and Zhiyuan Liu.

Nowadays, I'm fascinated by Human-Muppet Interaction. And I'm particularly concerned about the following questions:
How can humans verify what Muppets said, especially in tasks where humans lack the domain expertise?
How can we enable human-Muppet collaboration to complete tasks that humans or Muppets cannot solve alone?
What is the long-term impact of humans relying on Muppets?
How can we measure and improve the safety of Muppets?
In pursuing these research questions, I tend to move away from existing benchmarks and put human needs at the center of my research. I also aim to craft an interdisciplinary research agenda that connects insights from HCI, NLP, ML, Psychology, and Linguistics.

Back in the old days, I also worked on Question Answering, Tokenization, and Prompting.

Selected Papers

  • Mixture of Prompt Experts for Generalizable and Interpretable Question Answering
    Chenglei Si, Weijia Shi, Chen Zhao, Luke Zettlemoyer, Jordan Boyd-Graber
    Preprint [paper] [code]

  • Measuring Inductive Biases of In-Context Learning with Underspecified Demonstrations
    Chenglei Si*, Dan Friedman*, Nitish Joshi, Shi Feng, Danqi Chen, He He
    ACL 2023 [paper] [code] [tweet]

  • Prompting GPT-3 To Be Reliable
    Chenglei Si, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan Boyd-Graber, Lijuan Wang
    ICLR 2023 [paper] [code] [tweet] [video]

  • Sub-Character Tokenization for Chinese Pretrained Language Models
    Chenglei Si*, Zhengyan Zhang*, Yingfa Chen*, Fanchao Qi, Xiaozhi Wang, Zhiyuan Liu, Yasheng Wang, Qun Liu, Maosong Sun
    TACL 2023 [paper] [code]

  • Re-Examining Calibration: The Case of Question Answering
    Chenglei Si, Chen Zhao, Sewon Min, Jordan Boyd-Graber
    EMNLP 2022 Findings [paper] [code] [video]


  • July 2023, ACL @ Toronto
  • May 2023, ICLR @ Kigali
  • March 2023, Visit Day @ Stanford
  • March 2023, Visit Day @ NYU
  • Dec 2022, EMNLP @ Abu Dhabi
  • Summer 2022, Intern + NAACL @ Seattle