Li Zhou

I am a tech lead manager at Nuro. Our team work on machine learning for planning and prediction problems in the autonomous driving domain. I was an applied scientist at Amazon, and I worked on reinforcement learning, imitation learning, NLP and vision & language problems. While I was in CMU, I worked with Prof. Emma Brunskill on sequential decision making under uncertainty, particularly in the contextual bandits and reinforcement learning settings. I also worked with Prof. Alex Smola on scalable machine learning.

Papers / Preprints (Google Scholar)

• Generating Self-Contained and Summary-Centric Question Answer Pairs via Differentiable Reward Imitation Learning
  Li Zhou, Kevin Small, Yong Zhang, Sandeep Atluri
  In 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021).
• Inverse Reinforcement Learning with Natural Language Goals
  Li Zhou, Kevin Small
  In 35th AAAI Conference on Artificial Intelligence (AAAI 2021).
• Multi-domain Dialogue State Tracking as Dynamic Knowledge Graph Enhanced Question Answering
  Li Zhou, Kevin Small
  In Conversational AI Workshop, NeurIPS 2019.
• End-to-End Offline Goal-Oriented Dialog Policy Learning via Policy Gradient
  Li Zhou, Kevin Small, Oleg Rokhlenko, Charles Elkan
  In Conversational AI Workshop, NIPS 2017.
• Latent Contextual Bandits and their Application to Personalized Recommendations for New Users
  Li Zhou, Emma Brunskill
  In 25th International Joint Conference on Artificial Intelligence (IJCAI 2016).
• A Survey on Contextual Multi-armed Bandits
  Li Zhou
  Preprint, 2016.
• Cuckoo Linear Algebra
  Li Zhou, David G Andersen, Mu Li, Alexander J Smola
  In 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2015).
• Parameter Server for Distributed Machine Learning
  Mu Li, Li Zhou, Zichao Yang, Aaron Li, Fei Xia, David G Andersen, Alexander J Smola
  In BigLearning Workshop, NIPS 2013.
• Scalable Inference in Max-margin Topic Models
  Jun Zhu, Xun Zheng, Li Zhou, Bo Zhang
  In 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2013).

Experience

• Nuro, 2022 - Now
• Amazon, 2016 - 2022
• Google, Summer 2014 (Intern)
• Baidu, 2010 - 2012