I am a tech lead manager at Nuro. Our team work on machine learning for planning and prediction problems in the autonomous driving domain. I was an applied scientist at Amazon, and I worked on reinforcement learning, imitation learning, NLP and vision & language problems. While I was in CMU, I worked with Prof. Emma Brunskill on sequential decision making under uncertainty, particularly in the contextual bandits and reinforcement learning settings. I also worked with Prof. Alex Smola on scalable machine learning.
Papers / Preprints (Google Scholar)
- Generating Self-Contained and Summary-Centric Question Answer Pairs via Differentiable Reward Imitation Learning
Li Zhou, Kevin Small, Yong Zhang, Sandeep Atluri
In 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021).
- Inverse Reinforcement Learning with Natural Language Goals
Li Zhou, Kevin Small
In 35th AAAI Conference on Artificial Intelligence (AAAI 2021).
- Multi-domain Dialogue State Tracking as Dynamic Knowledge Graph Enhanced Question Answering
Li Zhou, Kevin Small
In Conversational AI Workshop, NeurIPS 2019.
- End-to-End Offline Goal-Oriented Dialog Policy Learning via Policy Gradient
Li Zhou, Kevin Small, Oleg Rokhlenko, Charles Elkan
In Conversational AI Workshop, NIPS 2017.
- Latent Contextual Bandits and their Application to Personalized Recommendations for New Users
Li Zhou, Emma Brunskill
In 25th International Joint Conference on Artificial Intelligence (IJCAI 2016).
- A Survey on Contextual Multi-armed Bandits
- Cuckoo Linear Algebra
Li Zhou, David G Andersen, Mu Li, Alexander J Smola
In 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2015).
- Parameter Server for Distributed Machine Learning
Mu Li, Li Zhou, Zichao Yang, Aaron Li, Fei Xia, David G Andersen, Alexander J Smola
In BigLearning Workshop, NIPS 2013.
- Scalable Inference in Max-margin Topic Models
Jun Zhu, Xun Zheng, Li Zhou, Bo Zhang
In 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2013).
- Nuro, 2022 - Now
- Amazon, 2016 - 2022
- Google, Summer 2014 (Intern)
- Baidu, 2010 - 2012