About

I got a bachelor degree and a Ph.D degree in School of Software, Tsinghua University. My research advisor is Prof. Long. I’m interested in machine learning and systems.

Besides research, I’m particularly interested in the working mechanism of our world (both the physical world and the Internet world). To fulfill such an interest, I have broad hobbies in reading, writing, and coding. I aim for a computational understanding of the world and intelligence.

I’m actively working on vLLM, a high-performance and easy-to-use library for LLM inference. If you want to see my open-source contributions, please visit my github homepage.

I’m a co-founder and Chief Scientist at Inferact Inc., a startup founded by creators and core maintainers of vLLM, aiming to grow vLLM as the world’s AI inference engine and accelerate AI progress by making inference cheaper and faster. Check the blog for my story and announcement for the company. We are actively hiring for strong candidates in the fields of AI inference, distributed systems, and machine learning. Please submit your application here or email me.