I am a research scientist at Horizon Robotics, working on learning-based robotics. Previously, I worked at Facebook AI Research and Baidu Research for embodied AI.

I love writing code and building things. I am a co-author and an active maintainer of ALF, an RL framework emphasizing on the flexibility and easiness of implementing a complex RL system involving many different algorithm components.

My long-term career goal is to build a robot with a wide range of skills to help people with tedious daily tasks, so that they have time to do creative things (e.g., writing, drawing, imagining, etc) which LLMs are currently doing.

ALF - Agent Learning Framework (ALF) is a PyTorch reinforcement learning framework emphasizing on the flexibility and easiness of implementing complex algorithms involving many different components.
TAAC - Temporally abstract actor-critic algorithm for efficient continuous control.
XWorld - A simulator package for RL research with language task support.
FLARE - A reinforcement learning framework for training embodied agents with PyTorch.

I like playing video games, especially ARPG. So far my favorite games are souls-like, by FromSoftware.