I am a research scientist at Horizon Robotics. Previously, I worked at Baidu Research and Facebook AI Research.

I am also an experienced engineer who loves writing code and building things. I am a co-author and an active maintainer of ALF, an RL framework emphasizing on the flexibility and easiness of implementing a complex RL system involving many different algorithm components.

My current passion is to build a robot with mobile manipulation capabilities in daily indoor scenarios.

ALF - Agent Learning Framework (ALF) is a PyTorch reinforcement learning framework emphasizing on the flexibility and easiness of implementing complex algorithms involving many different components.
TAAC - Temporally abstract actor-critic algorithm for efficient continuous control.
XWorld - A simulator package for RL research with language task support.
FLARE - A reinforcement learning framework for training embodied agents with PyTorch.

I like playing video games, especially ARPG. So far my favorite games are souls-like, by FromSoftware.