Meta Reality Labs - Codec Avatars

Working with Chen Cao, Giljoo Nam and Yaser Sheikh

Worked on 3D simulation and simulation intelligence for autonomous driving. Research, design and implement algorithms in multiple domains including sensor simulation, agent behavior, and vehicle dynamics, in order to make a simulation of the ego car and agents more realistic.

Led another two engineers developing sensor simulation, which generates synthetic scenarios’ 3D point cloud data scanned by simulated LiDAR based on physics-based ray casting and PBR material rendering. This project led to a 38% increase in mAP@iou_0.5 for our LiDAR detection model.

Worked on implementing graphics and shader-related features Cloth Simulation, Collider System (Physics System) in Lens Studio and Lens Core (Snap AR’s main rendering engine for mobile devices) deeply collaborated with Snap Research.

Engineering owner of Shader Analyzer, Texture Analyzer (internal tools) and refined small features in Lens Studio and Lens Core. Got Promoted after the first half year.

Master’s thesis: Action recognition in compressive sensing.

Supervised by Prof. Aggelos K. Katsaggelos

Worked in Software Analytics Group - current re-org as Data Analytics Research Group under the DKI (Data, Knowledge, Intelligence) Group at Microsoft Research Asia. Supervised by Justin(Rui) Ding

Worked on AutoInsights, which aims at automatically discovering interesting and meaningful data patterns, building structured knowledge on top of it to facilitate Exploratory/Predictive Data Analysis. Especially worked on data mining algorithms.