About me

Page
DSC03406_cropped_small

Yuanming Hu          胡渊鸣

MIT CSAIL Ph.D. student, advised by Frédo Durand and Bill Freeman.

I graduated with honor from Tsinghua University (Yao class) in July 2017. I worked on deep learning and computer vision, during my internship with Stephen Lin at Microsoft Research Asia. My undergrad thesis is on automatic (differentiable) photo post-processing using reinforcement & adversarial learning (TOG & SIGGRAPH 2018). I completed my master thesis (The ChainQueen Differentiable Physical Simulator) with Wojciech Matusik in November 2018. My research has been partly supported by an Edwin Webster fellowship, a Snap Research fellowship, and an Adobe Research fellowship.

I designed and implemented the Taichi programming language.

Contact:    yuanming _at_ mit.edu            Github

 

My current research interests include ...

  1. High-performance systems for computer graphics:
  2. Physical simulation for VFX, machine learning, and robotics:
    • ChainQueen: differentiable MLS-MPM simulator for soft robotics that enables skill learning in < 100 iterations gradient descent iterations;
    • MLS-MPM: efficient & simple MPM in 88 lines of code;
    • CPIC: rigid-deformable coupling and cutting for MPM;
    • AsyncMPM: MPM with adaptive regional time stepping.
  3. Computational photography and deep learning:
    • Exposure: learning infinite-resolution image processing with RL and GANs from unpaired images, based on a differentiable image editing model;
    • FC4: FCN-based color constancy with confidence-weighted pooling.

News

Research

2019

Learning-In-The-Loop Optimization: End-To-End Control and Co-Design of Soft Robots Through Learned Deep Latent Representations
NeurIPS 2019 [Video]

Andrew Spielberg, Allan Zhao, Tao Du, Yuanming Hu, Daniela Rus, Wojciech Matusik
DiffTaichi: Differentiable Programming for Physical Simulation
arXiv [Code][Video]
Yuanming Hu, Luke Anderson, Tzu-Mao Li, Qi Sun, Nathan Carr, Jonathan Ragan-Kelley, Fredo Durand
SIGGRAPH Asia 2019 [Code][Video][Supp]
Yuanming Hu, Tzu-Mao Li, Luke Anderson, Jonathan Ragan-Kelley, Fredo Durand
On Hybrid Lagrangian-Eulerian Simulation Methods: Practical Notes and High-Performance Aspects
SIGGRAPH 2019 Courses

Yuanming Hu, Xinxin Zhang, Ming Gao, Chenfanfu Jiang

2018

The ChainQueen Differentiable Physics Engine
MIT EECS Master Thesis
Yuanming Hu
ChainQueen: A Real-Time Differentiable Physical Simulator for Soft Robotics
ICRA 2019, NIPS 2018 Workshop on Modeling the Physical World (Oral)
Yuanming Hu, Jiancheng Liu*, Andrew Spielberg* (joint 2nd authors), Joshua B. Tenenbaum, William T. Freeman, Jiajun Wu, Daniela Rus, Wojciech Matusik [Video] [Code]
Narrow-Band Topology Optimization on a Sparsely Populated Grid ACM Transactions on Graphics, SIGGRAPH Asia 2018
Haixiang Liu*, Yuanming Hu* (joint first authors), Bo Zhu, Wojciech Matusik, Eftychios Sifakis [Video] [Project Page & Code]
Deep Multispectral Painting Reproduction via Multi-layer, Custom-Ink Printing
ACM Transactions on Graphics, SIGGRAPH Asia 2018
Liang Shi, Vahid Babaei, Changil Kim, Michael Foshey, Yuanming Hu, Pitchaya Sitthi-Amorn, Szymon Rusinkiewicz, Wojciech Matusik [Supplemental Document][Multispectral Scans][Uncompressed paper]
(Undergraduate Thesis)
Exposure: A White-Box Photo Post-Processing Framework
ACM Transactions on Graphics, presented at SIGGRAPH 2018 [Project & Code]
Yuanming Hu, Hao He, Chenxi Xu, Baoyuan Wang, Stephen Lin
A Moving Least Squares Material Point Method with Displacement Discontinuity and Two-Way Rigid Body Coupling (MLS-MPM and CPIC)
ACM Transactions on Graphics, SIGGRAPH 2018 [Supp] [Video] [Project & Code]
Yuanming Hu, Yu Fang, Ziheng Ge, Ziyin Qu, Yixin Zhu, Andre Pradhana, Chenfanfu Jiang
Taichi: An Open-Source Computer Graphics Library
arXiv
Yuanming Hu
A Temporally Adaptive Material Point Method with Regional Time Stepping ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA 2018)
Yu Fang*, Yuanming Hu* (joint first authors), Shi-Min Hu, Chenfanfu Jiang [Video] [Code]

Experience

Ph.D. Student@Massachusetts Institute of Technology 2017.9-
I am a Ph.D. student at MIT CSAIL, working on computational photography, physical simulation, and high-performance graphics systems.

mit

Visiting Student@The University of Pennsylvania 2017.7-2017.8
I visited Prof. Chenfanfu Jiang during summer 2017. We developed a new material point method that is faster and supports cutting and rigid-body coupling (SIGGRAPH 2018).

penn

Undergraduate Visiting Researcher@Stanford University 2016.6-2016.8
With Prof. Ron Fedkiw, I developed a novel line segment based reconstruction algorithm specifically for reconstructing tree twigs.

stanford

Internship Student@The University of Tokyo 2016.3-2016.6
Computer graphics research (physically based animation and rendering) with Prof. Seiichi Koshizuka and Prof. Toshiya Hachisuka. I implemented 10+ graphics papers during this internship and developed an initial version of the Taichi library.

utokyo

Programming Contests

Asia-Pacific Informatics Olympiad 2012, China District

China National Olympiad in Informatics 2012

ACM-ICPC Asia Changsha Regional Contest 2013, with my team

ACM-ICPC Asia Shanghai Regional Contest 2014, with my team

China National Olympiad in Informatics 2014

Gold Medal, 1st / 450

Gold Medal, 13th / 350

Gold Medal, 3rd / 200

Gold Medal, 5th / 250

Problem Setter

Hobbies

Photography, graphic design, animated films, creating and destroying everything in my physically based simulators