About me

Page
DSC03406_cropped_small

Yuanming Hu          胡渊鸣

MIT CSAIL Ph.D. student, advised by Frédo Durand and Bill Freeman.

I graduated with honor from Tsinghua University (Yao class) in July 2017. I worked on deep learning and computer vision, during my internship with Stephen Lin at Microsoft Research Asia. My undergrad thesis is on automatic (differentiable) photo post-processing using reinforcement & adversarial learning (TOG & SIGGRAPH 2018). I completed my master thesis (The ChainQueen Differentiable Physical Simulator) with Wojciech Matusik in November 2018. My research has been partly supported by an Edwin Webster fellowship and a Snap Research fellowship.

I designed and implemented the Taichi programming language.

Contact:    yuanming _at_ mit.edu            Github

 

My current research interests include ...

  1. High-performance systems for computer graphics:
  2. Physical simulation for VFX, machine learning, and robotics:
    • ChainQueen: differentiable MLS-MPM simulator for soft robotics that enables skill learning in < 100 iterations gradient descent iterations;
    • MLS-MPM: efficient & simple MPM in 88 lines of code;
    • CPIC: rigid-deformable coupling and cutting for MPM;
    • AsyncMPM: MPM with adaptive regional time stepping.
  3. Computational photography and deep learning:
    • Exposure: learning infinite-resolution image processing with RL and GANs from unpaired images, based on a differentiable image editing model;
    • FC4: FCN-based color constancy with confidence-weighted pooling.

News

  • (11/2019)  I'm a winner of the 2020 Adobe Research Fellowship.
  • (09/2019) The differentiable programming extension (DiffTaichi) for the Taichi programming language is released. [paper] [code]
  • (08/2019)The Taichi programming language for spatially sparse computation (SIGGRAPH Asia 2019) is released. [paper][code]
  • (07/2019) Welcome to our SIGGRAPH 2019 course On Hybrid Lagrangian-Eulerian Simulation Methods: Practical Notes and High-Performance Aspects (Thursday 3:45pm-5:15pm Room 408AB)! [Course Website]
  • (07/2019) MLS-MPM is featured on Two Minute Papers.
  • (06/2019) ChainQueen is on the MIT CSAIL news.
  • (05/2019) The code for our 1,040,875,347 voxel topology optimization is released.
  • More...

Research

2019

DiffTaichi: Differentiable Programming for Physical Simulation
arXiv [Code][Video]
Yuanming Hu
, Luke Anderson, Tzu-Mao Li, Qi Sun, Nathan Carr, Jonathan Ragan-Kelley, Fredo Durand

SIGGRAPH Asia 2019 [Code][Video][Supp]
Yuanming Hu, Tzu-Mao Li, Luke Anderson, Jonathan Ragan-Kelley, Fredo Durand

2018

(MIT EECS Master Thesis)
The ChainQueen Differentiable Physics Engine
Yuanming Hu

ChainQueen: A Real-Time Differentiable Physical Simulator for Soft Robotics
ICRA 2019
Workshop on Modeling the Physical World: Perception, Learning, and Control (Oral), NIPS 2018
Yuanming Hu, Jiancheng Liu*, Andrew Spielberg* (joint 2nd authors), Joshua B. Tenenbaum, William T. Freeman, Jiajun Wu,
Daniela RusWojciech Matusik

[Video] [Code]

Narrow-Band Topology Optimization on a Sparsely Populated Grid
ACM Transactions on Graphics, SIGGRAPH Asia 2018
Haixiang Liu*, Yuanming Hu* (joint first authors), Bo Zhu, Wojciech Matusik, Eftychios Sifakis
[Video] [Project Page & Code]

Deep Multispectral Painting Reproduction via Multi-layer, Custom-Ink Printing
ACM Transactions on Graphics, SIGGRAPH Asia 2018
Liang ShiVahid Babaei, Changil Kim, Michael Foshey, Yuanming Hu, Pitchaya Sitthi-Amorn,
Szymon Rusinkiewicz, Wojciech Matusik

[Supplemental Document]
 [Multispectral Scans]  [Uncompressed paper]

(Undergraduate Thesis)
Exposure: A White-Box Photo Post-Processing Framework 
ACM Transactions on Graphics, presented at SIGGRAPH 2018
Yuanming HuHao He, Chenxi Xu, Baoyuan Wang, Stephen Lin
[Project Page & Code]

A Temporally Adaptive Material Point Method with Regional Time Stepping
ACM SIGGRAPH/ Eurographics Symposium on Computer Animation (SCA 2018)
Yu Fang*, Yuanming Hu* (joint first authors)Shi-Min Hu, Chenfanfu Jiang
[Video] [Code]

2017

☯An Asynchronous Material Point Method
SIGGRAPH 2017 Posters
Yuanming Hu*, Yu Fang* (joint first authors)
[Code]

Experience

Ph.D. Student@Massachusetts Institute of Technology 2017.9-
Right now I am a Ph.D. student at MIT CSAIL. I work on computational photography, physical simulation, and high-performance graphics systems.

mit

Visiting Student@The University of Pennsylvania 2017.7-2017.8
I visited Prof. Chenfanfu Jiang during summer 2017. We developed a new material point method that is faster and supports cutting and rigid-body coupling (SIGGRAPH 2018).

penn

Undergraduate Visiting Researcher@Stanford University 2016.6-2016.8
With Prof. Ron Fedkiw, I developed a novel line segment based reconstruction algorithm for fine tree details where previous methods do not perform well.

stanford

Internship Student@The University of Tokyo 2016.3-2016.6
Computer graphics research (physically based animation and rendering) with Prof. Seiichi Koshizuka and Prof. Toshiya Hachisuka. I implemented 10+ graphics papers during this internship and developed an initial version of Taichi, an open-source computer graphics library.

utokyo

Programming Contests

Asia-Pacific Informatics Olympiad 2012, China District

China National Olympiad in Informatics 2012

ACM-ICPC Asia Changsha Regional Contest 2013, with my team

ACM-ICPC Asia Shanghai Regional Contest 2014, with my team

China National Olympiad in Informatics 2014

Gold Medal, 1st / 450

Gold Medal, 13th / 350

Gold Medal, 3rd / 200

Gold Medal, 5th / 250

Problem Setter

Hobbies

Photography, graphic design, animated films, creating and destroying everything in my physically based simulators