README.md · Lawrence Yang/3D点云学习库

# 3D Machine Learning
In recent years, tremendous amount of progress is being made in the field of 3D Machine Learning, which is an interdisciplinary field that fuses computer vision, computer graphics and machine learning. This repo is derived from my study notes and will be used as a place for triaging new research papers.

I'll use the following icons to differentiate 3D representations:
* :camera: Multi-view Images
* :space_invader: Volumetric
* :game_die: Point Cloud
* :gem: Polygonal Mesh
* :pill: Primitive-based

To find related papers and their relationships, check out [Connected Papers](https://www.connectedpapers.com/), which provides a neat way to visualize the academic field in a graph representation.

## Get Involved
To contribute to this Repo, you may add content through pull requests or open an issue to let me know.

:star: :star: :star: :star: :star: :star: :star: :star: :star: :star: :star: :star: 
We have also created a Slack workplace for people around the globe to ask questions, share knowledge and facilitate collaborations. Together, I'm sure we can advance this field as a collaborative effort. Join the community with [this link](https://join.slack.com/t/3d-machine-learning/shared_invite/enQtMzUyMTgyNzgwOTgzLTFiYTM4YWFjMTcxY2Q3YjQwMTA3ZGE2OTYwNDRlMDA5NGFmNDU5Njg4ODJhN2YwNmZkMDM4ZTllZWQzNjRjNDc).
 :star: :star: :star: :star: :star: :star: :star: :star: :star: :star: :star: :star:

## Table of Contents
- [Courses](#courses)
- [Datasets](#datasets)
  - [3D Models](#3d_models)
  - [3D Scenes](#3d_scenes)
- [3D Pose Estimation](#pose_estimation)
- [Single Object Classification](#single_classification)
- [Multiple Objects Detection](#multiple_detection)
- [Scene/Object Semantic Segmentation](#segmentation)
- [3D Geometry Synthesis/Reconstruction](#3d_synthesis)
  - [Parametric Morphable Model-based methods](#3d_synthesis_model_based)
  - [Part-based Template Learning methods](#3d_synthesis_template_based)
  - [Deep Learning Methods](#3d_synthesis_dl_based)
- [Texture/Material Analysis and Synthesis](#material_synthesis)
- [Style Learning and Transfer](#style_transfer)
- [Scene Synthesis/Reconstruction](#scene_synthesis)
- [Scene Understanding](#scene_understanding)

## Available Courses
[Stanford CS231A: Computer Vision-From 3D Reconstruction to Recognition (Winter 2018)](http://web.stanford.edu/class/cs231a/)

[UCSD CSE291-I00: Machine Learning for 3D Data (Winter 2018)](https://cse291-i.github.io/index.html)

[Stanford CS468: Machine Learning for 3D Data (Spring 2017)](http://graphics.stanford.edu/courses/cs468-17-spring/)

[MIT 6.838: Shape Analysis (Spring 2017)](http://groups.csail.mit.edu/gdpgroup/6838_spring_2017.html)

[Princeton COS 526: Advanced Computer Graphics  (Fall 2010)](https://www.cs.princeton.edu/courses/archive/fall10/cos526/syllabus.php)

[Princeton CS597: Geometric Modeling and Analysis (Fall 2003)](https://www.cs.princeton.edu/courses/archive/fall03/cs597D/)

[Geometric Deep Learning](http://geometricdeeplearning.com/)

[Paper Collection for 3D Understanding](https://www.cs.princeton.edu/courses/archive/spring15/cos598A/cos598A.html#Estimating)

[CreativeAI: Deep Learning for Graphics](http://geometry.cs.ucl.ac.uk/creativeai/)

## Datasets
To see a survey of RGBD datasets, check out Michael Firman's [collection](http://www0.cs.ucl.ac.uk/staff/M.Firman//RGBDdatasets/) as well as the associated paper, [RGBD Datasets: Past, Present and Future](https://arxiv.org/pdf/1604.00999.pdf). Point Cloud Library also has a good dataset [catalogue](http://pointclouds.org/media/).

### 3D Models
Princeton Shape Benchmark (2003) [[Link]](http://shape.cs.princeton.edu/benchmark/)
 1,814 models collected from the web in .OFF format. Used to evaluating shape-based retrieval and analysis algorithms.
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Princeton%20Shape%20Benchmark%20(2003).jpeg" />

Dataset for IKEA 3D models and aligned images (2013) [[Link]](http://ikea.csail.mit.edu/)
 759 images and 219 models including Sketchup (skp) and Wavefront (obj) files, good for pose estimation.
<img width="50%" src="http://ikea.csail.mit.edu/web_img/ikea_object.png" />

Open Surfaces: A Richly Annotated Catalog of Surface Appearance (SIGGRAPH 2013) [[Link]](http://opensurfaces.cs.cornell.edu/)
 OpenSurfaces is a large database of annotated surfaces created from real-world consumer photographs. Our annotation framework draws on crowdsourcing to segment surfaces from photos, and then annotate them with rich surface properties, including material, texture and contextual information.
<img width="50%" src="http://opensurfaces.cs.cornell.edu/static/img/teaser4-web.jpg" />

PASCAL3D+ (2014) [[Link]](http://cvgl.stanford.edu/projects/pascal3d.html)
 12 categories, on average 3k+ objects per category, for 3D object detection and pose estimation.
<img width="50%" src="http://cvgl.stanford.edu/projects/pascal3d+/pascal3d.png" />

ModelNet (2015) [[Link]](http://modelnet.cs.princeton.edu/#)
 127915 3D CAD models from 662 categories
 ModelNet10: 4899 models from 10 categories
 ModelNet40: 12311 models from 40 categories, all are uniformly orientated
<img width="50%" src="http://3dvision.princeton.edu/projects/2014/ModelNet/thumbnail.jpg" />

ShapeNet (2015) [[Link]](https://www.shapenet.org/)
 3Million+ models and 4K+ categories. A dataset that is large in scale, well organized and richly annotated.
 ShapeNetCore [[Link]](http://shapenet.cs.stanford.edu/shrec16/): 51300 models for 55 categories.
<img width="50%" src="http://msavva.github.io/files/shapenet.png" />

A Large Dataset of Object Scans (2016) [[Link]](http://redwood-data.org/3dscan/index.html)
 10K scans in RGBD + reconstructed 3D models in .PLY format.
<img width="50%" src="http://redwood-data.org/3dscan/img/teaser.jpg" />

ObjectNet3D: A Large Scale Database for 3D Object Recognition (2016) [[Link]](http://cvgl.stanford.edu/projects/objectnet3d/)
 100 categories, 90,127 images, 201,888 objects in these images and 44,147 3D shapes. 
 Tasks: region proposal generation, 2D object detection, joint 2D detection and 3D object pose estimation, and image-based 3D shape retrieval
<img width="50%" src="http://cvgl.stanford.edu/projects/objectnet3d/ObjectNet3D.png" />

Thingi10K: A Dataset of 10,000 3D-Printing Models (2016) [[Link]](https://ten-thousand-models.appspot.com/)
 10,000 models from featured “things” on thingiverse.com, suitable for testing 3D printing techniques such as structural analysis , shape optimization, or solid geometry operations.
<img width="50%" src="https://pbs.twimg.com/media/DRbxWnqXkAEEH0g.jpg:large" />

ABC: A Big CAD Model Dataset For Geometric Deep Learning [[Link]](https://cs.nyu.edu/~zhongshi/publication/abc-dataset/)[[Paper]](https://arxiv.org/abs/1812.06216)
 This work introduce a dataset for geometric deep learning consisting of over 1 million individual (and high quality) geometric models, each associated with accurate ground truth information on the decomposition into patches, explicit sharp feature annotations, and analytic differential properties. 
<img width="50%" src="https://cs.nyu.edu/~zhongshi/img/abc-dataset.png" />

:game_die: ScanObjectNN: A New Benchmark Dataset and Classification Model on Real-World Data (ICCV 2019) [[Link]](https://hkust-vgd.github.io/scanobjectnn/)
 
This work introduce ScanObjectNN, a new real-world point cloud object dataset based on scanned indoor scene data. The comprehensive benchmark in this work shows that this dataset poses great challenges to existing point cloud classification techniques as objects from real-world scans are often cluttered with background and/or are partial due to occlusions. Three key open problems for point cloud object classification are identified, and a new point cloud classification neural network that achieves state-of-the-art performance on classifying objects with cluttered background is proposed.
 
<img width="50%" src="https://hkust-vgd.github.io/scanobjectnn/images/objects_teaser.png" />

VOCASET: Speech-4D Head Scan Dataset (2019( [[Link]](https://voca.is.tue.mpg.de/)[[Paper]](https://ps.is.tuebingen.mpg.de/uploads_file/attachment/attachment/510/paper_final.pdf)
 [VOCASET](https://voca.is.tue.mpg.de/), is a 4D face dataset with about 29 minutes of 4D scans captured at 60 fps and synchronized audio. The dataset has 12 subjects and 480 sequences of about 3-4 seconds each with sentences chosen from an array of standard protocols that maximize phonetic diversity. 
<img width="50%" src="https://github.com/TimoBolkart/voca/blob/master/gif/vocaset.gif" />

3D-FUTURE: 3D FUrniture shape with TextURE (2020( [[Link]](https://tianchi.aliyun.com/specials/promotion/alibaba-3d-future?spm=5176.14208320.0.0.66293cf7asRnrR)
 [VOCASET](https://voca.is.tue.mpg.de/), contains 20,000+ clean and realistic synthetic scenes in 5,000+ diverse rooms, which include 10,000+ unique high quality 3D instances of furniture with high resolution informative textures developed by professional designers. 
<img width="50%" src="https://img.alicdn.com/tfs/TB1HTSfz4v1gK0jSZFFXXb0sXXa-1999-1037.png" />

Fusion 360 Gallery Dataset (2020) [[Link]](https://github.com/AutodeskAILab/Fusion360GalleryDataset)[[Paper]](https://arxiv.org/abs/2010.02392)
 The [Fusion 360 Gallery Dataset](https://github.com/AutodeskAILab/Fusion360GalleryDataset) contains rich 2D and 3D geometry data derived from parametric CAD models. The Reconstruction Dataset provides sequential construction sequence information from a subset of simple 'sketch and extrude' designs. The Segmentation Dataset provides a segmentation of 3D models based on the CAD modeling operation, including B-Rep format, mesh, and point cloud.
<img width="50%" src="https://raw.githubusercontent.com/AutodeskAILab/Fusion360GalleryDataset/master/docs/images/reconstruction_teaser.jpg" />
<img width="50%" src="https://raw.githubusercontent.com/AutodeskAILab/Fusion360GalleryDataset/master/docs/images/segmentation_example.jpg" />

### 3D Scenes
NYU Depth Dataset V2 (2012) [[Link]](https://cs.nyu.edu/~silberman/datasets/nyu_depth_v2.html)
 1449 densely labeled pairs of aligned RGB and depth images from Kinect video sequences for a variety of indoor scenes.
<img width="50%" src="https://cs.nyu.edu/~silberman/images/nyu_depth_v2_labeled.jpg" />

SUNRGB-D 3D Object Detection Challenge [[Link]](http://rgbd.cs.princeton.edu/challenge.html)
 19 object categories for predicting a 3D bounding box in real world dimension
 Training set: 10,355 RGB-D scene images, Testing set: 2860 RGB-D images
<img width="50%" src="http://rgbd.cs.princeton.edu/3dbox.png" />

SceneNN (2016) [[Link]](http://www.scenenn.net/)
 100+ indoor scene meshes with per-vertex and per-pixel annotation.
<img width="50%" src="https://cdn-ak.f.st-hatena.com/images/fotolife/r/robonchu/20170611/20170611155625.png" />

ScanNet (2017) [[Link]](http://www.scan-net.org/)
 An RGB-D video dataset containing 2.5 million views in more than 1500 scans, annotated with 3D camera poses, surface reconstructions, and instance-level semantic segmentations.
<img width="50%" src="http://www.scan-net.org/img/annotations.png" />

Matterport3D: Learning from RGB-D Data in Indoor Environments (2017) [[Link]](https://niessner.github.io/Matterport/)
 10,800 panoramic views (in both RGB and depth) from 194,400 RGB-D images of 90 building-scale scenes of private rooms. Instance-level semantic segmentations are provided for region (living room, kitchen) and object (sofa, TV) categories. 
<img width="50%" src="https://niessner.github.io/Matterport/teaser.png" />

SUNCG: A Large 3D Model Repository for Indoor Scenes (2017) [[Link]](http://suncg.cs.princeton.edu/)
 The dataset contains over 45K different scenes with manually created realistic room and furniture layouts. All of the scenes are semantically annotated at the object level.
<img width="50%" src="http://suncg.cs.princeton.edu/figures/data_full.png" />

MINOS: Multimodal Indoor Simulator (2017) [[Link]](https://github.com/minosworld/minos)
 MINOS is a simulator designed to support the development of multisensory models for goal-directed navigation in complex indoor environments. MINOS leverages large datasets of complex 3D environments and supports flexible configuration of multimodal sensor suites. MINOS supports SUNCG and Matterport3D scenes.
<img width="50%" src="http://vladlen.info/wp-content/uploads/2017/12/MINOS.jpg" />

Facebook House3D: A Rich and Realistic 3D Environment (2017) [[Link]](https://github.com/facebookresearch/House3D)
 House3D is a virtual 3D environment which consists of 45K indoor scenes equipped with a diverse set of scene types, layouts and objects sourced from the SUNCG dataset. All 3D objects are fully annotated with category labels. Agents in the environment have access to observations of multiple modalities, including RGB images, depth, segmentation masks and top-down 2D map views.
<img width="50%" src="https://user-images.githubusercontent.com/1381301/33509559-87c4e470-d6b7-11e7-8266-27c940d5729a.jpg" />

HoME: a Household Multimodal Environment (2017) [[Link]](https://home-platform.github.io/)
 HoME integrates over 45,000 diverse 3D house layouts based on the SUNCG dataset, a scale which may facilitate learning, generalization, and transfer. HoME is an open-source, OpenAI Gym-compatible platform extensible to tasks in reinforcement learning, language grounding, sound-based navigation, robotics, multi-agent learning.
<img width="50%" src="https://home-platform.github.io/assets/overview.png" />

AI2-THOR: Photorealistic Interactive Environments for AI Agents [[Link]](http://ai2thor.allenai.org/)
 AI2-THOR is a photo-realistic interactable framework for AI agents. There are a total 120 scenes in version 1.0 of the THOR environment covering four different room categories: kitchens, living rooms, bedrooms, and bathrooms. Each room has a number of actionable objects.
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/AI2-Thor.jpeg" />

UnrealCV: Virtual Worlds for Computer Vision (2017) [[Link]](http://unrealcv.org/)[[Paper]](http://www.idm.pku.edu.cn/staff/wangyizhou/papers/ACMMM2017_UnrealCV.pdf)
 An open source project to help computer vision researchers build virtual worlds using Unreal Engine 4.
<img width="50%" src="http://unrealcv.org/images/homepage_teaser.png" />

Gibson Environment: Real-World Perception for Embodied Agents (2018 CVPR) [[Link]](http://gibsonenv.stanford.edu/)
 This platform provides RGB from 1000 point clouds, as well as multimodal sensor data: surface normal, depth, and for a fraction of the spaces, semantics object annotations. The environment is also RL ready with physics integrated. Using such datasets can further narrow down the discrepency between virtual environment and real world.
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Gibson%20Environment-%20Real-World%20Perception%20for%20Embodied%20Agents%20(2018%20CVPR)%20.jpeg" />

InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Dataset [[Link]](https://interiornet.org/)
 System Overview: an end-to-end pipeline to render an RGB-D-inertial benchmark for large scale interior scene understanding and mapping. Our dataset contains 20M images created by pipeline: (A) We collect around 1 million CAD models provided by world-leading furniture manufacturers. These models have been used in the real-world production. (B) Based on those models, around 1,100 professional designers create around 22 million interior layouts. Most of such layouts have been used in real-world decorations. (C) For each layout, we generate a number of configurations to represent different random lightings and simulation of scene change over time in daily life. (D) We provide an interactive simulator (ViSim) to help for creating ground truth IMU, events, as well as monocular or stereo camera trajectories including hand-drawn, random walking and neural network based realistic trajectory. (E) All supported image sequences and ground truth.
<img width="50%" src="https://interiornet.org/items/InteriorNet.jpg" />

Semantic3D[[Link]](http://www.semantic3d.net/)
 Large-Scale Point Cloud Classification Benchmark, which provides a large labelled 3D point cloud data set of natural scenes with over 4 billion points in total, and also covers a range of diverse urban scenes.
<img width="50%" src="http://www.semantic3d.net/img/full_resolution/sg27_8.jpg" />

Structured3D: A Large Photo-realistic Dataset for Structured 3D Modeling [[Link]](https://structured3d-dataset.org/)
<img width="50%" src="https://structured3d-dataset.org/static/img/teaser.png" />

3D-FRONT: 3D Furnished Rooms with layOuts and semaNTics [[Link]](https://tianchi.aliyun.com/specials/promotion/alibaba-3d-scene-dataset)
 Contains 10,000 houses (or apartments) and ~70,000 rooms with layout information. 
<img width="50%" src="https://img.alicdn.com/tfs/TB131XOJeL2gK0jSZPhXXahvXXa-2992-2751.jpg" />

3ThreeDWorld(TDW): A High-Fidelity, Multi-Modal Platform for Interactive Physical Simulation [[Link]](http://www.threedworld.org/)
<img width="50%" src="http://www.threedworld.org/img/gallery/gallery-1.jpg" />

## 3D Pose Estimation
Category-Specific Object Reconstruction from a Single Image (2014) [[Paper]](https://people.eecs.berkeley.edu/~akar/categoryshapes.pdf)
<img width="50%" src="http://people.eecs.berkeley.edu/~akar/basisshapes_highres.png" />

Viewpoints and Keypoints (2015) [[Paper]](https://people.eecs.berkeley.edu/~shubhtuls/papers/cvpr15vpsKps.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Viewpoints%20and%20Keypoints.jpeg" />

Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Views (2015 ICCV) [[Paper]](https://shapenet.cs.stanford.edu/projects/RenderForCNN/)
<img width="50%" src="https://shapenet.cs.stanford.edu/projects/RenderForCNN/images/teaser.jpg" />

PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization (2015) [[Paper]](https://www.cv-foundation.org/openaccess/content_iccv_2015/papers/Kendall_PoseNet_A_Convolutional_ICCV_2015_paper.pdf)
<img width="50%" src="http://mi.eng.cam.ac.uk/projects/relocalisation/images/map.png" />

Modeling Uncertainty in Deep Learning for Camera Relocalization (2016) [[Paper]](https://arxiv.org/pdf/1509.05909.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Modeling%20Uncertainty%20in%20Deep%20Learning%20for%20Camera%20Relocalization.jpeg" />

Robust camera pose estimation by viewpoint classification using deep learning (2016) [[Paper]](https://link.springer.com/article/10.1007/s41095-016-0067-z)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Robust%20camera%20pose%20estimation%20by%20viewpoint%20classification%20using%20deep%20learning.jpeg" />

Geometric loss functions for camera pose regression with deep learning (2017 CVPR) [[Paper]](https://arxiv.org/pdf/1704.00390.pdf)
<img width="50%" src="http://mi.eng.cam.ac.uk/~cipolla/images/pose-net.png" />

Generic 3D Representation via Pose Estimation and Matching (2017) [[Paper]](http://3drepresentation.stanford.edu/)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Generic%203D%20Representation%20via%20Pose%20Estimation%20and%20Matching.jpeg" />

3D Bounding Box Estimation Using Deep Learning and Geometry (2017) [[Paper]](https://arxiv.org/pdf/1612.00496.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/3D%20Bounding%20Box%20Estimation%20Using%20Deep%20Learning%20and%20Geometry.png" />

6-DoF Object Pose from Semantic Keypoints (2017) [[Paper]](https://www.seas.upenn.edu/~pavlakos/projects/object3d/)
<img width="50%" src="https://www.seas.upenn.edu/~pavlakos/projects/object3d/files/object3d-teaser.png" />

Relative Camera Pose Estimation Using Convolutional Neural Networks (2017) [[Paper]](https://arxiv.org/pdf/1702.01381.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Relative%20Camera%20Pose%20Estimation%20Using%20Convolutional%20Neural%20Networks.png" />

3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions (2017) [[Paper]](http://3dmatch.cs.princeton.edu/)
<img width="50%" src="http://3dmatch.cs.princeton.edu/img/overview.jpg" />

Single Image 3D Interpreter Network (2016) [[Paper]](http://3dinterpreter.csail.mit.edu/) [[Code]](https://github.com/jiajunwu/3dinn)
<img width="50%" src="http://3dinterpreter.csail.mit.edu/images/spotlight_3dinn_large.jpg" />

Multi-view Consistency as Supervisory Signal for Learning Shape and Pose Prediction (2018 CVPR) [[Paper]](https://shubhtuls.github.io/mvcSnP/)
<img width="50%" src="https://shubhtuls.github.io/mvcSnP/resources/images/teaser.png" />

PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes (2018) [[Paper]](https://rse-lab.cs.washington.edu/projects/posecnn/)
<img width="50%" src="https://yuxng.github.io/PoseCNN.png" />

Feature Mapping for Learning Fast and Accurate 3D Pose Inference from Synthetic Images (2018 CVPR) [[Paper]](https://arxiv.org/pdf/1712.03904.pdf)
<img width="40%" src="https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcTnpyajEhbhrPMc0YpEQzqE8N9E7CW_EVWYA3Bxg46oUEYFf9XvkA" />

Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling (2018 CVPR) [[Paper]](http://pix3d.csail.mit.edu/)
<img width="50%" src="http://pix3d.csail.mit.edu/images/spotlight_pix3d.jpg" />

3D Pose Estimation and 3D Model Retrieval for Objects in the Wild (2018 CVPR) [[Paper]](https://arxiv.org/pdf/1803.11493.pdf)
<img width="50%" src="https://www.tugraz.at/fileadmin/user_upload/Institute/ICG/Documents/team_lepetit/images/grabner/pose_retrieval_overview.png" />

Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objects (2018) [[Paper]](https://research.nvidia.com/publication/2018-09_Deep-Object-Pose)
<img width="50%" src="https://research.nvidia.com/sites/default/files/publications/forwebsite1_0.png" />

## Single Object Classification
:space_invader: 3D ShapeNets: A Deep Representation for Volumetric Shapes (2015) [[Paper]](http://3dshapenets.cs.princeton.edu/)
<img width="50%" src="https://ai2-s2-public.s3.amazonaws.com/figures/2016-11-08/3ed23386284a5639cb3e8baaecf496caa766e335/1-Figure1-1.png" />

:space_invader: VoxNet: A 3D Convolutional Neural Network for Real-Time Object Recognition (2015) [[Paper]](http://www.dimatura.net/publications/voxnet_maturana_scherer_iros15.pdf) [[Code]](https://github.com/dimatura/voxnet)
<img width="50%" src="http://www.dimatura.net/research/voxnet/car_voxnet_side.png" />

:camera: Multi-view Convolutional Neural Networks for 3D Shape Recognition (2015) [[Paper]](http://vis-www.cs.umass.edu/mvcnn/)
<img width="50%" src="http://vis-www.cs.umass.edu/mvcnn/images/mvcnn.png" />

:camera: DeepPano: Deep Panoramic Representation for 3-D Shape Recognition (2015) [[Paper]](http://mclab.eic.hust.edu.cn/UpLoadFiles/Papers/DeepPano_SPL2015.pdf)
<img width="30%" src="https://ai2-s2-public.s3.amazonaws.com/figures/2016-11-08/5a1b5d31905d8cece7b78510f51f3d8bbb063063/1-Figure3-1.png" />

:space_invader::camera: FusionNet: 3D Object Classification Using Multiple Data Representations (2016) [[Paper]](https://stanford.edu/~rezab/papers/fusionnet.pdf)
<img width="30%" src="https://ai2-s2-public.s3.amazonaws.com/figures/2016-11-08/0aab8fbcef1f0a14f5653d170ca36f4e5aae8010/6-Figure5-1.png" />

:space_invader::camera: Volumetric and Multi-View CNNs for Object Classification on 3D Data (2016) [[Paper]](https://arxiv.org/pdf/1604.03265.pdf) [[Code]](https://github.com/charlesq34/3dcnn.torch)
<img width="40%" src="http://graphics.stanford.edu/projects/3dcnn/teaser.jpg" />

:space_invader: Generative and Discriminative Voxel Modeling with Convolutional Neural Networks (2016) [[Paper]](https://arxiv.org/pdf/1608.04236.pdf) [[Code]](https://github.com/ajbrock/Generative-and-Discriminative-Voxel-Modeling)
<img width="50%" src="http://davidstutz.de/wordpress/wp-content/uploads/2017/02/brock_vae.png" />

:gem: Geometric deep learning on graphs and manifolds using mixture model CNNs (2016) [[Link]](https://arxiv.org/pdf/1611.08402.pdf)
<img width="50%" src="https://i2.wp.com/preferredresearch.jp/wp-content/uploads/2017/08/monet.png?resize=581%2C155&ssl=1" />

:space_invader: 3D GAN: Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling (2016) [[Paper]](https://arxiv.org/pdf/1610.07584.pdf) [[Code]](https://github.com/zck119/3dgan-release)
<img width="50%" src="http://3dgan.csail.mit.edu/images/model.jpg" />

:space_invader: Generative and Discriminative Voxel Modeling with Convolutional Neural Networks (2017) [[Paper]](https://github.com/ajbrock/Generative-and-Discriminative-Voxel-Modeling)
<img width="50%" src="https://github.com/ajbrock/Generative-and-Discriminative-Voxel-Modeling/blob/master/doc/GUI3.png" />

:space_invader: FPNN: Field Probing Neural Networks for 3D Data (2016) [[Paper]](http://yangyanli.github.io/FPNN/) [[Code]](https://github.com/yangyanli/FPNN)
<img width="30%" src="https://ai2-s2-public.s3.amazonaws.com/figures/2016-11-08/15ca7adccf5cd4dc309cdcaa6328f4c429ead337/1-Figure2-1.png" />

:space_invader: OctNet: Learning Deep 3D Representations at High Resolutions (2017) [[Paper]](https://arxiv.org/pdf/1611.05009.pdf) [[Code]](https://github.com/griegler/octnet)
<img width="30%" src="https://is.tuebingen.mpg.de/uploads/publication/image/18921/img03.png" />

:space_invader: O-CNN: Octree-based Convolutional Neural Networks for 3D Shape Analysis (2017) [[Paper]](http://wang-ps.github.io/O-CNN) [[Code]](https://github.com/Microsoft/O-CNN)
<img width="50%" src="http://wang-ps.github.io/O-CNN_files/teaser.png" />

:space_invader: Orientation-boosted voxel nets for 3D object recognition (2017) [[Paper]](https://lmb.informatik.uni-freiburg.de/Publications/2017/SZB17a/) [[Code]](https://github.com/lmb-freiburg/orion)
<img width="50%" src="https://lmb.informatik.uni-freiburg.de/Publications/2017/SZB17a/teaser_w.png" />

:game_die: PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation (2017) [[Paper]](http://stanford.edu/~rqi/pointnet/) [[Code]](https://github.com/charlesq34/pointnet)
<img width="40%" src="https://web.stanford.edu/~rqi/papers/pointnet.png" />

:game_die: PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space (2017) [[Paper]](https://arxiv.org/pdf/1706.02413.pdf) [[Code]](https://github.com/charlesq34/pointnet2)
<img width="40%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/PointNet%2B%2B-%20Deep%20Hierarchical%20Feature%20Learning%20on%20Point%20Sets%20in%20a%20Metric%20Space.png" />

:camera: Feedback Networks (2017) [[Paper]](http://feedbacknet.stanford.edu/) [[Code]](https://github.com/amir32002/feedback-networks)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Feedback%20Networks.png" />

:game_die: Escape from Cells: Deep Kd-Networks for The Recognition of 3D Point Cloud Models (2017) [[Paper]](http://www.arxiv.org/pdf/1704.01222.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Escape From Cells.png" />

:game_die: Dynamic Graph CNN for Learning on Point Clouds (2018) [[Paper]](https://arxiv.org/pdf/1801.07829.pdf)
<img width="50%" src="https://liuziwei7.github.io/homepage_files/dynamicgcnn_logo.png" />

:game_die: PointCNN (2018) [[Paper]](https://yangyanli.github.io/PointCNN/)
<img width="50%" src="http://yangyan.li/images/paper/pointcnn.png" />

:game_die::camera: A Network Architecture for Point Cloud Classification via Automatic Depth Images Generation (2018 CVPR) [[Paper]](http://openaccess.thecvf.com/content_cvpr_2018/papers/Roveri_A_Network_Architecture_CVPR_2018_paper.pdf)
<img width="50%" src="https://s3-us-west-1.amazonaws.com/disneyresearch/wp-content/uploads/20180619114732/A-Network-Architecture-for-Point-Cloud-Classification-via-Automatic-Depth-Images-Generation-Image-600x317.jpg" />

:game_die::space_invader: PointGrid: A Deep Network for 3D Shape Understanding (CVPR 2018) [[Paper]](http://openaccess.thecvf.com/content_cvpr_2018/papers/Le_PointGrid_A_Deep_CVPR_2018_paper.pdf) [[Code]](https://github.com/trucleduc/PointGrid)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/PointGrid-%20A%20Deep%20Network%20for%203D%20Shape%20Understanding%20(2018).jpeg" />

:gem: MeshNet: Mesh Neural Network for 3D Shape Representation (AAAI 2019) [[Paper]](https://arxiv.org/pdf/1811.11424.pdf) [[Code]](https://github.com/Yue-Group/MeshNet)
<img width="50%" src="http://www.gaoyue.org/en_tsinghua/resrc/meshnet.jpg" />

:game_die: SpiderCNN (2018) [[Paper]](https://github.com/xyf513/SpiderCNN)[[Code]](https://github.com/xyf513/SpiderCNN)
<img width="50%" src="http://5b0988e595225.cdn.sohucs.com/images/20181109/45c3b670e67f43b288791c650fb7fb0b.jpeg" />

:game_die: PointConv (2018) [[Paper]](https://github.com/DylanWusee/pointconv/tree/master/imgs)[[Code]](https://github.com/DylanWusee/pointconv/tree/master/imgs)
<img width="50%" src="https://pics4.baidu.com/feed/8b82b9014a90f603272fe29f88ef061fb251ed49.jpeg?token=b23e1dbbaeaf12ffe3d168bd997a8d66&s=01307D328FE07C010C69C1CE0000D0B3" />

:gem: MeshCNN (SIGGRAPH 2019) [[Paper]](https://bit.ly/meshcnn)[[Code]](https://github.com/ranahanocka/MeshCNN)
<img width="50%" src="https://github.com/ranahanocka/MeshCNN/blob/master/docs/imgs/alien.gif?raw=true" />

:game_die: SampleNet: Differentiable Point Cloud Sampling (CVPR 2020) [[Paper]](http://openaccess.thecvf.com/content_CVPR_2020/papers/Lang_SampleNet_Differentiable_Point_Cloud_Sampling_CVPR_2020_paper.pdf) [[Code]](https://github.com/itailang/SampleNet)
<img width="50%" src="https://github.com/itailang/SampleNet/blob/master/doc/teaser.png" />

## Multiple Objects Detection
Sliding Shapes for 3D Object Detection in Depth Images (2014) [[Paper]](http://slidingshapes.cs.princeton.edu/)
<img width="50%" src="http://slidingshapes.cs.princeton.edu/teaser.jpg" />

Object Detection in 3D Scenes Using CNNs in Multi-view Images (2016) [[Paper]](https://stanford.edu/class/ee367/Winter2016/Qi_Report.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Object%20Detection%20in%203D%20Scenes%20Using%20CNNs%20in%20Multi-view%20Images.png" />

Deep Sliding Shapes for Amodal 3D Object Detection in RGB-D Images (2016) [[Paper]](http://dss.cs.princeton.edu/) [[Code]](https://github.com/shurans/DeepSlidingShape)
<img width="50%" src="http://3dvision.princeton.edu/slide/DSS.jpg" />

Three-Dimensional Object Detection and Layout Prediction using Clouds of Oriented Gradients (2016) [[CVPR '16 Paper]](https://www.cv-foundation.org/openaccess/content_cvpr_2016/papers/Ren_Three-Dimensional_Object_Detection_CVPR_2016_paper.pdf) [[CVPR '18 Paper]](http://openaccess.thecvf.com/content_cvpr_2018/papers/Ren_3D_Object_Detection_CVPR_2018_paper.pdf) [[T-PAMI '19 Paper]](https://arxiv.org/pdf/1906.04725) 
<img width="50%" src="https://github.com/luvegood/3D-Machine-Learning/blob/master/imgs/Three-Dimensional%20Object%20Detection%20and%20Layout%20Prediction%20using%20Clouds%20of%20Oriented%20Gradients.png" />

DeepContext: Context-Encoding Neural Pathways for 3D Holistic Scene Understanding (2016) [[Paper]](http://deepcontext.cs.princeton.edu/)
<img width="50%" src="http://deepcontext.cs.princeton.edu/teaser.png" />

SUN RGB-D: A RGB-D Scene Understanding Benchmark Suite (2017) [[Paper]](http://rgbd.cs.princeton.edu/)
<img width="50%" src="http://rgbd.cs.princeton.edu/teaser.jpg" />

VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection (2017) [[Paper]](https://arxiv.org/pdf/1711.06396.pdf)
<img width="50%" src="https://pbs.twimg.com/media/DPMtLhHXUAcQUj2.jpg" />

Frustum PointNets for 3D Object Detection from RGB-D Data (CVPR2018) [[Paper]](https://arxiv.org/pdf/1711.08488.pdf)

A^2-Net: Molecular Structure Estimation from Cryo-EM Density Volumes (AAAI2019) [[Paper]](https://arxiv.org/abs/1901.00785)

Stereo R-CNN based 3D Object Detection for Autonomous Driving (CVPR2019) [[Paper]](https://arxiv.org/abs/1902.09738v1)

Deep Hough Voting for 3D Object Detection in Point Clouds (ICCV2019) [[Paper]](https://arxiv.org/pdf/1904.09664.pdf) [[code]](https://github.com/facebookresearch/votenet)
<img width="50%" src="https://github.com/facebookresearch/votenet/blob/master/doc/teaser.jpg" />

## Scene/Object Semantic Segmentation
Learning 3D Mesh Segmentation and Labeling (2010) [[Paper]](https://people.cs.umass.edu/~kalo/papers/LabelMeshes/LabelMeshes.pdf)
<img width="50%" src="https://ai2-s2-public.s3.amazonaws.com/figures/2016-11-08/0bf390e2a14f74bcc8838d5fb1c0c4cc60e92eb7/7-Figure7-1.png" />

Unsupervised Co-Segmentation of a Set of Shapes via Descriptor-Space Spectral Clustering (2011) [[Paper]](https://www.cs.sfu.ca/~haoz/pubs/sidi_siga11_coseg.pdf)
<img width="30%" src="http://people.scs.carleton.ca/~olivervankaick/cosegmentation/results6.png" />

Single-View Reconstruction via Joint Analysis of Image and Shape Collections (2015) [[Paper]](https://www.cs.utexas.edu/~huangqx/modeling_sig15.pdf) [[Code]](https://github.com/huangqx/image_shape_align)
<img width="50%" src="http://vladlen.info/wp-content/uploads/2015/05/single-view.png" />

3D Shape Segmentation with Projective Convolutional Networks (2017) [[Paper]](http://people.cs.umass.edu/~kalo/papers/shapepfcn/) [[Code]](https://github.com/kalov/ShapePFCN)
<img width="50%" src="http://people.cs.umass.edu/~kalo/papers/shapepfcn/teaser.jpg" />

Learning Hierarchical Shape Segmentation and Labeling from Online Repositories (2017) [[Paper]](http://cs.stanford.edu/~ericyi/project_page/hier_seg/index.html)
<img width="50%" src="http://cs.stanford.edu/~ericyi/project_page/hier_seg/figures/teaser.jpg" />

:space_invader: ScanNet (2017) [[Paper]](https://arxiv.org/pdf/1702.04405.pdf) [[Code]](https://github.com/scannet/scannet)
<img width="50%" src="http://www.scan-net.org/img/voxel-predictions.jpg" />

:game_die: 3D Graph Neural Networks for RGBD Semantic Segmentation (2017) [[Paper]](http://www.cs.toronto.edu/~rjliao/papers/iccv_2017_3DGNN.pdf)
<img width="40%" src="http://www.fonow.com/Images/2017-10-18/66372-20171018115809740-2125227250.jpg" />

:game_die: 3DCNN-DQN-RNN: A Deep Reinforcement Learning Framework for Semantic
Parsing of Large-scale 3D Point Clouds (2017) [[Paper]](https://arxiv.org/pdf/1707.06783.pdf)
<img width="40%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/3DCNN-DQN-RNN.png" />

:game_die::space_invader: Semantic Segmentation of Indoor Point Clouds using Convolutional Neural Networks (2017) [[Paper]](https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/IV-4-W4/101/2017/isprs-annals-IV-4-W4-101-2017.pdf)
<img width="55%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Semantic Segmentation of Indoor Point Clouds using Convolutional Neural Networks.png" />

:game_die::space_invader: SEGCloud: Semantic Segmentation of 3D Point Clouds (2017) [[Paper]](https://arxiv.org/pdf/1710.07563.pdf)
<img width="55%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/SEGCloud.png" />

:game_die::space_invader: Large-Scale 3D Shape Reconstruction and Segmentation from ShapeNet Core55 (2017) [[Paper]](https://arxiv.org/pdf/1710.06104.pdf)
<img width="40%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Core55.png" />

:game_die: Pointwise Convolutional Neural Networks (CVPR 2018) [[Link]](http://pointwise.scenenn.net/)
 
We propose pointwise convolution that performs on-the-fly voxelization for learning local features of a point cloud.
<img width="50%" src="http://pointwise.scenenn.net/images/teaser.png" />

:game_die: PointCNN (2018) [[Paper]](https://yangyanli.github.io/PointCNN/)
<img width="50%" src="http://yangyan.li/images/paper/pointcnn.png" />

:camera::space_invader: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation (2018) [[Paper]](https://arxiv.org/pdf/1803.10409.pdf)
<img width="50%" src="https://github.com/angeladai/3DMV/blob/master/images/teaser.jpg" />

:space_invader: ScanComplete: Large-Scale Scene Completion and Semantic Segmentation for 3D Scans (2018) [[Paper]](https://arxiv.org/pdf/1712.10215.pdf) 
<img width="50%" src="https://github.com/angeladai/ScanComplete/blob/master/images/teaser_mesh.jpg" />

:game_die::camera: SPLATNet: Sparse Lattice Networks for Point Cloud Processing (2018) [[Paper]](https://arxiv.org/pdf/1802.08275.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/SPLATNet-%20Sparse%20Lattice%20Networks%20for%20Point%20Cloud%20Processing.jpeg" />

:space_invader: 3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans (CVPR 2019) [[Paper]](https://arxiv.org/pdf/1812.07003.pdf)[[Code]](https://github.com/Sekunde/3D-SIS)
<img width="50%" src="http://www.niessnerlab.org/papers/2019/6sis/teaser.jpg" />

:game_die: Real-time Progressive 3D Semantic Segmentation for Indoor Scenes (WACV 2019) [[Link]](https://pqhieu.github.io/research/proseg/)
 
We propose an efficient yet robust technique for on-the-fly dense reconstruction and semantic segmentation of 3D indoor scenes. Our method is built atop an efficient super-voxel clustering method and a conditional random field with higher-order constraints from structural and object cues, enabling progressive dense semantic segmentation without any precomputation.
<img width="50%" src="https://pqhieu.github.io/media/images/wacv19/thumbnail.gif" />

:game_die: JSIS3D: Joint Semantic-Instance Segmentation of 3D Point Clouds (CVPR 2019) [[Link]](https://pqhieu.github.io/research/jsis3d/)
 
We jointly address the problems of semantic and instance segmentation of 3D point clouds with a multi-task pointwise network that simultaneously performs two tasks: predicting the semantic classes of 3D points and embedding the points into high-dimensional vectors so that points of the same object instance are represented by similar embeddings. We then propose a multi-value conditional random field model to incorporate the semantic and instance labels and formulate the problem of semantic and instance segmentation as jointly optimising labels in the field model.
<img width="50%" src="./imgs/jsis3d.png" />

:game_die: ShellNet: Efficient Point Cloud Convolutional Neural Networks using Concentric Shells Statistics (ICCV 2019) [[Link]](https://hkust-vgd.github.io/shellnet/)
 
We propose an efficient end-to-end permutation invariant convolution for point cloud deep learning. We use statistics from concentric spherical shells to define representative features and resolve the point order ambiguity, allowing traditional convolution to perform efficiently on such features. 
<img width="50%" src="https://hkust-vgd.github.io/shellnet/images/shellconv_new.png" />

:game_die: Rotation Invariant Convolutions for 3D Point Clouds Deep Learning (3DV 2019) [[Link]](https://hkust-vgd.github.io/riconv/)
 
We introduce a novel convolution operator for point clouds that achieves rotation invariance. Our core idea is to use low-level rotation invariant geometric features such as distances and angles to design a convolution operator for point cloud learning. 
<img width="50%" src="https://hkust-vgd.github.io/riconv/images/RIO_cam.png" />

## 3D Model Synthesis/Reconstruction

_Parametric Morphable Model-based methods_

A Morphable Model For The Synthesis Of 3D Faces (1999) [[Paper]](http://gravis.dmi.unibas.ch/publications/Sigg99/morphmod2.pdf)[[Code]](https://github.com/MichaelMure/3DMM)
<img width="40%" src="http://mblogthumb3.phinf.naver.net/MjAxNzAzMTdfMjcz/MDAxNDg5NzE3MzU0ODI3.9lQioLxwoGmtoIVXX9sbVOzhezoqgKMKiTovBnbUFN0g.sXN5tG4Kohgk7OJEtPnux-mv7OAoXVxxCyo3SGZMc6Yg.PNG.atelierjpro/031717_0222_DataDrivenS4.png?type=w420" />

FLAME: Faces Learned with an Articulated Model and Expressions (2017) [[Paper]](https://ps.is.tuebingen.mpg.de/uploads_file/attachment/attachment/400/paper.pdf)[[Code (Chumpy)]](https://github.com/Rubikplayer/flame-fitting)[[Code (TF)]](https://github.com/TimoBolkart/TF_FLAME) [[Code (PyTorch)]](https://github.com/HavenFeng/photometric_optimization)
 [FLAME](http://flame.is.tue.mpg.de/) is a lightweight and expressive generic head model learned from over 33,000 of accurately aligned 3D scans. The model combines a linear identity shape space (trained from 3800 scans of human heads) with an articulated neck, jaw, and eyeballs, pose-dependent corrective blendshapes, and additional global expression blendshapes.
The code demonstrates how to 1) reconstruct textured 3D faces from images, 2) fit the model to 3D landmarks or registered 3D meshes, or 3) generate 3D face templates for [speech-driven facial animation](https://github.com/TimoBolkart/voca).
 <img width="50%" src="https://github.com/TimoBolkart/TF_FLAME/blob/master/gifs/model_variations.gif">

The Space of Human Body Shapes: Reconstruction and Parameterization from Range Scans (2003) [[Paper]](http://grail.cs.washington.edu/projects/digital-human/pub/allen03space-submit.pdf)
<img width="50%" src="https://ai2-s2-public.s3.amazonaws.com/figures/2016-11-08/46d39b0e21ae956e4bcb7a789f92be480d45ee12/7-Figure10-1.png" />

SMPL-X: Expressive Body Capture: 3D Hands, Face, and Body from a Single Image (2019) [[Paper]](https://ps.is.tuebingen.mpg.de/uploads_file/attachment/attachment/497/SMPL-X.pdf)[[Video]](https://youtu.be/XyXIEmapWkw)[[Code]](https://github.com/vchoutas/smplify-x)
 <img width="50%" src="https://github.com/vchoutas/smplify-x/blob/master/images/teaser_fig.png">

ExPose: Monocular Expressive Body Regression through Body-Driven Attention (2020) [[Paper]](https://ps.is.tuebingen.mpg.de/uploads_file/attachment/attachment/620/0983.pdf)[[Video]](https://youtu.be/lNTmHLYTiB8)[[Code]](https://github.com/vchoutas/expose)
 <img width="50%" src="https://github.com/vchoutas/expose/blob/master/images/expose.png">

Category-Specific Object Reconstruction from a Single Image (2014) [[Paper]](https://people.eecs.berkeley.edu/~akar/categoryshapes.pdf)
<img width="50%" src="http://people.eecs.berkeley.edu/~akar/categoryShapes/images/teaser.png" />

:game_die: DeformNet: Free-Form Deformation Network for 3D Shape Reconstruction from a Single Image (2017) [[Paper]](http://ai.stanford.edu/~haosu/papers/SI2PC_arxiv_submit.pdf)
<img width="50%" src="https://chrischoy.github.io/images/publication/deformnet/model.png" />

:gem: Mesh-based Autoencoders for Localized Deformation Component Analysis (2017) [[Paper]](https://arxiv.org/pdf/1709.04304.pdf)
<img width="50%" src="http://qytan.com/img/point_conv.jpg" />

:gem: Exploring Generative 3D Shapes Using Autoencoder Networks (Autodesk 2017) [[Paper]](https://www.autodeskresearch.com/publications/exploring_generative_3d_shapes)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Exploring%20Generative%203D%20Shapes%20Using%20Autoencoder%20Networks.jpeg" />

:gem: Using Locally Corresponding CAD Models for
Dense 3D Reconstructions from a Single Image (2017) [[Paper]](http://ci2cv.net/media/papers/chenkong_cvpr_2017.pdf)
<img width="50%" src="https://chenhsuanlin.bitbucket.io/images/rp/r02.png" />

:gem: Compact Model Representation for 3D Reconstruction (2017) [[Paper]](https://jhonykaesemodel.com/publication/3dv2017/)
<img width="50%" src="https://jhonykaesemodel.com/img/headers/overview.png" />

:gem: Image2Mesh: A Learning Framework for Single Image 3D Reconstruction (2017) [[Paper]](https://arxiv.org/pdf/1711.10669.pdf)
<img width="50%" src="https://pbs.twimg.com/media/DW5VhjpW4AAESHO.jpg" />

:gem: Learning free-form deformations for 3D object reconstruction (2018) [[Paper]](https://jhonykaesemodel.com/publication/learning_ffd/)
<img width="50%" src="https://jhonykaesemodel.com/learning_ffd_overview.png" />

:gem: Variational Autoencoders for Deforming 3D Mesh Models(2018 CVPR) [[Paper]](http://qytan.com/publication/vae/)
<img width="50%" src="http://humanmotion.ict.ac.cn/papers/2018P5_VariationalAutoencoders/TeaserImage.jpg" />

:gem: Lions and Tigers and Bears: Capturing Non-Rigid, 3D, Articulated Shape from Images (2018 CVPR) [[Paper]](http://files.is.tue.mpg.de/black/papers/zuffiCVPR2018.pdf)
<img width="50%" src="https://3c1703fe8d.site.internapcdn.net/newman/gfx/news/hires/2018/realisticava.jpg" />

_Part-based Template Learning methods_

Modeling by Example (2004) [[Paper]](http://www.cs.princeton.edu/~funk/sig04a.pdf)
<img width="20%" src="http://gfx.cs.princeton.edu/pubs/Funkhouser_2004_MBE/chair.jpg" />

Model Composition from Interchangeable Components (2007) [[Paper]](http://www.cs.princeton.edu/courses/archive/spring11/cos598A/pdfs/Kraevoy07.pdf)
<img width="40%" src="http://www.cs.ubc.ca/labs/imager/tr/2007/Vlad_Shuffler/teaser.jpg" />

Data-Driven Suggestions for Creativity Support in 3D Modeling (2010) [[Paper]](http://vladlen.info/publications/data-driven-suggestions-for-creativity-support-in-3d-modeling/)
<img width="50%" src="http://vladlen.info/wp-content/uploads/2011/12/creativity.png" />

Photo-Inspired Model-Driven 3D Object Modeling (2011) [[Paper]](http://kevinkaixu.net/projects/photo-inspired.html)
<img width="50%" src="http://kevinkaixu.net/projects/photo-inspired/overview.PNG" />

Probabilistic Reasoning for Assembly-Based 3D Modeling (2011) [[Paper]](https://people.cs.umass.edu/~kalo/papers/assembly/ProbReasoningShapeModeling.pdf)
<img width="50%" src="http://vladlen.info/wp-content/uploads/2011/12/highlight9.png" />

A Probabilistic Model for Component-Based Shape Synthesis (2012) [[Paper]](https://people.cs.umass.edu/~kalo/papers/ShapeSynthesis/ShapeSynthesis.pdf)
<img width="50%" src="https://github.com/timzhang642/test1/blob/master/imgs/A%20Probabilistic%20Model%20for%20Component-Based%20Shape%20Synthesis.png" />

Structure Recovery by Part Assembly (2012) [[Paper]](http://cg.cs.tsinghua.edu.cn/StructureRecovery/)
<img width="50%" src="https://github.com/timzhang642/test1/blob/master/imgs/Structure%20Recovery%20by%20Part%20Assembly.png" />

Fit and Diverse: Set Evolution for Inspiring 3D Shape Galleries (2012) [[Paper]](http://kevinkaixu.net/projects/civil.html)
<img width="50%" src="http://kevinkaixu.net/projects/civil/teaser.png" />

AttribIt: Content Creation with Semantic Attributes (2013) [[Paper]](https://people.cs.umass.edu/~kalo/papers/attribit/AttribIt.pdf)
<img width="30%" src="http://gfx.cs.princeton.edu/gfx/pubs/Chaudhuri_2013_ACC/teaser.jpg" />

Learning Part-based Templates from Large Collections of 3D Shapes (2013) [[Paper]](http://shape.cs.princeton.edu/vkcorrs/papers/13_SIGGRAPH_CorrsTmplt.pdf)
<img width="50%" src="https://github.com/timzhang642/test1/blob/master/imgs/Learning%20Part-based%20Templates%20from%20Large%20Collections%20of%203D%20Shapes.png" />

Topology-Varying 3D Shape Creation via Structural Blending (2014) [[Paper]](http://gruvi.cs.sfu.ca/project/topo/)
<img width="50%" src="https://i.ytimg.com/vi/Xc4qf7v6a-w/maxresdefault.jpg" />

Estimating Image Depth using Shape Collections (2014) [[Paper]](http://vecg.cs.ucl.ac.uk/Projects/SmartGeometry/image_shape_net/imageShapeNet_sigg14.html)
<img width="50%" src="http://vecg.cs.ucl.ac.uk/Projects/SmartGeometry/image_shape_net/paper_docs/pipeline.jpg" />

Single-View Reconstruction via Joint Analysis of Image and Shape Collections (2015) [[Paper]](https://www.cs.utexas.edu/~huangqx/modeling_sig15.pdf)
<img width="50%" src="http://vladlen.info/wp-content/uploads/2015/05/single-view.png" />

Interchangeable Components for Hands-On Assembly Based Modeling (2016) [[Paper]](http://www.cs.umb.edu/~craigyu/papers/handson_low_res.pdf)
<img width="30%" src="https://github.com/timzhang642/test1/blob/master/imgs/Interchangeable%20Components%20for%20Hands-On%20Assembly%20Based%20Modeling.png" />

Shape Completion from a Single RGBD Image (2016) [[Paper]](http://www.kunzhou.net/2016/shapecompletion-tvcg16.pdf)
<img width="40%" src="http://tianjiashao.com/Images/2015/completion.jpg" />

_Deep Learning Methods_

:camera: Learning to Generate Chairs, Tables and Cars with Convolutional Networks (2014) [[Paper]](https://arxiv.org/pdf/1411.5928.pdf)
<img width="50%" src="https://zo7.github.io/img/2016-09-25-generating-faces/chairs-model.png" />

:camera: Weakly-supervised Disentangling with Recurrent Transformations for 3D View Synthesis (2015, NIPS) [[Paper]](https://papers.nips.cc/paper/5639-weakly-supervised-disentangling-with-recurrent-transformations-for-3d-view-synthesis.pdf)
<img width="50%" src="https://github.com/jimeiyang/deepRotator/blob/master/demo_img.png" />

:game_die: Analysis and synthesis of 3D shape families via deep-learned generative models of surfaces (2015) [[Paper]](https://people.cs.umass.edu/~hbhuang/publications/bsm/)
<img width="50%" src="https://people.cs.umass.edu/~hbhuang/publications/bsm/bsm_teaser.jpg" />

:camera: Weakly-supervised Disentangling with Recurrent Transformations for 3D View Synthesis (2015) [[Paper]](https://papers.nips.cc/paper/5639-weakly-supervised-disentangling-with-recurrent-transformations-for-3d-view-synthesis.pdf) [[Code]](https://github.com/jimeiyang/deepRotator)
<img width="50%" src="https://ai2-s2-public.s3.amazonaws.com/figures/2016-11-08/042993c46294a542946c9c1706b7b22deb1d7c43/2-Figure1-1.png" />

:camera: Multi-view 3D Models from Single Images with a Convolutional Network (2016) [[Paper]](https://arxiv.org/pdf/1511.06702.pdf) [[Code]](https://github.com/lmb-freiburg/mv3d)
<img width="50%" src="https://ai2-s2-public.s3.amazonaws.com/figures/2016-11-08/3d7ca5ad34f23a5fab16e73e287d1a059dc7ef9a/4-Figure2-1.png" />

:camera: View Synthesis by Appearance Flow (2016) [[Paper]](https://people.eecs.berkeley.edu/~tinghuiz/papers/eccv16_appflow.pdf) [[Code]](https://github.com/tinghuiz/appearance-flow)
<img width="50%" src="https://ai2-s2-public.s3.amazonaws.com/figures/2016-11-08/12280506dc8b5c3ca2db29fc3be694d9a8bef48c/6-Figure2-1.png" />

:space_invader: Voxlets: Structured Prediction of Unobserved Voxels From a Single Depth Image (2016) [[Paper]](http://visual.cs.ucl.ac.uk/pubs/depthPrediction/http://visual.cs.ucl.ac.uk/pubs/depthPrediction/) [[Code]](https://github.com/mdfirman/voxlets)
<img width="30%" src="https://i.ytimg.com/vi/1wy4y2GWD5o/maxresdefault.jpg" />

:space_invader: 3D-R2N2: 3D Recurrent Reconstruction Neural Network (2016) [[Paper]](http://cvgl.stanford.edu/3d-r2n2/) [[Code]](https://github.com/chrischoy/3D-R2N2)
<img width="50%" src="http://3d-r2n2.stanford.edu/imgs/overview.png" />

:space_invader: Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervision (2016) [[Paper]](https://eng.ucmerced.edu/people/jyang44/papers/nips16_ptn.pdf)
<img width="70%" src="https://sites.google.com/site/skywalkeryxc/_/rsrc/1481104596238/perspective_transformer_nets/network_arch.png" />

:space_invader: TL-Embedding Network: Learning a Predictable and Generative Vector Representation for Objects (2016) [[Paper]](https://arxiv.org/pdf/1603.08637.pdf)
<img width="50%" src="https://rohitgirdhar.github.io/GenerativePredictableVoxels/assets/webteaser.jpg" />

:space_invader: 3D GAN: Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling (2016) [[Paper]](https://arxiv.org/pdf/1610.07584.pdf)
<img width="50%" src="http://3dgan.csail.mit.edu/images/model.jpg" />

:space_invader: 3D Shape Induction from 2D Views of Multiple Objects (2016) [[Paper]](https://arxiv.org/pdf/1612.05872.pdf)
<img width="50%" src="https://ai2-s2-public.s3.amazonaws.com/figures/2016-11-08/e78572eeef8b967dec420013c65a6684487c13b2/2-Figure2-1.png" />

:camera: Unsupervised Learning of 3D Structure from Images (2016) [[Paper]](https://arxiv.org/pdf/1607.00662.pdf)
<img width="50%" src="https://adriancolyer.files.wordpress.com/2016/12/unsupervised-3d-fig-10.jpeg?w=600" />

:camera: Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistency (2017) [[Paper]](https://shubhtuls.github.io/drc/)
<img width="50%" src="https://shubhtuls.github.io/drc/resources/images/teaserChair.png" />

:camera: Synthesizing 3D Shapes via Modeling Multi-View Depth Maps and Silhouettes with Deep Generative Networks (2017) [[Paper]](http://openaccess.thecvf.com/content_cvpr_2017/papers/Soltani_Synthesizing_3D_Shapes_CVPR_2017_paper.pdf) [[Code]](https://github.com/Amir-Arsalan/Synthesize3DviaDepthOrSil)
<img width="50%" src="https://jiajunwu.com/images/spotlight_3dvae.jpg" />

:space_invader: Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis (2017) [[Paper]](https://arxiv.org/pdf/1612.00101.pdf) [[Code]](https://github.com/angeladai/cnncomplete)
<img width="50%" src="http://graphics.stanford.edu/projects/cnncomplete/teaser.jpg" />

:space_invader: Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputs (2017) [[Paper]](https://arxiv.org/pdf/1703.09438.pdf) [[Code]](https://github.com/lmb-freiburg/ogn)
<img width="50%" src="https://ai2-s2-public.s3.amazonaws.com/figures/2016-11-08/6c2a292bb018a8742cbb0bbc5e23dd0a454ffe3a/2-Figure2-1.png" />

:space_invader: Hierarchical Surface Prediction for 3D Object Reconstruction (2017) [[Paper]](https://arxiv.org/pdf/1704.00710.pdf)
<img width="50%" src="http://bair.berkeley.edu/blog/assets/hsp/image_2.png" />

:space_invader: OctNetFusion: Learning Depth Fusion from Data (2017) [[Paper]](https://arxiv.org/pdf/1704.01047.pdf) [[Code]](https://github.com/griegler/octnetfusion)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/OctNetFusion-%20Learning%20Depth%20Fusion%20from%20Data.jpeg" />

:game_die: A Point Set Generation Network for 3D Object Reconstruction from a Single Image (2017) [[Paper]](http://ai.stanford.edu/~haosu/papers/SI2PC_arxiv_submit.pdf) [[Code]](https://github.com/fanhqme/PointSetGeneration)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/A%20Point%20Set%20Generation%20Network%20for%203D%20Object%20Reconstruction%20from%20a%20Single%20Image%20(2017).jpeg" />

:game_die: Learning Representations and Generative Models for 3D Point Clouds (2017) [[Paper]](https://arxiv.org/pdf/1707.02392.pdf) [[Code]](https://github.com/optas/latent_3d_points)
<img width="50%" src="https://github.com/optas/latent_3d_points/blob/master/doc/images/teaser.jpg" />

:game_die: Shape Generation using Spatially Partitioned Point Clouds (2017) [[Paper]](https://arxiv.org/pdf/1707.06267.pdf)
<img width="50%" src="http://mgadelha.me/sppc/fig/abstract.png" />

:game_die: PCPNET Learning Local Shape Properties from Raw Point Clouds (2017) [[Paper]](https://arxiv.org/pdf/1710.04954.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/PCPNET%20Learning%20Local%20Shape%20Properties%20from%20Raw%20Point%20Clouds%20(2017).jpeg" />

:camera: Transformation-Grounded Image Generation Network for Novel 3D View Synthesis (2017) [[Paper]](http://www.cs.unc.edu/~eunbyung/tvsn/) [[Code]](https://github.com/silverbottlep/tvsn)
<img width="50%" src="https://eng.ucmerced.edu/people/jyang44/pics/view_synthesis.gif" />

:camera: Tag Disentangled Generative Adversarial Networks for Object Image Re-rendering (2017) [[Paper]](http://static.ijcai.org/proceedings-2017/0404.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Tag%20Disentangled%20Generative%20Adversarial%20Networks%20for%20Object%20Image%20Re-rendering.jpeg" />

:camera: 3D Shape Reconstruction from Sketches via Multi-view Convolutional Networks (2017) [[Paper]](http://people.cs.umass.edu/~zlun/papers/SketchModeling/) [[Code]](https://github.com/happylun/SketchModeling)
<img width="50%" src="https://people.cs.umass.edu/~zlun/papers/SketchModeling/SketchModeling_teaser.png" />

:space_invader: Interactive 3D Modeling with a Generative Adversarial Network (2017) [[Paper]](https://arxiv.org/pdf/1706.05170.pdf)
<img width="50%" src="https://pbs.twimg.com/media/DCsPKLqXoAEBd-V.jpg" />

:camera::space_invader: Weakly supervised 3D Reconstruction with Adversarial Constraint (2017) [[Paper]](https://arxiv.org/pdf/1705.10904.pdf) [[Code]](https://github.com/jgwak/McRecon)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Weakly%20supervised%203D%20Reconstruction%20with%20Adversarial%20Constraint%20(2017).jpeg" />

:camera: SurfNet: Generating 3D shape surfaces using deep residual networks (2017) [[Paper]](https://arxiv.org/pdf/1703.04079.pdf)
<img width="50%" src="https://3dadept.com/wp-content/uploads/2017/07/Screenshot-from-2017-07-26-145521-e1501077539723.png" />

:camera: Learning to Reconstruct Symmetric Shapes using Planar Parameterization of 3D Surface (2019) [[Paper]](https://openaccess.thecvf.com/content_ICCVW_2019/papers/GMDL/Jain_Learning_to_Reconstruct_Symmetric_Shapes_using_Planar_Parameterization_of_3D_ICCVW_2019_paper.pdf) [[Code]](https://github.com/hrdkjain/LearningSymmetricShapes)
<img width="50%" src="https://github.com/hrdkjain/LearningSymmetricShapes/blob/master/Images/teaser.png" />

:pill: GRASS: Generative Recursive Autoencoders for Shape Structures (SIGGRAPH 2017) [[Paper]](http://kevinkaixu.net/projects/grass.html) [[Code]](https://github.com/junli-lj/grass) [[code]](https://github.com/kevin-kaixu/grass_pytorch)
<img width="50%" src="http://kevinkaixu.net/projects/grass/teaser.jpg" />

:pill: 3D-PRNN: Generating Shape Primitives with Recurrent Neural Networks (2017) [[Paper]](https://arxiv.org/pdf/1708.01648.pdf)[[code]](https://github.com/zouchuhang/3D-PRNN)
<img width="50%" src="https://github.com/zouchuhang/3D-PRNN/blob/master/figs/teasor.jpg" />

:gem: Neural 3D Mesh Renderer (2017) [[Paper]](http://hiroharu-kato.com/projects_en/neural_renderer.html) [[Code]](https://github.com/hiroharu-kato/neural_renderer.git)
<img width="50%" src="https://pbs.twimg.com/media/DPSm-4HWkAApEZd.jpg" />

:space_invader: Pix2vox: Sketch-Based 3D Exploration with Stacked Generative Adversarial Networks (2017) [[Code]](https://github.com/maxorange/pix2vox)
<img width="50%" src="https://github.com/maxorange/pix2vox/blob/master/img/sample.gif" />

:camera::space_invader: What You Sketch Is What You Get: 3D Sketching using Multi-View Deep Volumetric Prediction (2017) [[Paper]](https://arxiv.org/pdf/1707.08390.pdf)
<img width="50%" src="https://arxiv-sanity-sanity-production.s3.amazonaws.com/render-output/31631/x1.png" />

:camera::space_invader: MarrNet: 3D Shape Reconstruction via 2.5D Sketches (2017) [[Paper]](http://marrnet.csail.mit.edu/)
<img width="50%" src="http://marrnet.csail.mit.edu/images/model.jpg" />

:camera::space_invader::game_die: Learning a Multi-View Stereo Machine (2017 NIPS) [[Paper]](http://bair.berkeley.edu/blog/2017/09/05/unified-3d/) 
<img width="50%" src="http://bair.berkeley.edu/static/blog/unified-3d/Network.png" />

:space_invader: 3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions (2017) [[Paper]](http://3dmatch.cs.princeton.edu/)
<img width="50%" src="http://3dmatch.cs.princeton.edu/img/overview.jpg" />

:space_invader: Scaling CNNs for High Resolution Volumetric Reconstruction from a Single Image (2017) [[Paper]](https://ieeexplore.ieee.org/document/8265323/)
<img width="50%" src="https://github.com/frankhjwx/3D-Machine-Learning/blob/master/imgs/Scaling%20CNN%20Reconstruction.png" />

:pill: ComplementMe: Weakly-Supervised Component Suggestions for 3D Modeling (2017) [[Paper]](https://arxiv.org/pdf/1708.01841.pdf)
<img width="50%" src="https://mhsung.github.io/assets/images/complement-me/figure_2.png" />

:game_die: PU-Net: Point Cloud Upsampling Network (2018) [[Paper]](https://arxiv.org/pdf/1801.06761.pdf) [[Code]](https://github.com/yulequan/PU-Net)
<img width="50%" src="http://appsrv.cse.cuhk.edu.hk/~lqyu/indexpics/Pu-Net.png" />

:camera::space_invader: Multi-view Consistency as Supervisory Signal for Learning Shape and Pose Prediction (2018 CVPR) [[Paper]](https://shubhtuls.github.io/mvcSnP/)
<img width="50%" src="https://shubhtuls.github.io/mvcSnP/resources/images/teaser.png" />

:camera::game_die: Object-Centric Photometric Bundle Adjustment with Deep Shape Prior (2018) [[Paper]](http://ci2cv.net/media/papers/WACV18.pdf)
<img width="50%" src="https://chenhsuanlin.bitbucket.io/images/rp/r06.png" />

:camera::game_die: Learning Efficient Point Cloud Generation for Dense 3D Object Reconstruction (2018 AAAI) [[Paper]](https://chenhsuanlin.bitbucket.io/3D-point-cloud-generation/)
<img width="50%" src="https://chenhsuanlin.bitbucket.io/images/rp/r05.png" />

:gem: Pixel2Mesh: Generating 3D Mesh Models from Single RGB Images (2018) [[Paper]](https://github.com/nywang16/Pixel2Mesh)
<img width="50%" src="https://www.groundai.com/media/arxiv_projects/188911/x2.png.750x0_q75_crop.png" />

:gem: AtlasNet: A Papier-Mâché Approach to Learning 3D Surface Generation (2018 CVPR) [[Paper]](http://imagine.enpc.fr/~groueixt/atlasnet/) [[Code]](https://github.com/ThibaultGROUEIX/AtlasNet)
<img width="50%" src="http://imagine.enpc.fr/~groueixt/atlasnet/imgs/teaser.small.png" />

:space_invader::gem: Deep Marching Cubes: Learning Explicit Surface Representations (2018 CVPR) [[Paper]](http://www.cvlibs.net/publications/Liao2018CVPR.pdf)
<img width="50%" src="https://github.com/frankhjwx/3D-Machine-Learning/blob/master/imgs/Deep%20Marching%20Cubes.png" />

:space_invader: Im2Avatar: Colorful 3D Reconstruction from a Single Image (2018) [[Paper]](https://arxiv.org/pdf/1804.06375v1.pdf)
<img width="50%" src="https://github.com/syb7573330/im2avatar/blob/master/misc/demo_teaser.png" />

:gem: Learning Category-Specific Mesh Reconstruction from Image Collections (2018) [[Paper]](https://akanazawa.github.io/cmr/#)
<img width="50%" src="https://akanazawa.github.io/cmr/resources/images/teaser.png" />

:pill: CSGNet: Neural Shape Parser for Constructive Solid Geometry (2018) [[Paper]](https://arxiv.org/pdf/1712.08290.pdf)
<img width="50%" src="https://pbs.twimg.com/media/DR-RgbaU8AEyjeW.jpg" />

:space_invader: Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddings (2018) [[Paper]](http://text2shape.stanford.edu/)
<img width="50%" src="http://text2shape.stanford.edu/figures/pull.png" />

:space_invader::gem::camera: Multi-View Silhouette and Depth Decomposition for High Resolution 3D Object Representation (2018) [[Paper]](https://arxiv.org/abs/1802.09987) [[Code]](https://github.com/EdwardSmith1884/Multi-View-Silhouette-and-Depth-Decomposition-for-High-Resolution-3D-Object-Representation)
<img width="60%" src="imgs/decomposition_new.png" /> <img width="60%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Multi-View%20Silhouette%20and%20Depth%20Decomposition%20for%20High%20Resolution%203D%20Object%20Representation.png" />

:space_invader::gem::camera: Pixels, voxels, and views: A study of shape representations for single view 3D object shape prediction (2018 CVPR) [[Paper]](https://arxiv.org/abs/1804.06032)
<img width="60%" src="imgs/pixels-voxels-views-rgb2mesh.png" />

:camera::game_die: Neural scene representation and rendering (2018) [[Paper]](https://deepmind.com/blog/neural-scene-representation-and-rendering/)
<img width="50%" src="http://www.arimorcos.com/static/images/publication_images/gqn_image.png" />

:pill: Im2Struct: Recovering 3D Shape Structure from a Single RGB Image (2018 CVPR) [[Paper]](https://arxiv.org/pdf/1804.05469.pdf)
<img width="50%" src="https://kevinkaixu.net/images/publications/niu_cvpr18.jpg" />

:game_die: FoldingNet: Point Cloud Auto-encoder via Deep Grid Deformation (2018 CVPR) [[Paper]](https://arxiv.org/pdf/1712.07262.pdf)
<img width="50%" src="http://simbaforrest.github.io/fig/FoldingNet.jpg" />

:camera::space_invader: Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling (2018 CVPR) [[Paper]](http://pix3d.csail.mit.edu/)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Pix3D%20-%20Dataset%20and%20Methods%20for%20Single-Image%203D%20Shape%20Modeling%20(2018%20CVPR).png" />

:gem: 3D-RCNN: Instance-level 3D Object Reconstruction via Render-and-Compare (2018 CVPR) [[Paper]](http://openaccess.thecvf.com/content_cvpr_2018/CameraReady/1128.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/3D-RCNN-%20Instance-level%203D%20Object%20Reconstruction%20via%20Render-and-Compare%20(2018%20CVPR).jpeg" />

:space_invader: Matryoshka Networks: Predicting 3D Geometry via Nested Shape Layers (2018 CVPR) [[Paper]](https://arxiv.org/pdf/1804.10975.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Matryoshka%20Networks-%20Predicting%203D%20Geometry%20via%20Nested%20Shape%20Layers%20(2018%20CVPR).jpeg" />

:gem: 	
Deformable Shape Completion with Graph Convolutional Autoencoders (2018 CVPR) [[Paper]](https://arxiv.org/pdf/1712.00268v1.pdf)
<img width="50%" src="https://orlitany.github.io/OL_files/shapeComp.png" />

:space_invader: Global-to-Local Generative Model for 3D Shapes (SIGGRAPH Asia 2018) [[Paper]](http://vcc.szu.edu.cn/research/2018/G2L)[[Code]](https://github.com/Hao-HUST/G2LGAN)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Global-to-Local%20Generative%20Model%20for%203D%20Shapes.jpg" />

:gem::game_die::space_invader: ALIGNet: Partial-Shape Agnostic Alignment via Unsupervised Learning (TOG 2018) [[Paper]](https://bit.ly/alignet) [[Code]](https://github.com/ranahanocka/ALIGNet/)
<img width="50%" src="https://github.com/ranahanocka/ALIGNet/blob/master/docs/rep.png" />

:game_die: GAL: Geometric Adversarial Loss for Single-View 3D-Object Reconstruction (2018) [[Paper]](https://xjqi.github.io/GAL.pdf)
<img width="50%" src="https://media.springernature.com/original/springer-static/image/chp%3A10.1007%2F978-3-030-01237-3_49/MediaObjects/474213_1_En_49_Fig2_HTML.gif" />

:game_die: Visual Object Networks: Image Generation with Disentangled 3D Representation (2018) [[Paper]](https://papers.nips.cc/paper/7297-visual-object-networks-image-generation-with-disentangled-3d-representations.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Visual%20Object%20Networks-%20Image%20Generation%20with%20Disentangled%203D%20Representation%20(2018).jpeg" />

:space_invader: Learning to Infer and Execute 3D Shape Programs (2019)) [[Paper]](http://shape2prog.csail.mit.edu/)
<img width="50%" src="http://shape2prog.csail.mit.edu/shape_files/teaser.jpg" />

:space_invader: Learning to Infer and Execute 3D Shape Programs (2019)) [[Paper]](https://arxiv.org/pdf/1901.05103.pdf)
<img width="50%" src="https://pbs.twimg.com/media/DxFaW-mU8AEo9wc.jpg" />

:gem: Learning View Priors for Single-view 3D Reconstruction (CVPR 2019) [[Paper]](http://hiroharu-kato.com/projects_en/view_prior_learning.html)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Learning%20View%20Priors%20for%20Single-view%203D%20Reconstruction.png" />

:gem::game_die: Learning Embedding of 3D models with Quadric Loss (BMVC 2019) [[Paper]](https://arxiv.org/abs/1907.10250) [[Code]](https://github.com/nitinagarwal/QuadricLoss)
<img width="50%" src="https://www.ics.uci.edu/~agarwal/bmvc_2019.png" />

:game_die: CompoNet: Learning to Generate the Unseen by Part Synthesis and Composition (ICCV 2019) [[Paper]](https://arxiv.org/abs/1811.07441)[[Code]](https://github.com/nschor/CompoNet)
<img width="50%" src="https://raw.githubusercontent.com/nschor/CompoNet/master/images/network_architecture.png" />

CoMA: Convolutional Mesh Autoencoders (2018) [[Paper]](https://ps.is.tuebingen.mpg.de/uploads_file/attachment/attachment/439/1285.pdf)[[Code (TF)]](https://github.com/anuragranj/coma)[[Code (PyTorch)]](https://github.com/pixelite1201/pytorch_coma/)[[Code (PyTorch)]](https://github.com/sw-gong/coma)
 [CoMA](https://coma.is.tue.mpg.de/) is a versatile model that learns a non-linear representation of a face using spectral convolutions on a mesh surface. CoMA introduces mesh sampling operations that enable a hierarchical mesh representation that captures non-linear variations in shape and expression at multiple scales within the model. 
 <img width="50%" src="https://coma.is.tue.mpg.de/uploads/ckeditor/pictures/91/content_coma_faces.jpg">

RingNet: 3D Face Reconstruction from Single Images (2019) [[Paper]](https://ps.is.tuebingen.mpg.de/uploads_file/attachment/attachment/509/paper_camera_ready.pdf)[[Code]](https://github.com/soubhiksanyal/RingNet)
 <img width="50%" src="https://github.com/soubhiksanyal/RingNet/blob/master/gif/celeba_reconstruction.gif">

VOCA: Voice Operated Character Animation (2019) [[Paper]](https://ps.is.tuebingen.mpg.de/uploads_file/attachment/attachment/510/paper_final.pdf)[[Video]](https://youtu.be/XceCxf_GyW4)[[Code]](https://github.com/TimoBolkart/voca)
 [VOCA](https://voca.is.tue.mpg.de/) is a simple and generic speech-driven facial animation framework that works across a range of identities. The codebase demonstrates how to synthesize realistic character animations given an arbitrary speech signal and a static character mesh.
 <img width="50%" src="https://github.com/TimoBolkart/voca/blob/master/gif/speech_driven_animation.gif">

:gem: Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderer [[Paper]](https://arxiv.org/abs/1908.01210)[[Site]](https://nv-tlabs.github.io/DIB-R/)[[Code]](https://github.com/nv-tlabs/DIB-R)
 <img width="50%" src="https://nv-tlabs.github.io/DIB-R/figures/model2a-2.png">

:gem: Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning [[Paper]](https://arxiv.org/abs/1904.01786)[[Code]](https://github.com/ShichenLiu/SoftRas)
 <img width="50%" src="https://raw.githubusercontent.com/ShichenLiu/SoftRas/master/data/media/teaser/teaser.png">

NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis [[Project]](http://www.matthewtancik.com/nerf)[[Paper]](https://arxiv.org/abs/2003.08934)[[Code]](https://github.com/bmild/nerf)
 <img width="50%" src="https://uploads-ssl.webflow.com/51e0d73d83d06baa7a00000f/5e700ef6067b43821ed52768_pipeline_website-01-p-800.png">

## Texture/Material Analysis and Synthesis
Texture Synthesis Using Convolutional Neural Networks (2015) [[Paper]](https://arxiv.org/pdf/1505.07376.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Texture%20Synthesis%20Using%20Convolutional%20Neural%20Networks.jpeg" />

Two-Shot SVBRDF Capture for Stationary Materials (SIGGRAPH 2015) [[Paper]](https://mediatech.aalto.fi/publications/graphics/TwoShotSVBRDF/)
<img width="50%" src="https://mediatech.aalto.fi/publications/graphics/TwoShotSVBRDF/teaser.png" />

Reflectance Modeling by Neural Texture Synthesis (2016) [[Paper]](https://mediatech.aalto.fi/publications/graphics/NeuralSVBRDF/)
<img width="50%" src="https://mediatech.aalto.fi/publications/graphics/NeuralSVBRDF/teaser.png" />

Modeling Surface Appearance from a Single Photograph using Self-augmented Convolutional Neural Networks (2017) [[Paper]](http://msraig.info/~sanet/sanet.htm)
<img width="50%" src="http://msraig.info/~sanet/teaser.jpg" />

High-Resolution Multi-Scale Neural Texture Synthesis (2017) [[Paper]](https://wxs.ca/research/multiscale-neural-synthesis/)
<img width="50%" src="https://wxs.ca/research/multiscale-neural-synthesis/multiscale-gram-marble.jpg" />

Reflectance and Natural Illumination from Single Material Specular Objects Using Deep Learning (2017) [[Paper]](https://homes.cs.washington.edu/~krematas/Publications/reflectance-natural-illumination.pdf)
<img width="50%" src="http://www.vision.ee.ethz.ch/~georgous/images/tpami17_teaser2.png" />

Joint Material and Illumination Estimation from Photo Sets in the Wild (2017) [[Paper]](https://arxiv.org/pdf/1710.08313.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Joint%20Material%20and%20Illumination%20Estimation%20from%20Photo%20Sets%20in%20the%20Wild.jpeg" />

JWhat Is Around The Camera? (2017) [[Paper]](https://arxiv.org/pdf/1611.09325v2.pdf)
<img width="50%" src="https://homes.cs.washington.edu/~krematas/my_images/arxiv16b_teaser.jpg" />

TextureGAN: Controlling Deep Image Synthesis with Texture Patches (2018 CVPR) [[Paper]](https://arxiv.org/pdf/1706.02823.pdf)
<img width="50%" src="http://texturegan.eye.gatech.edu/img/paper_figure.png" />

Gaussian Material Synthesis (2018 SIGGRAPH) [[Paper]](https://users.cg.tuwien.ac.at/zsolnai/gfx/gaussian-material-synthesis/)
<img width="50%" src="https://i.ytimg.com/vi/VM2ysCnD9GA/maxresdefault.jpg" />

Non-stationary Texture Synthesis by Adversarial Expansion (2018 SIGGRAPH) [[Paper]](http://vcc.szu.edu.cn/research/2018/TexSyn)
<img width="50%" src="https://github.com/jessemelpolio/non-stationary_texture_syn/blob/master/imgs/teaser.png" />

Synthesized Texture Quality Assessment via Multi-scale Spatial and Statistical Texture Attributes of Image and Gradient Magnitude Coefficients (2018 CVPR) [[Paper]](https://arxiv.org/pdf/1804.08020.pdf)
<img width="50%" src="https://user-images.githubusercontent.com/12434910/39275366-e18c7c1c-4899-11e8-8e61-05072618bbce.PNG" />

LIME: Live Intrinsic Material Estimation (2018 CVPR) [[Paper]](https://gvv.mpi-inf.mpg.de/projects/LIME/)
<img width="50%" src="https://web.stanford.edu/~zollhoef/papers/CVPR18_Material/teaser.png" />

Single-Image SVBRDF Capture with a Rendering-Aware Deep Network (2018) [[Paper]](https://team.inria.fr/graphdeco/fr/projects/deep-materials/)
<img width="50%" src="https://team.inria.fr/graphdeco/files/2018/08/teaser_v0.png" />

PhotoShape: Photorealistic Materials for Large-Scale Shape Collections (2018) [[Paper]](https://keunhong.com/publications/photoshape/)
<img width="50%" src="https://keunhong.com/publications/photoshape/teaser.jpg" />

Learning Material-Aware Local Descriptors for 3D Shapes (2018) [[Paper]](http://www.vovakim.com/papers/18_3DV_ShapeMatFeat.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Learning%20Material-Aware%20Local%20Descriptors%20for%203D%20Shapes%20(2018).jpeg" />

FrankenGAN: Guided Detail Synthesis for Building Mass Models 
using Style-Synchonized GANs (2018 SIGGRAPH Asia) [[Paper]](http://geometry.cs.ucl.ac.uk/projects/2018/frankengan/)
<img width="50%" src="http://geometry.cs.ucl.ac.uk/projects/2018/frankengan/paper_docs/teaser.jpg" />

## Style Learning and Transfer
Style-Content Separation by Anisotropic Part Scales (2010) [[Paper]](https://www.cs.sfu.ca/~haoz/pubs/xu_siga10_style.pdf)
<img width="50%" src="https://sites.google.com/site/kevinkaixu/_/rsrc/1472852123106/publications/style_b.jpg?height=145&width=400" />

Design Preserving Garment Transfer (2012) [[Paper]](https://hal.inria.fr/hal-00695903/file/GarmentTransfer.pdf)
<img width="30%" src="https://hal.inria.fr/hal-00695903v2/file/02_WomanToAll.jpg" />

Analogy-Driven 3D Style Transfer (2014) [[Paper]](http://www.chongyangma.com/publications/st/index.html)
<img width="50%" src="http://www.chongyangma.com/publications/st/2014_st_teaser.png" />

Elements of Style: Learning Perceptual Shape Style Similarity (2015) [[Paper]](http://people.cs.umass.edu/~zlun/papers/StyleSimilarity/StyleSimilarity.pdf) [[Code]](https://github.com/happylun/StyleSimilarity)
<img width="50%" src="https://people.cs.umass.edu/~zlun/papers/StyleSimilarity/StyleSimilarity_teaser.jpg" />

Functionality Preserving Shape Style Transfer (2016) [[Paper]](http://people.cs.umass.edu/~zlun/papers/StyleTransfer/StyleTransfer.pdf) [[Code]](https://github.com/happylun/StyleTransfer)
<img width="50%" src="https://people.cs.umass.edu/~zlun/papers/StyleTransfer/StyleTransfer_teaser.jpg" />

Unsupervised Texture Transfer from Images to Model Collections (2016) [[Paper]](http://ai.stanford.edu/~haosu/papers/siga16_texture_transfer_small.pdf)
<img width="50%" src="http://geometry.cs.ucl.ac.uk/projects/2016/texture_transfer/paper_docs/teaser.png" />

Learning Detail Transfer based on Geometric Features (2017) [[Paper]](http://surfacedetails.cs.princeton.edu/)
<img width="50%" src="http://surfacedetails.cs.princeton.edu/images/teaser.png" />

Co-Locating Style-Defining Elements on 3D Shapes (2017) [[Paper]](http://people.scs.carleton.ca/~olivervankaick/pubs/style_elem.pdf)
<img width="50%" src="http://s2017.siggraph.org/sites/default/files/styles/large/public/images/events/c118-e100-publicimage_0-itok=yO8OegQO.png" />

Neural 3D Mesh Renderer (2017) [[Paper]](http://hiroharu-kato.com/projects_en/neural_renderer.html) [[Code]](https://github.com/hiroharu-kato/neural_renderer.git)
<img width="50%" src="https://pbs.twimg.com/media/DPSm-4HWkAApEZd.jpg" />

Appearance Modeling via Proxy-to-Image Alignment (2018) [[Paper]](http://vcc.szu.edu.cn/research/2018/AppMod)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Appearance%20Modeling%20via%20Proxy-to-Image%20Alignment.png" />

:gem: Pixel2Mesh: Generating 3D Mesh Models from Single RGB Images (2018) [[Paper]](http://bigvid.fudan.edu.cn/pixel2mesh/)
<img width="50%" src="https://pbs.twimg.com/media/DaIuEnfU0AAqesA.jpg" />

Automatic Unpaired Shape Deformation Transfer (SIGGRAPH Asia 2018) [[Paper]](http://geometrylearning.com/ausdt/)
<img width="50%" src="http://geometrylearning.com/ausdt/imgs/teaser.png" />

## Scene Synthesis/Reconstruction
Make It Home: Automatic Optimization of Furniture Arrangement (2011, SIGGRAPH) [[Paper]](http://people.sutd.edu.sg/~saikit/projects/furniture/index.html)
<img width="40%" src="https://www.cs.umb.edu/~craigyu/img/papers/furniture.gif" />

Interactive Furniture Layout Using Interior Design Guidelines (2011) [[Paper]](http://graphics.stanford.edu/~pmerrell/furnitureLayout.htm)
<img width="50%" src="http://vis.berkeley.edu/papers/furnitureLayout/furnitureBig.jpg" />

Synthesizing Open Worlds with Constraints using Locally Annealed Reversible Jump MCMC (2012) [[Paper]](http://graphics.stanford.edu/~lfyg/owl.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Synthesizing%20Open%20Worlds%20with%20Constraints%20using%20Locally%20Annealed%20Reversible%20Jump%20MCMC%20(2012).jpeg" />

Example-based Synthesis of 3D Object Arrangements (2012 SIGGRAPH Asia) [[Paper]](http://graphics.stanford.edu/projects/scenesynth/)
<img width="60%" src="http://graphics.stanford.edu/projects/scenesynth/img/teaser.jpg" />

Sketch2Scene: Sketch-based Co-retrieval and Co-placement of 3D Models (2013) [[Paper]](http://sweb.cityu.edu.hk/hongbofu/projects/sketch2scene_sig13/#.WWWge__ysb0)
<img width="40%" src="http://sunweilun.github.io/images/paper/sketch2scene_thumb.jpg" />

Action-Driven 3D Indoor Scene Evolution (2016) [[Paper]](https://www.cs.sfu.ca/~haoz/pubs/ma_siga16_action.pdf)
<img width="50%" src="https://maruitx.github.io/project/adise/teaser.jpg" />

The Clutterpalette: An Interactive Tool for Detailing Indoor Scenes (2015) [[Paper]](https://www.cs.umb.edu/~craigyu/papers/clutterpalette.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/The%20Clutterpalette-%20An%20Interactive%20Tool%20for%20Detailing%20Indoor%20Scenes.png" />

Relationship Templates for Creating Scene Variations (2016) [[Paper]](http://geometry.cs.ucl.ac.uk/projects/2016/relationship-templates/)
<img width="50%" src="http://geometry.cs.ucl.ac.uk/projects/2016/relationship-templates/paper_docs/teaser.png" />

IM2CAD (2017) [[Paper]](http://homes.cs.washington.edu/~izadinia/im2cad.html)
<img width="50%" src="http://i.imgur.com/KhtOeuB.jpg" />

Predicting Complete 3D Models of Indoor Scenes (2017) [[Paper]](https://arxiv.org/pdf/1504.02437.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Predicting%20Complete%203D%20Models%20of%20Indoor%20Scenes.png" />

Complete 3D Scene Parsing from Single RGBD Image (2017) [[Paper]](https://arxiv.org/pdf/1710.09490.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Complete%203D%20Scene%20Parsing%20from%20Single%20RGBD%20Image.jpeg" />

Raster-to-Vector: Revisiting Floorplan Transformation (2017, ICCV) [[Paper]](http://www.cse.wustl.edu/~chenliu/floorplan-transformation.html) [[Code]](https://github.com/art-programmer/FloorplanTransformation)
<img width="50%" src="https://www.cse.wustl.edu/~chenliu/floorplan-transformation/teaser.png" />

Fully Convolutional Refined Auto-Encoding Generative Adversarial Networks for 3D Multi Object Scenes (2017) [[Blog]](https://becominghuman.ai/3d-multi-object-gan-7b7cee4abf80)
<img width="50%" src="https://cdn-images-1.medium.com/max/1600/1*NckW2hfgbHhEP3P8Z5ZLjQ.png" />

Adaptive Synthesis of Indoor Scenes via Activity-Associated Object Relation Graphs (2017 SIGGRAPH Asia) [[Paper]](http://arts.buaa.edu.cn/projects/sa17/)
<img width="50%" src="https://sa2017.siggraph.org/images/events/c121-e45-publicimage.jpg" />

Automated Interior Design Using a Genetic Algorithm (2017) [[Paper]](https://publik.tuwien.ac.at/files/publik_262718.pdf)
<img width="50%" src="http://www.peterkan.com/pictures/teaserq.jpg" />

SceneSuggest: Context-driven 3D Scene Design (2017) [[Paper]](https://arxiv.org/pdf/1703.00061.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/SceneSuggest%20-Context-driven%203D%20Scene%20Design%20(2017).png" />

A fully end-to-end deep learning approach for real-time simultaneous 3D reconstruction and material recognition (2017) [[Paper]](https://arxiv.org/pdf/1703.04699v1.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/A%20fully%20end-to-end%20deep%20learning%20approach%20for%20real-time%20simultaneous%203D%20reconstruction%20and%20material%20recognition%20(2017).png" />

Human-centric Indoor Scene Synthesis Using Stochastic Grammar (2018, CVPR)[[Paper]](http://web.cs.ucla.edu/~syqi/publications/cvpr2018synthesis/cvpr2018synthesis.pdf) [[Supplementary]](http://web.cs.ucla.edu/~syqi/publications/cvpr2018synthesis/cvpr2018synthesis_supplementary.pdf) [[Code]](https://github.com/SiyuanQi/human-centric-scene-synthesis)
<img width="50%" src="http://web.cs.ucla.edu/~syqi/publications/thumbnails/cvpr2018synthesis.gif" />

:camera::game_die: FloorNet: A Unified Framework for Floorplan Reconstruction from 3D Scans (2018) [[Paper]](https://arxiv.org/pdf/1804.00090.pdf) [[Code]](http://art-programmer.github.io/floornet.html)
<img width="50%" src="http://art-programmer.github.io/floornet/teaser.png" />

:space_invader: ScanComplete: Large-Scale Scene Completion and Semantic Segmentation for 3D Scans (2018) [[Paper]](https://arxiv.org/pdf/1712.10215.pdf) 
<img width="50%" src="https://niessnerlab.org/papers/2018/3scancomplete/teaser.jpg" />

Deep Convolutional Priors for Indoor Scene Synthesis (2018) [[Paper]](https://kwang-ether.github.io/pdf/deepsynth.pdf) 
<img width="50%" src="http://msavva.github.io/files/deepsynth.png" />

Configurable 3D Scene Synthesis and 2D Image Rendering
with Per-Pixel Ground Truth using Stochastic Grammars (2018) [[Paper]](https://arxiv.org/pdf/1704.00112.pdf) 
<img width="50%" src="https://media.springernature.com/original/springer-static/image/art%3A10.1007%2Fs11263-018-1103-5/MediaObjects/11263_2018_1103_Fig5_HTML.jpg" />

Holistic 3D Scene Parsing and Reconstruction from a Single RGB Image (ECCV 2018) [[Paper]](http://siyuanhuang.com/holistic_parsing/main.html) 
<img width="50%" src="http://web.cs.ucla.edu/~syqi/publications/thumbnails/eccv2018scene.png" />

Language-Driven Synthesis of 3D Scenes from Scene Databases (SIGGRAPH Asia 2018) [[Paper]](http://www.sfu.ca/~agadipat/publications/2018/T2S/project_page.html) 
<img width="50%" src="http://www.sfu.ca/~agadipat/publications/2018/T2S/teaser.png" />

Deep Generative Modeling for Scene Synthesis via Hybrid Representations (2018) [[Paper]](https://arxiv.org/pdf/1808.02084.pdf) 
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Deep%20Generative%20Modeling%20for%20Scene%20Synthesis%20via%20Hybrid%20Representations%20(2018).jpeg" />

GRAINS: Generative Recursive Autoencoders for INdoor Scenes (2018) [[Paper]](https://arxiv.org/pdf/1807.09193.pdf) 
<img width="50%" src="https://www.groundai.com/media/arxiv_projects/373503/new_pics/teaserfig.jpg.750x0_q75_crop.jpg" />

SEETHROUGH: Finding Objects in Heavily Occluded Indoor Scene Images (2018) [[Paper]](http://www.vovakim.com/papers/18_3DVOral_SeeThrough.pdf) 
<img width="50%" src="http://geometry.cs.ucl.ac.uk/projects/2018/seethrough/paper_docs/result_plate.png" />

:space_invader: Scan2CAD: Learning CAD Model Alignment in RGB-D Scans (CVPR 2019) [[Paper]](https://arxiv.org/pdf/1811.11187.pdf) [[Code]](https://github.com/skanti/Scan2CAD)
<img width="50%" src="http://www.niessnerlab.org/papers/2019/5scan2cad/teaser.jpg" />

:gem: Scan2Mesh: From Unstructured Range Scans to 3D Meshes (CVPR 2019) [[Paper]](https://arxiv.org/pdf/1811.10464.pdf)
<img width="50%" src="http://www.niessnerlab.org/papers/2019/4scan2mesh/teaser.jpg" />

:space_invader: 3D-SIC: 3D Semantic Instance Completion for RGB-D Scans (arXiv 2019) [[Paper]](https://arxiv.org/pdf/1904.12012.pdf)
<img width="50%" src="http://www.niessnerlab.org/papers/2019/z1sic/teaser.jpg" />

:space_invader: End-to-End CAD Model Retrieval and 9DoF Alignment in 3D Scans (arXiv 2019) [[Paper]](https://arxiv.org/abs/1906.04201)
<img width="50%" src="http://www.niessnerlab.org/papers/2019/z2end2end/teaser.jpg" />

:space_invader: Feature-metric Registration: A Fast Semi-Supervised Approach for Robust Point Cloud Registration without Correspondences (CVPR 2020) [[Paper]](https://arxiv.org/abs/2005.01014)[[Code]](https://github.com/XiaoshuiHuang/fmr)
<img width="50%" src="https://github.com/XiaoshuiHuang/xiaoshuihuang.github.io/blob/master/research/2020-feature-metric.png?raw=true" />

## Scene Understanding (Another more detailed [repository](https://github.com/bertjiazheng/awesome-scene-understanding))

Recovering the Spatial Layout of Cluttered Rooms (2009) [[Paper]](http://dhoiem.cs.illinois.edu/publications/iccv2009_hedau_indoor.pdf)
<img width="60%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Recovering%20the%20Spatial%20Layout%20of%20Cluttered%20Rooms.png" />

Characterizing Structural Relationships in Scenes Using Graph Kernels (2011 SIGGRAPH) [[Paper]](https://graphics.stanford.edu/~mdfisher/graphKernel.html)
<img width="60%" src="https://graphics.stanford.edu/~mdfisher/papers/graphKernelTeaser.png" />

Understanding Indoor Scenes Using 3D Geometric Phrases (2013) [[Paper]](http://cvgl.stanford.edu/projects/3dgp/)
<img width="30%" src="http://cvgl.stanford.edu/projects/3dgp/images/title.png" />

Organizing Heterogeneous Scene Collections through Contextual Focal Points (2014 SIGGRAPH) [[Paper]](http://kevinkaixu.net/projects/focal.html)
<img width="60%" src="http://kevinkaixu.net/projects/focal/overlapping_clusters.jpg" />

SceneGrok: Inferring Action Maps in 3D Environments (2014, SIGGRAPH) [[Paper]](http://graphics.stanford.edu/projects/scenegrok/)
<img width="50%" src="http://graphics.stanford.edu/projects/scenegrok/scenegrok.png" />

PanoContext: A Whole-room 3D Context Model for Panoramic Scene Understanding (2014) [[Paper]](http://panocontext.cs.princeton.edu/)
<img width="50%" src="http://panocontext.cs.princeton.edu/teaser.jpg" />

Learning Informative Edge Maps for Indoor Scene Layout Prediction (2015) [[Paper]](http://slazebni.cs.illinois.edu/publications/iccv15_informative.pdf)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Learning%20Informative%20Edge%20Maps%20for%20Indoor%20Scene%20Layout%20Prediction.png" />

Rent3D: Floor-Plan Priors for Monocular Layout Estimation (2015) [[Paper]](http://www.cs.toronto.edu/~fidler/projects/rent3D.html)
<img width="50%" src="http://www.cs.toronto.edu/~fidler/projects/layout-res.jpg" />

A Coarse-to-Fine Indoor Layout Estimation (CFILE) Method (2016) [[Paper]](https://pdfs.semanticscholar.org/7024/a92186b81e6133dc779f497d06877b48d82b.pdf?_ga=2.54181869.497995160.1510977308-665742395.1510465328)
<img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/A%20Coarse-to-Fine%20Indoor%20Layout%20Estimation%20(CFILE)%20Method%20(2016).png" />

DeLay: Robust Spatial Layout Estimation for Cluttered Indoor Scenes (2016) [[Paper]](http://deeplayout.stanford.edu/)
<img width="30%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/DeLay-Robust%20Spatial%20Layout%20Estimation%20for%20Cluttered%20Indoor%20Scenes.png" />

3D Semantic Parsing of Large-Scale Indoor Spaces (2016) [[Paper]](http://buildingparser.stanford.edu/method.html) [[Code]](https://github.com/alexsax/2D-3D-Semantics)
<img width="50%" src="http://buildingparser.stanford.edu/images/teaser.png" />

Deep Multi-Modal Image Correspondence Learning (2016) [[Paper]](http://www.cse.wustl.edu/~chenliu/floorplan-matching.html)
<img width="50%" src="http://art-programmer.github.io/floorplan-matching/teaser.png" />

Physically-Based Rendering for Indoor Scene Understanding Using Convolutional Neural Networks (2017) [[Paper]](http://3dvision.princeton.edu/projects/2016/PBRS/) [[Code]](https://github.com/yindaz/pbrs) [[Code]](https://github.com/yindaz/surface_normal) [[Code]](https://github.com/fyu/dilation) [[Code]](https://github.com/s9xie/hed)
<img width="50%" src="https://pbs.twimg.com/media/C0YERJOXEAA69xN.jpg" />

RoomNet: End-to-End Room Layout Estimation (2017) [[Paper]](https://arxiv.org/pdf/1703.06241.pdf)
<img width="50%" src="https://pbs.twimg.com/media/C7Z29GsV0AASEvR.jpg" />

SUN RGB-D: A RGB-D Scene Understanding Benchmark Suite (2017) [[Paper]](http://rgbd.cs.princeton.edu/)
<img width="50%" src="http://rgbd.cs.princeton.edu/teaser.jpg" />

Semantic Scene Completion from a Single Depth Image (2017) [[Paper]](http://sscnet.cs.princeton.edu/) [[Code]](https://github.com/shurans/sscnet)
<img width="50%" src="http://sscnet.cs.princeton.edu/teaser.jpg" />

Factoring Shape, Pose, and Layout from the 2D Image of a 3D Scene (2018 CVPR) [[Paper]](https://arxiv.org/pdf/1712.01812.pdf) [[Code]](https://shubhtuls.github.io/factored3d/)
<img width="50%" src="https://shubhtuls.github.io/factored3d/resources/images/teaser.png" />

LayoutNet: Reconstructing the 3D Room Layout from a Single RGB Image (2018 CVPR) [[Paper]](https://arxiv.org/pdf/1803.08999.pdf) [[Code]](https://github.com/zouchuhang/LayoutNet)
<img width="50%" src="http://p0.ifengimg.com/pmop/2018/0404/A1D0CAE48130C918FE624FA60495F237C67172F6_size63_w797_h755.jpeg" />

PlaneNet: Piece-wise Planar Reconstruction from a Single RGB Image (2018 CVPR) [[Paper]](http://art-programmer.github.io/planenet/paper.pdf) [[Code]](http://art-programmer.github.io/planenet.html)
<img width="50%" src="http://art-programmer.github.io/images/planenet.png" />

Cross-Domain Self-supervised Multi-task Feature Learning using Synthetic Imagery (2018 CVPR) [[Paper]](http://web.cs.ucdavis.edu/~yjlee/projects/cvpr2018.pdf) <img width="50%" src="https://jason718.github.io/project/cvpr18/files/concept_pic.png" />

Pano2CAD: Room Layout From A Single Panorama Image (2018 CVPR) [[Paper]](http://bjornstenger.github.io/papers/xu_wacv2017.pdf) <img width="50%" src="https://www.groundai.com/media/arxiv_projects/58924/figures/Compare_2b.png" />

Automatic 3D Indoor Scene Modeling from Single Panorama (2018 CVPR) [[Paper]](http://openaccess.thecvf.com/content_cvpr_2018/papers/Yang_Automatic_3D_Indoor_CVPR_2018_paper.pdf) <img width="50%" src="https://github.com/timzhang642/3D-Machine-Learning/blob/master/imgs/Automatic%203D%20Indoor%20Scene%20Modeling%20from%20Single%20Panorama%20(2018%20CVPR).jpeg" />

Single-Image Piece-wise Planar 3D Reconstruction via Associative Embedding (2019 CVPR) [[Paper]](https://arxiv.org/pdf/1902.09777.pdf) [[Code]](https://github.com/svip-lab/PlanarReconstruction) <img width="50%" src="https://github.com/svip-lab/PlanarReconstruction/blob/master/misc/pipeline.jpg" />

3D-Aware Scene Manipulation via Inverse Graphics (NeurIPS 2018) [[Paper]](http://3dsdn.csail.mit.edu/) [[Code]](https://github.com/svip-lab/PlanarReconstruction) <img width="50%" src="http://3dsdn.csail.mit.edu/images/teaser.png" />

:gem: 3D Scene Reconstruction with Multi-layer Depth and Epipolar Transformers (ICCV 2019) [[Paper]](https://research.dshin.org/iccv19/multi-layer-depth/) <img width="50%" src="https://research.dshin.org/iccv19/multi-layer-depth/figures/overview_1.png" /> <img width="50%" src="https://research.dshin.org/iccv19/multi-layer-depth/figures/voxelization00.jpg" />

PerspectiveNet: 3D Object Detection from a Single RGB Image via Perspective Points (NIPS 2019) [[Paper]](https://papers.nips.cc/paper/9093-perspectivenet-3d-object-detection-from-a-single-rgb-image-via-perspective-points.pdf) <img width="50%" src="https://storage.googleapis.com/groundai-web-prod/media/users/user_288036/project_402358/images/x1.png" />

Holistic++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsense (ICCV 2019) [[Paper & Code]](https://github.com/yixchen/holistic_scene_human) <img width="50%" src="https://yixchen.github.io/holisticpp/file/pg.png" />

Lawrence Yang/3D点云学习库

简介

发行版

贡献者

近期动态

Lawrence Yang/3D点云学习库 .gitee-modal { width: 500px !important; }

简介

发行版

贡献者

近期动态

搜索帮助

Lawrence Yang/3D点云学习库