Xinshuo Weng

The Robotics Institute
School of Computer Science
Carnegie Mellon University
Pittsburgh, PA 15213, USA

Office: 1502F NSH

 page loads since 06/20/2017

Github LinkedIn Google Scholar

Brief Bio

I am a first-year Ph.D. student (2018-) at the Robotics Institute of Carnegie Mellon University supervised by Kris Kitani. I received my Masters (2016-17) at the Robotics Institute as well, where I am working with Yaser Sheikh and Kris Kitani. Before starting my Ph.D. program at CMU, I worked at Oculus Research Pittsburgh (Facebook Reality Lab) as a research engineer. I spent a wonderful summer (2016) working with Alan Yuille at the Johns Hopkins University as a summer intern. When I was an undergradute, I've studied in School of Computer Science, University College Dublin as an exchange student in Ireland. My Bachelor's degree is received from the School of Electronic Information at Wuhan University in China.

See here for my resume.

Research Interests

  • Computer Vision
    • Visual Recognition: Image Segmentation, 2D Object/Pedestrian Detection and Tracking, High-Resolution Recognition
    • 2D Keypoint Detection: Facial Landmark Detection, Human Pose Estimation, Hand Pose Estimation
    • 2.5D Vision: Depth Estimation, Surface Normal Estimation, Ground Plane Normal Estimation
    • 3D Vision: 3D Object/Pedestrian Detection and Tracking, Point Cloud Registration
  • Machine Learning for Vision
    • Deep Learning: Equivariance Modeling
    • Self/Unsupervised Learning: Supervision via Consistency
    • Reinforcement Learning for Vision
    • Multimodal Learning: Visual Lipreading


Aug. 2018 -- Joined CMU Robotics Institute as a Ph.D. student.
Feb. 2018 -- Joined Oculus Research Pittsburgh as a research engineer.
Jan. 2018 -- One paper accepted to CVPR 2018!
Oct. 2017 -- One paper accepted to WACV 2018!
May. 2017 -- Joined Facebook as a research intern.
Aug. 2016 -- Started the master program in computer vision (MSCV) In Robotics Institute at CMU.
Jun. 2016 -- Joined Alan Yuille's group as a summer intern.


Monocular 3D Object Detection with Pseudo-LiDAR Point Cloud

Xinshuo Weng, Kris Kitani

arXiv preprint 2019

On the Importance of Video Action Recognition for Visual Lipreading

Xinshuo Weng

arXiv preprint 2019

Future Near-Collision Prediction from Monocular Video: Feasibility, Dataset, and Challenges

Aashi Manglik, Xinshuo Weng, Eshed Ohn-Bar, Kris Kitani

arXiv preprint 2019

GroundNet: Segmentation-Aware Monocular Ground Plane Estimation with Geometric Consistency

Yunze Man, Xinshuo Weng, Kris Kitani

arXiv preprint 2018

Supervision-by-Registration: An Unsupervised Approach to Improve the Precision of Facial Landmark Detectors

Xuanyi Dong, Shoou-I Yu, Xinshuo Weng, Shi-en Wei, Yi Yang, Yaser Sheikh

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018

Rotational Rectification Network: Enabling Pedestrian Detection for Mobile Vision

Xinshuo Weng, Shangxuan Wu, Fares Beainy, Kris Kitani

IEEE Winter Conference on Applications of Computer Vision (WACV), 2018

Visual Compiler: Synthesizing a Scene-Specific Pedestrian Detector and Pose Estimator

Namhoon Lee, Xinshuo Weng, Vishnu Naresh Boddeti, Yu Zhang, Fares Beainy, Kris Kitani, Takeo Kanade

arXiv preprint 2016


Geometry-Based Methods in Computer Vision (16-822), CMU
Teaching Assistant (TA) with Martial Hebert
Fall 2018


1. Xinshuo's Toolbox: A self-contained structured toolbox for computer vision and machine learning (deep learning). It's written in python, matlab, c++ and lua, containing extensive libraries for I/O stream, image & video processing, visualization for convenience.

2. CNN Monitor: A very lightweight deep learning tool for monitoring data flow, parameter size and their corresponding memory usage throughout CNN. This tool doesn't need any powerful computational resource (eg. GPU). And it's very easy to use since it follows many similar rules in popular deep learning frameworks (Caffe, Tensorflow, Torch)

Professional Service

  • Conference Reviewer: CVPR, ACCV, ICCV.
  • Journal Reviewer: TCSVT.

Awards and Honors

  • Outstanding Graduate Award, Wuhan University, 2016.
  • Wuhan University Scholarship (4%), 2013, 2015, 2016.
  • CSC (China Scholarship Council) Scholarship (1%), 2015.
  • Yang Gui Scholarship (4%), Wuhan University, 2015.
  • Undergraduate Research Fellowship, Wuhan University, 2014, 2015.
  • China National Scholarship (1%), 2014.

Free Web Counters unique visitors since 06/20/2017