Resume and Portfolio

About


About
Expert in human pose estimation, computationally efficient deep learning, and computer vision. Lead author of OpenPose. 5 years of experience in performance-oriented C++ software development, including CUDA, AVX vectorization, multi-threading, embedded system programming, and Qt/GUI deployment. Mentored multiple students in research and software development, culminating in their contribution to OpenPose.

CMU:
I am a full-time Research Associate at The Robotics Institute, Carnegie Mellon University (CMU) since Fall 2014 and M.S. student since Fall 2016. I am currently working under the supervision of professor Yaser Sheikh, and I previously worked for 2 years with professor Fernando De La Torre. The main projects I have contributed to are OpenPose, OpenPose Unity Plugin, the Panoptic Studio, IntraFace, and the FeelingSpector. I have also collaborated in projects with Ford and General Motors and IARPA, among others.

UPCT:
Before joining the Robotics Institute, I obtained a B.S. in Telecommunication System Engineering (similar to Electrical and Computer Engineering in US) from Universidad Politécnica de Cartagena (UPCT), Spain. While an undergraduate, I had the opportunity to work on stereoscopic image rectification and embedded system problems under the supervision of professor Javier Toledo.

Full CV:
My full CV is available in PDF format and on my LinkedIn profile.

Research and Projects


OpenPose

OpenPose

Lead author. First real-time multi-person system to jointly detect human body, hand, facial, and foot keypoints (in total 135 keypoints) on single images.

Read More
Panoptic Studio

Panoptic Studio

Collaborator. The Panoptic Studio is a Massive Multiview System Dataset that includes: 480 VGA camera views, 30+ HD views, 10 RGB-D sensors, Hardware-based sync, and Calibration.

Read More
IntraFace and FeelingSpector

IntraFace and FeelingSpector

C++ GUI developer and multi-threading optimization. IntraFace is a facial tracking and emotion detection library.

Read More
OpenPose Unity Plugin

OpenPose Unity Plugin

Co-author. OpenPose plugin for Unity users.

Read More
Human Foot Keypoint Dataset

Human Foot Keypoint Dataset

Co-author. Publicly released the first dataset of human foot keypoints (approximately 15000 person annotations).

Read More
Face Swapping

Face Swapping

Personal project. Programmed in C++ with the Vulkan Graphics API.

Read More

Publications and Conferences



OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, Yaser Sheikh
Dec 2018
PDF | arXiv | OpenPose | Foot Dataset



Efficient Online Multi-Person 2D Pose Tracking with Recurrent Spatio-Temporal Affinity Fields
Yaadhav Raaj, Haroon Idrees, Gines Hidalgo, Yaser Sheikh
Nov 2018
PDF | arXiv



OpenPose: A Real-Time Multi-Person Keypoint Detection Library
Gines Hidalgo, Zhe Cao, Tomas Simon, Shih-En Wei, Hanbyul Joo, Yaser Sheikh
CVPR 2017 (demo)
OpenPose


Press Coverage











OpenPose and the Panoptic Studio:

IntraFace:

OpenPose and the Panoptic Studio (Spanish links):

Contact


  • Smith Hall Room 201, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA