Resume and Portfolio

About


About
I am a full-time Research Associate at The Robotics Institute, Carnegie Mellon University (CMU) since Fall 2014 and M.S. student since Fall 2016. I am currently working under the supervision of professor Yaser Sheikh, and I previously worked for 2 years with professor Fernando De La Torre.

Projects:
The main projects I have contributed to are OpenPose, OpenPose Unity Plugin, the Panoptic Studio, IntraFace, and the FeelingSpector. I have also collaborated in projects with Ford and General Motors, among others.

Currently I am working on whole-body (body, hands and face) keypoint estimation from single RGB images, focusing on the compression of CNNs to allow accurate whole-body estimation on embedded systems and low-range devices, e.g. cell phones.

Before CMU:
Before joining the Robotics Institute, I obtained a B.S. in Telecommunication System Engineering (similar to Electrical and Computer Engineering in US) from Universidad Politécnica de Cartagena, Spain. While an undergraduate, I had the opportunity to work on stereoscopic image rectification and embedded system problems under the supervision of professor Javier Toledo.

Full CV:
My full CV is available in PDF format and on my LinkedIn profile.

Research and Projects


OpenPose

OpenPose

Lead author. First real-time multi-person system to jointly detect human body, hand, facial, and foot keypoints (in total 135 keypoints) on single images.

Read More
Panoptic Studio

Panoptic Studio

Collaborator. The Panoptic Studio is a Massive Multiview System Dataset that includes: 480 VGA camera views, 30+ HD views, 10 RGB-D sensors, Hardware-based sync, and Calibration.

Read More
IntraFace and FeelingSpector

IntraFace and FeelingSpector

C++ GUI developer and multi-threading optimization. IntraFace is a facial tracking and emotion detection library.

Read More
NEW! OpenPose Unity Plugin

NEW! OpenPose Unity Plugin

Co-author. OpenPose plugin for Unity users.

Read More
Face Swapping

Face Swapping

Personal project. Programmed in C++ with the Vulkan Graphics API.

Read More

Publications and Conferences



OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, Yaser Sheikh
Dec 2018
PDF | arXiv | OpenPose | Foot Dataset



Efficient Online Multi-Person 2D Pose Tracking with Recurrent Spatio-Temporal Affinity Fields
Yaadhav Raaj, Haroon Idrees, Gines Hidalgo, Yaser Sheikh
Dec 2018
PDF | arXiv



OpenPose: A Real-Time Multi-Person Keypoint Detection Library
Gines Hidalgo, Zhe Cao, Tomas Simon, Shih-En Wei, Hanbyul Joo, Yaser Sheikh
CVPR 2017 (demo)
OpenPose


Press Coverage











OpenPose and the Panoptic Studio:

IntraFace:

OpenPose and the Panoptic Studio (Spanish links):

Contact


  • Smith Hall Room 201, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA