Resume and Portfolio

About


About
Expert in computationally efficient human pose estimation, deep learning, and computer vision. Lead author of OpenPose (13,000+ stars in GitHub). 5+ years of experience in performance-oriented C++ software development, including multi-threading, CUDA, AVX vectorization, and embedded system programming. Mentored multiple students in research and software development, culminating in their contribution to OpenPose. Proven expertise in translating research projects into successful open-source libraries.

Engine Programmer, Epic Games:
Starting in June 2019, I am part of the Epic Games family :)

M.S. in Robotics and full-time Research Associate, CMU:
I was a full-time Research Associate at The Robotics Institute, Carnegie Mellon University (CMU) since Fall 2014 and M.S. student since Fall 2016. I graduated in May 2019. I am currently working under the supervision of professor Yaser Sheikh, and I previously worked for 2 years with professor Fernando De La Torre. The main projects I have contributed to are OpenPose, OpenPose Unity Plugin, the Panoptic Studio, IntraFace, and the FeelingSpector. I have also collaborated in projects with Ford and General Motors and IARPA, among others.

B.S. in Telecommunication System Engineering, UPCT: 
Before joining the Robotics Institute, I obtained a B.S. in Telecommunication System Engineering (similar to Electrical and Computer Engineering in US) from Universidad Politécnica de Cartagena (UPCT), Spain. While an undergraduate, I had the opportunity to work on stereoscopic image rectification and embedded system problems under the supervision of professor Javier Toledo.

Full CV:
My full CV is available in PDF format and on my LinkedIn profile.

Research and Projects


OpenPose

OpenPose

Lead author. First real-time multi-person system to jointly detect human body, hand, facial, and foot keypoints (in total 135 keypoints) on single images.

Read More
Panoptic Studio

Panoptic Studio

Collaborator. The Panoptic Studio is a Massive Multiview System Dataset that includes: 480 VGA camera views, 30+ HD views, 10 RGB-D sensors, Hardware-based sync, and Calibration.

Read More
IntraFace and FeelingSpector

IntraFace and FeelingSpector

C++ GUI developer and multi-threading optimization. IntraFace is a facial tracking and emotion detection library.

Read More
OpenPose Unity Plugin

OpenPose Unity Plugin

Co-author. OpenPose plugin for Unity users.

Read More
Human Foot Keypoint Dataset

Human Foot Keypoint Dataset

Co-author. Publicly released the first dataset of human foot keypoints (approximately 15000 person annotations).

Read More
Face Swapping

Face Swapping

Personal project. Programmed in C++ with the Vulkan Graphics API.

Read More

Publications and Conferences


[Coming soon]
Single-Network Whole-Body Pose Estimation
Gines Hidalgo, Yaadhav Raaj, Haroon Idrees, Donglai Xiang, Hanbyul Joo, Tomas Simon, Yaser Sheikh
ICCV 2019
Links coming soon: PDF | arXiv | OpenPose Training | OpenPose


OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, Yaser Sheikh
IEEE TPAMI 2019
PDF | IEEE TPAMI | arXiv | OpenPose | Foot Dataset


Efficient Online Multi-Person 2D Pose Tracking with Recurrent Spatio-Temporal Affinity Fields
Yaadhav Raaj, Haroon Idrees, Gines Hidalgo, Yaser Sheikh
CVPR 2019 (Oral)
PDF | arXiv


OpenPose: A Real-Time Multi-Person Keypoint Detection Library
Gines Hidalgo, Zhe Cao, Tomas Simon, Shih-En Wei, Hanbyul Joo, Yaser Sheikh
CVPR 2017 (demo)
OpenPose


Press Coverage











OpenPose and the Panoptic Studio:

IntraFace:

OpenPose and the Panoptic Studio (Spanish links):

Others (Spanish links):

Contact


  • Smith Hall Room 201, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA