Résumé and Portfolio

About image
Expert in leading development, industrialization, and maintenance of high impact research projects used by thousands of users, focused primarily on easy-to-use API design (6+ YOE) and secondarily on computationally-performant software (9+ YOE; including multi-threading, Pybinding, CUDA/HLSL, AVX vectorization). Worked in the areas of human photorealism, deep learning, and computer vision. Lead author of OpenPose (25k+ stars on GitHub, 9k+ Google citations) and UE5’s Neural Network Inference (NNI). Managed and mentored FTEs, interns and students in research and software development.


Research Engineer, Reality Labs Research, Meta:
Starting in January 2022, I am part of the Meta family :)

Research Engineer, Epic Games:
Starting in June 2019, I am part of the Epic Games family :)

M.S. in Robotics and full-time Research Associate, CMU:
I was a full-time Research Associate at The Robotics Institute, Carnegie Mellon University (CMU) since the Fall of 2014 and M.S. student since the Fall of 2016. I graduated in May 2019. I am currently working under the supervision of professor Yaser Sheikh, and I previously worked for 2 years with professor Fernando De La Torre. The main projects I have contributed to are OpenPose, OpenPose Unity Plugin, the Panoptic Studio, IntraFace, and the FeelingSpector. I have also collaborated in projects with Ford and General Motors and IARPA, among others.

B.S. in Telecommunication System Engineering, UPCT: 
Before joining the Robotics Institute, I obtained a B.S. in Telecommunication System Engineering (similar to Electrical and Computer Engineering in US) from Universidad Politécnica de Cartagena (UPCT), Spain. While an undergraduate, I had the opportunity to work on stereoscopic image rectification and embedded system problems under the supervision of professor Javier Toledo.

Full CV:
My full CV is available on my LinkedIn profile.

Relevant projects I have highly contributed to

OpenPose

OpenPose

25k+ stars on GitHub, 9k+ Google citations. Lead author. First real-time multi-person system to jointly detect human body, hand, facial, and foot keypoints (in total 135 keypoints) on single images.

Read More  
MetaHuman Creator

MetaHuman Creator

Free cloud-based app that empowers anyone to create photorealistic digital humans, complete with hair and clothing, in minutes. MetaHumans come fully rigged and ready to animate in your Unreal Engine projects.

Read More  
Panoptic Studio

Panoptic Studio

Collaborator. The Panoptic Studio is a Massive Multiview System Dataset that includes: 480 VGA camera views, 30+ HD views, 10 RGB-D sensors, Hardware-based sync, and Calibration.

Read More  
IntraFace and FeelingSpector

IntraFace and FeelingSpector

C++ GUI developer and multi-threading optimization. IntraFace is a facial tracking and emotion detection library.

Read More  
OpenPose Unity Plugin

OpenPose Unity Plugin

Co-author. OpenPose plugin for Unity users.

Read More  
Human Foot Keypoint Dataset

Human Foot Keypoint Dataset

Co-author. Publicly released the first dataset of human foot keypoints (approximately 15000 person annotations).

Read More  
Face Swapping

Face Swapping

Personal project. Programmed in C++ with the Vulkan Graphics API.

Read More  
Single-Network Whole-Body Pose Estimation
Gines Hidalgo, Yaadhav Raaj, Haroon Idrees, Donglai Xiang, Hanbyul Joo, Tomas Simon, Yaser Sheikh
ICCV 2019
PDF | arXiv | OpenPose Training | OpenPose


OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, Yaser Sheikh
IEEE TPAMI 2019
PDF | IEEE TPAMI | arXiv | OpenPose | Foot Dataset


Efficient Online Multi-Person 2D Pose Tracking with Recurrent Spatio-Temporal Affinity Fields
Yaadhav Raaj, Haroon Idrees, Gines Hidalgo, Yaser Sheikh
CVPR 2019 (Oral)
PDF | arXiv


OpenPose: A Real-Time Multi-Person Keypoint Detection Library
Gines Hidalgo, Zhe Cao, Tomas Simon, Shih-En Wei, Hanbyul Joo, Yaser Sheikh
CVPR 2017 (demo)
OpenPose


Some news involving projects I have worked on










Epic Games

OpenPose and the Panoptic Studio

IntraFace

OpenPose and the Panoptic Studio (Spanish links)

Others (Spanish links)

  • 2501 Smallman St, Pittsburgh, PA 15222, USA