Resume and Portfolio

About


About
I am a full-time Research Associate at The Robotics Institute, Carnegie Mellon University (CMU) since Fall 2014 and M.S. student since Fall 2016. I am currently working under the supervision of professor Yaser Sheikh, and I previously worked for 2 years with professor Fernando De La Torre.

Projects:
The main projects I have contributed to are OpenPose, the Panoptic Studio, IntraFace, and the FeelingSpector. I have also collaborated in projects with Ford and General Motors, among others.

Currently I am working on whole-body (body, hands and face) keypoint estimation from single RGB images, focusing on the compression of CNNs to allow accurate whole-body estimation on embedded systems and low-range devices, e.g. cell phones.

Before CMU:
Before joining the Robotics Institute, I obtained a B.S. in Telecommunication System Engineering (similar to Electrical and Computer Engineering in US) from Universidad Politécnica de Cartagena, Spain. While an undergraduate, I had the opportunity to work on stereoscopic image rectification and embedded system problems under the supervision of professor Javier Toledo.

Paper and conferences:
Efficient Online Multi-Person 2D Pose Tracking with Recurrent Spatio-Temporal Affinity Fields
Yaadhav Raaj, Haroon Idrees, Gines Hidalgo, Yaser Sheikh

OpenPose: A Real-Time Multi-Person Keypoint Detection Library
Gines Hidalgo, Zhe Cao, Tomas Simon, Shih-En Wei, Hanbyul Joo, Yaser Sheikh
CVPR 2017 (demo)

Full CV:
My full CV is available in PDF format and on my Linkedin profile.

Lead author

OpenPose

First real-time multi-person system to jointly detect human body, hand, facial, and foot keypoints (in total 135 keypoints) on single images.

Collaborator

Panoptic Studio

Massive Multiview System Dataset - 480 VGA camera views - 30+ HD views - 10 RGB-D sensors - Hardware-based sync - Calibration

C++ GUI developer and multi-threading optimization

IntraFace

Facial tracking library

C++ GUI developer and multi-threading optimization

FeelingSpector

The machine that can tell your mood (located at CMU and Pittsburgh International Airport)

Personal project

Face Swapping

Programmed in C++ with the Vulkan Graphics API

Media


Media
  1. OpenPose and the Panoptic Studio:
  2. IntraFace:
  3. OpenPose and the Panoptic Studio (Spanish links):

Contact


  • Smith Hall Room 201, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA