Dhiraj Gandhi

I am a first year Masters student at The Robotics Institute, Carnegie Mellon University (CMU) advised by Abhinav Gupta.

I have completed my bachelors in Mechanical engineering from Indian Institute of Technology (IIT) Guwahati in 2015. Before joining CMU, I had spent around half a year as engineer at The Hitech Robotic Systemz


Press Coverage

Robot Learning in Homes: Improving Generalization and Reducing Dataset Bias

Learning to Fly by Crashing

Curious Robot

SBS Review
Research and Selected Projects

Robot Learning in Homes: Improving Generalization and Reducing Dataset Bias
Abhinav Gupta, Adithya Murali, Dhiraj Gandhi , Lerrel Pinto [Equal contribution]

We present the first systematic effort in collecting a large dataset for robotic grasping in homes. The models trained with our home dataset showed a marked improvement of 43.7% over a baseline model trained with data collected in lab. Our architecture which explicitly models the latent noise in the dataset also performed 10% better than one that did not factor out the noise.


Learning to Grasp Without Seeing
Adithyavairavan Murali, Yin Li, Dhiraj Gandhi, Abhinav Gupta
arXiv, video, dataset, project page

Can a robot grasp an unknown object without seeing it? In this paper, we present a tactile-sensing based approach to this challenging problem of grasping novel objects without prior knowledge of their location or physical properties. Our key idea is to combine touch based object localization with tactile based re-grasping. To train our learning models, we created a large-scale grasping dataset, including more than 30 RGB frames and over 2.8 million tactile samples from 7800 grasp interactions of 52 objects.


CASSL: Curriculum Accelerated Self-Supervised Learning
Adithyavairavan Murali, Lerrel Pinto, Dhiraj Gandhi, Abhinav Gupta
ICRA, 2018
arXiv, video

Recent self-supervised learning approaches focus on using a few thousand data points to learn policies for high-level, low-dimensional action spaces. However, scaling this framework for high-dimensional control require either scaling up the data collection efforts or using a clever sampling strategy for training. We present a novel approach - Curriculum Accelerated Self-Supervised Learning (CASSL) - to train policies that map visual information to high-level, higher- dimensional action spaces.



Learning to Fly by Crashing
Dhiraj Gandhi, Lerrel Pinto , Abhinav Gupta
IROS, 2017
arXiv, video, dataset & trained model

How do you learn to navigate an Unmanned Aerial Vehicle (UAV) and avoid obstacles? In this project, we propose to bite the bullet and collect a dataset of crashes itself! We build a drone whose sole purpose is to crash into objects: it samples naive trajectories and crashes into random objects. We crash our drone around 11K times to create one of the biggest UAV crash dataset. We show that simple self-supervised models learnt on this data is quite effective in navigating the UAV even in extremely cluttered environments with dynamic obstacles including humans.


The Curious Robot: Learning Visual Representations via Physical Interactions
Lerrel Pinto, Dhiraj Gandhi, Yuanfeng Han, Yong-Lae Park and Abhinav Gupta
Spotlight Presentation at ECCV 2016

What is the right supervisory signal to train visual representations? In case of biological agents, visual representation learning does not require semantic labels. In fact, we argue that biological agents use active exploration and physical interactions with the world to learn visual representations unlike current vision systems which just use passive observations (images and videos downloaded from web). Towards this goal, we build one of the first systems on a Baxter platform that pushes, pokes, grasps and actively observes objects in a tabletop environment.

We use these physical interactions to collect more than 130K datapoints, with each datapoint providing backprops to a shared ConvNet architecture allowing us to learn visual representations. We show the quality of learned representations by observing neuron activations and performing nearest neighbor retrieval on this learned representation. Finally we evaluate our learned ConvNet on different image classification tasks.


Auto PID tuning of Automated Guided Vehicle(AGV)
Work experience at The Hi-Tech Robotic Systemz Ltd.

Engineers at company faced difficulties in tuning the AGVs PID controller using the prevalent Ziegler-Nichols technique. This tuning technique was also not robust enough to work on varying loading conditions (from 0-2000lb). To overcome this cumbersome process, I undertook an initiative to automate it. After conducting a literature review and running proof-of-concept experiments in the Gazebo simulator, I implemented a model free Iterative Feedback Tuning scheme. AGVs tuned with this method are running smoothly in production for the past couple of years at the Honda and Nokia plants in India.


Sampling based path planning algorithm
video, code

In this project I tried to study different sampling based algorithms like PRM, RRT, RRT* and implemented them in matlab. I tried to smooth out trajectory obtained using these algorithms using Bezier curve method. Furthermore I tried to exted these algoritms for car like non-holonomic object using Dubins curve and Reeds-Shepps curve.


Design & Development of hybrid legged and wheeled robot
Dhiraj Gandhi, Jagjeet Singh , A. Narayana Reddy
Proceedings of iNaCoMM2015
pdf, video

Wheeled locomotion is most widely used mechanism for mobile robots on even terrain whereas walking mechanism is suitable for mobility of robots on uneven terrain. To achieve advantages of wheeled as well as biped robot, we designed a robot with both mobility mechanisms. A 6-degree of freedom (DoF) biped robot has been constructed with 3 DoF on each leg with mechanism of transforming it into a wheeled robot.

Design of Parrlel Planar Manipulator (PPM)
2014 summer internship at Systemantics
pdf, video

Parallel manipulators have higher payload capacity, higher mechanical rigidity and better accuracy than their serial counter parts. However presence of singularities within the workspace is major problem with these manipulators. In this project I worked on optimizing the ratio of singularity free workspace to the total space occupied by the mechanism with respect to link lenght. Furthermore I extended the work to come up with design algorithm that engineers can use for its optimal design. On application side I used 2RR PPM to deposit glue evenly on engine gaskit in simulation


Design & Development of Spherical Robot
Dhiraj Gandhi, Akshay Khatri and Leena Vachhani
2013 Summer internship at SysCon Dept. IIT Bombay
pdf, video

Spherical Robots have several advantages over robots that use wheels or legs for locomotion, including inner component protection, low rolling resistance, and ability to move in any direction. At the same time, it brings number of challenging problems in modelling, stabilization, and path following. In this project we designed and manufactured novel two pendulum based Spherical robot within diameter of 6 inch and achieved remote controlled omni-directional movements. We also mathematically modeled the system to observe the effect of pendulum state on the motion of robot.

Source stolen from here