About Me

I am a Ph.D. student at the University of Alberta, working with Professor Rich Sutton in the Reinforcement Learning and Artificial Intelligence (RLAI) lab. I want to discover the general principles that underlie goal-seeking behaviour. I study how the mind works and how intelligent systems can learn to perform a myriad of tasks over their lifetime. I believe research progress in these areas will benefit humanity significantly and tangibly, for good.

You can find my resume here.


Recent News


Publications and Pre-prints

Currently, I’m interested in learning and planning methods for continuing (non-episodic) problems in RL.


Talks


Master’s Thesis

This thesis was a part of my integrated Bachelor’s + Master’s program in the Dept. of Computer Science and Engineering at the Indian Institute of Technology Madras in Chennai, India, supervised by Professor Balaraman Ravindran. Presented in May 2018.

My goal was to contribute in making self-driving cars a reality in my country, India. I modeled this as a multi-agent learning problem in a safety-critical application and:

  1. proposed a risk-averse imitation learning algorithm that had lower tail-end risk w.r.t. the then state-of-the-art,
  2. trialled a curriculum-based learning approach for multi-agent RoboSoccer, and
  3. extended the TORCS simulator to release the first open-source driving simulator that supports multi-agent training.

[Thesis PDF, Defense Slides]


Work Experience

Huawei Research

Research Internship; May 2019 – Sep 2019; Edmonton, Canada
With Hengshuai Yao.

Intel Labs

Research Internship; May 2017 – Jul 2017; Bengaluru, India
With Bharat Kaul

Purdue University

Research Internship; May 2016 – Jul 2016; Indiana, USA
With Bruno Ribeiro

Amazon Development Centre

Technical Internship; May 2015 – Jul 2015; Chennai, India
With Sravan Bodapati and Venkatraman Kalyanapasupathy


Teaching Experience



Community Service


Interests and Hobbies

Formula 1

There’s hardly anything as spectacular as this confluence of science and engineering which gives the world these lean, mean, and beautiful machines, with some of fittest athletes on the planet battling fearlessly at speeds excessive of 300 kmph over 20+ challenging tracks all over the world. Forza Ferrari!

Ice-hockey

One of the fastest sport in the world, with an exhausting 60 minutes of action (yes, even while watching). The wizardry these athletes pull off while on skates is a delight to watch (shoutout to Connor McDavid! #LetsGoOilers). I am currently learning ice-skating in order to start playing ice-hockey by early 2020! learning to play ice-hockey!

Football

I love watching and playing the beautiful game. Come rain or shine, my heart beats for Real Madrid. I also root for Liverpool, Juventus, and Portugal. My idol is, you guessed it, Cristiano Ronaldo — one of the greatest footballers of all time.

Books

If I had to pick one thing of the few things I could do all my life, it would be reading (sports comes first). With three fat bookshelves overflowing with books back home, and many more in my handy Kindle, there are actually times when I am happy to see long queues, presenting another opportunity to dive into my latest book.

Music

During the pandemic, I have started learning to play the piano. I hope to play my favourite piano piece Nuvole Bianche by the end of 2020!

Photography and Traveling

I love visiting and documenting quaint, spectacular places; meeting local people; digging into the native cuisine. You can find some of my photos here. I also love trekking and hiking into the wilderness. After skydiving, scuba diving, and parasailing, I’m looking forward to hang gliding and bungee jumping!


Contact Me

Email ID


Recent Posts

  • Lessons from Peter Thiel's book: Zero to One
    Interesting research-relevant lessons from Peter Thiel's notes on startups and building the future
    December 28, 2020

  • Time Travel, Free Will, P vs NP
    Time travel implies no free will, and that P equals NP?
    April 30, 2020

  • Birds are quite 'intelligent'
    A parrot, with a brain the size of a walnut, showed cognitive and linguistic skills matching those of chimps and 5-year old human toddlers.
    January 15, 2020

  • On the Bellman Equation
    The derivation of the Bellman equation is ... subtle.
    July 24, 2019

  • See All Posts