Projects

2021

Mountain Car

Mountain Car

CS747 Intelligent and Learning Agents

A car is on a one-dimensional track, positioned between two "mountains". The goal is to drive up the mountain on the right; however, the car's engine is not strong enough to scale the mountain in a single pass.

Multi Armed Bandits

Multi Armed Bandits

CS747 Intelligent and Learning Agents

In a bandit instance, each arm provides a random reward from a probability distribution specific to that arm, this distribution is not known a-priori and it may even change. The objective of the gambler is to maximize the sum of rewards earned through the arms which is same as minimising the 'regret'.

MDP Planning

MDP Planning

CS747 Intelligent and Learning Agents

In Reinforcement Learning problems, Markov Decision Processes (MDPs) describe the change in environment which changes its state in response to agent's actions. The state of the environment affects the immediate reward obtained by the agent, as well as the probabilities of future state transitions. The agent's objective (also called MDP Planning) is to select actions to maximize a expected long-term total reward.

Moustique Cipher

Moustique Cipher

EE720 An Introduction to Number Theory and Cryptography

Team Members: Param Rathour and Prathamesh Dhake

Moustique is a Self-synchronizing stream cipher that was broken in the final round of the eStream project. Here we present its reduced size analog.

Tennis Scoreboard Simulator

Tennis Scordboard Simulator

EE337 Microprocessors Laboratory

Simulate a scoreboard for a tennis match in the best-of-three tiebreak set format in Embedded C. The inputs of the scorer will be obtained using key presses on a keyboard connected to Pt-51 using UART.

Music Synthesizer

Music Synthesizer

EE214 Digital Circuits Lab

A music synthesizer circuit to automate the sequence of 8 musical notes to generate music using a finite state machine in VHDL.

2020

Distributed Deep Learning

Distributed Deep Learning

Institute Technical Summer Project Institute Technical Council, IIT Bombay

Team Members: Param Rathour, Sumit Jain, Aditya Bhaskar, Ritik Mandal

Deep learning models are now extensively used in various domains ranging from medical imaging to the automobile industry. Yet, to date, deep learning models fail when it comes to playing around with high-resolution data. Our model uses a hierarchy-based model to achieve synchronous parallel computations distributed to multiple machines.

Arithmetic Logic Unit

Arithmetic Logic Unit

EE224 Digital Systems

Team Members: Param Rathour, Darin Jeff, Aanal Sonara, Madhav Vadlamani

A signed 16-bit ALU using Structural VHDL which computes addition, subtraction, bitwise NAND & XOR. Performs signed addition using 16-bit Kogge–Stone fast adder.

2019

Remote Control Plane

RC Plane Competition Aeromodelling Club, IIT Bombay

Team Members: Param Rathour, Sumit Jain, Veda Pranav, Rajesh Dasari

Made a Radio Controlled Trainer Plane powered by BLDC Motor

Remote Control Bot

XLR8 Electronics and Robotics Club, IIT Bombay

Team Members: Param Rathour, Vineet Gala, Abhinav Kumar

Made a Bluetooth Controlled bot, using AT-tiny 2313 Microcontroller and L293D Motor Driver energised by Li-ion battery