Mountain Car
CS747 Intelligent and Learning Agents
A car is on a one-dimensional track, positioned between two "mountains". The goal is to drive up the mountain on the right; however, the car's engine is not strong enough to scale the mountain in a single pass.
Multi Armed Bandits
CS747 Intelligent and Learning Agents
In a bandit instance, each arm provides a random reward from a probability distribution specific to that arm, this distribution is not known a-priori and it may even change. The objective of the gambler is to maximize the sum of rewards earned through the arms which is same as minimising the 'regret'.
MDP Planning
CS747 Intelligent and Learning Agents
In Reinforcement Learning problems, Markov Decision Processes (MDPs) describe the change in environment which changes its state in response to agent's actions. The state of the environment affects the immediate reward obtained by the agent, as well as the probabilities of future state transitions. The agent's objective (also called MDP Planning) is to select actions to maximize a expected long-term total reward.
Moustique Cipher
EE720 An Introduction to Number Theory and Cryptography
Team Members: Param Rathour and Prathamesh Dhake
Moustique is a Self-synchronizing stream cipher that was broken in the final round of the eStream project. Here we present its reduced size analog.
Tennis Scordboard Simulator
EE337 Microprocessors Laboratory
Simulate a scoreboard for a tennis match in the best-of-three tiebreak set format in Embedded C. The inputs of the scorer will be obtained using key presses on a keyboard connected to Pt-51 using UART.
Music Synthesizer
EE214 Digital Circuits Lab
A music synthesizer circuit to automate the sequence of 8 musical notes to generate music using a finite state machine in VHDL.