profile pic

Ryan S

- Research Program Mentor

MEng Master of Engineering


Deep Reinforcement Learning, Computer Vision, Machine Learning, Neural Networks, Perception

Project ideas

Project ideas are meant to help inspire student thinking about their own project. Students are in the driver seat of their research and are free to use any or none of the ideas shared by their mentors.

Training a Deep Reinforcement Learning Agent with TensorFlow Agents and OpenAI Gym!

Deep Reinforcement Learning is a rapidly growing field at the intersection of machine learning and robotics, and through this project, you will have the chance to implement deep reinforcement learning agents yourself! We will implement this project using TensorFlow-Agents, a powerful library for training agents to solve tasks such as getting a Half-Cheetah to walk, balancing an Inverted Pendulum, or teaching a car to race autonomously (all in simulation).

Fingerprint Classification and Pattern Recognition in Keras

Ever wondered how fingerprint scanners work? In this project, we will study and implement some ways in which fingerprints can be detected and identified using deep learning (implemented through Kerasin Python) and classical computer vision techniques Iimplemented through OpenCV in Python).

Computer Vision for Autonomous Driving!

Fast and accurate vision is a crucial component for the successful adoption of autonomous vehicles as a widespread technology. In this project, we will use Python and PyTorch, a deep learning library, to segment different objects using RGB cameras and lidar sensors!

Coding skills

python, PyTorch, TensorFlow, NumPy, Scikit-Learn, AWS, Ubuntu, ROS, C++, Stata, Matlab, SLURM

Interested in working with expert mentors like Ryan?

Apply now