Projects

Start with the implementations behind my reinforcement learning research, then explore earlier applied and learning projects.

Research implementations

SCORER

ICLR, 2026. JAX / Python.

A Stackelberg formulation lets representations adapt faster than value estimates, stabilizing their interaction in deep Q-learning.

CORAL

IJCAI, 2026. JAX / Python.

A pretrained world model communicates reusable context, helping a separate control agent learn faster and adapt to new tasks.

Applied and learning projects

Snake: reinforcement learning agent

Independent learning project

A neural-network-based reinforcement learning agent that learns to play Snake. A compact implementation of the environment–agent learning loop.

Reinforcement learning · Neural Q-function

Predicting term deposit subscriptions

Data mining course project

A bank marketing classification project predicting whether a customer will subscribe to a term deposit, with code, report, and slides.

Classification · Model evaluation

The stable marriage problem

Algorithms & game theory study

An investigation of stable matching and its applications, presented through a written report and slides.

Stable matching · Game theory

Netflix recommendation system

Independent learning project

A recommendation systems learning project using Netflix competition data, with the implementation available on GitHub.

Recommendation systems

Mini Imagen study

Independent study · In progress

An exploratory implementation study of text-to-image diffusion models, inspired by Imagen. This work is in progress.

Text-to-image diffusion

More code on GitHub.