Research

I study how learned representations and predictive models support decision-making in reinforcement learning. My work connects representation learning and control with game theory and optimization, and explores how agents reuse prior knowledge across tasks.

I am a Computer Science PhD student at Fordham University, supervised by Juntao Chen. My current focus is decentralized multi-agent reinforcement learning using world models.

Research directions

Representation learning and control

Learning useful features and a policy together can create unstable feedback. SCORER and SPRIG study how game-theoretic coordination between representation learning and control can improve this interaction.

SCORER (ICLR 2026) / SPRIG (AAAI PRL Workshop 2025)

World models and transfer

CORAL separates world modeling from control through learned communication. A pretrained information agent provides context that can be reused by a new control agent on unseen tasks.

CORAL (IJCAI 2026)

Decentralized multi-agent learning

CASTLE combines local dynamics and counterfactual social predictions to guide independent PPO. Its world models are pretrained offline and frozen during online learning, with each agent using local information and no inter-agent communication or centralized critic.

CASTLE (preprint, 2026; submitted for review)

LLM guidance for reinforcement learning

Ask the Expert turns occasional LLM recommendations into reward shaping during PPO training for autonomous cyber defense. The deployed policy runs without LLM calls.

Ask the Expert (IEEE GLOBECOM 2026; accepted, proceedings forthcoming)

Earlier applied research

My earlier work includes few-shot network attack detection, visual attention, interpretable learning for healthcare, and the evaluation of AI-generated text and images. These projects inform my interest in generalization and careful empirical evaluation.

Browse all publications