Hands-on web simulations, playable RL agents, and visual decision engines built from my research papers and software repositories.
Play Mississippi Marbles manually or toggle the optimal dynamic programming / Monte Carlo expected value (EV) policy solver to visualize optimal decision boundaries.
Challenge a trained Rainbow DQN neural network in real-time. View live column Q-values and search probability distributions on every turn.
Simulate 24/7 continuous mining haul road dispatch logistics. Tweak fleet allocations (140t vs 110t trucks), shift durations, and crusher capacities to analyze throughput bottlenecks.
Explore hippocampal spatial localization using Continuous Attractor Networks (CAN). Move a virtual agent inside a 2D arena and observe periodic hexagonal grid cell firing patterns.
Custom Bridge dealing tool built for practicing bidding conventions, hand analysis, and vulnerability scenarios.