Research & Projects

Research & Projects

My work combines reinforcement learning, machine learning, process systems engineering, control, and applied software. Explore the systems, methods, and results behind each project.

01 / RESEARCH

MPC-Pretrained Reinforcement Learning

Four-stage diagram showing offline MPC demonstration generation, behavioral cloning and offline critic training, online TD3 control with bounded actions and mixed replay, and final evaluation without exploration or network updates. MPC is used to initialize the RL policy and is not the online controller.

Developed an RL-centered workflow that initializes Twin Delayed Deep Deterministic Policy Gradient (TD3) from model predictive control demonstrations, then gives the neural policy direct control and online adaptation across polymer-reactor and Aspen Dynamics C2-splitter simulations.

Collaboration: Linde

Open case study

02 / RESEARCH

Multi-Channel RL-Assisted MPC

A vertical controller pipeline connects measurements and targets to horizon and weight configuration, dynamic-matrix correction, constrained MPC, residual projection, and a simulated process. A DQN assistant and three TD3 assistants each pass through a separate critic gate, with a dashed simulation-learning path below.

Designed a four-channel RL-assisted MPC architecture in which DQN and TD3 agents propose bounded controller adjustments and channel-specific critic gates decide whether to use each learned proposal or a conservative supervisor action.

Collaboration: Linde

Open case study

03 / RESEARCH

Stability-Aware Reinforcement Learning

A left-to-right flow from measurements and target through TD3, one-step prediction, and a Lyapunov acceptance test. The accepted path goes to the applied input; the rejected path goes to GART-LMPC fallback before joining the applied-input path. Process feedback closes the loop, while reward, replay, and policy updates appear in a separate training-only lane.

Developed an RL-first control architecture in which TD3 proposes continuous coolant and monomer flow commands and a Lyapunov-guided GART-LMPC layer evaluates each move before it is applied to a simulated polymerization reactor.

Collaboration: Linde

Open case study

06 / SOFTWARE & DATA

Finance Assistance

Layered architecture showing generic read-only financial inputs flowing through encrypted evidence stores and typed adapters into an exact canonical ledger, reconciliation, categorization, operations, typed queries, and Dashboard v2, with a dashed planned AI layer.

Finance Assistance is a local-first platform that converts heterogeneous financial records into traceable accounting and read-only analytics, with guarded machine-learning categorization and a planned path toward human-reviewed AI portfolio decision support.

Open case study