Amir Hamedi

Amir Hamedi · Ontario, Canada

Machine learning for complex process systems.

Machine Learning Engineer | Reinforcement Learning Researcher | Process Systems & Control Engineer

I am a machine-learning and process-systems engineer working across reinforcement learning, scientific machine learning, and control. I develop data-driven methods for complex process systems in simulation and laboratory settings.

Portrait of Amir Hamedi

Education

2022 - Expected Jan 2027

PhD Process Systems Engineering

McMaster University
McMaster University logo
ControlReinforcement LearningScientific Machine Learning GPA 4.0 / 4.0
2018 - 2021

MSc Process Design Engineering

University of Tehran
University of Tehran logo
Heuristic OptimizationMachine Learning
2012 - 2017

BSc Chemical Engineering

Iran University of Science and Technology
Iran University of Science and Technology logo
Simulation

Selected work

6 case studies spanning reinforcement learning, scientific machine learning, control, laboratory experimentation, and data engineering.

01 / RESEARCH

MPC-Pretrained Reinforcement Learning

Four-stage diagram showing offline MPC demonstration generation, behavioral cloning and offline critic training, online TD3 control with bounded actions and mixed replay, and final evaluation without exploration or network updates. MPC is used to initialize the RL policy and is not the online controller.

Developed an RL-centered workflow that initializes Twin Delayed Deep Deterministic Policy Gradient (TD3) from model predictive control demonstrations, then gives the neural policy direct control and online adaptation across polymer-reactor and Aspen Dynamics C2-splitter simulations.

Collaboration: Linde

Open case study

02 / RESEARCH

Multi-Channel RL-Assisted MPC

A vertical controller pipeline connects measurements and targets to horizon and weight configuration, dynamic-matrix correction, constrained MPC, residual projection, and a simulated process. A DQN assistant and three TD3 assistants each pass through a separate critic gate, with a dashed simulation-learning path below.

Designed a four-channel RL-assisted MPC architecture in which DQN and TD3 agents propose bounded controller adjustments and channel-specific critic gates decide whether to use each learned proposal or a conservative supervisor action.

Collaboration: Linde

Open case study

03 / RESEARCH

Stability-Aware Reinforcement Learning

A left-to-right flow from measurements and target through TD3, one-step prediction, and a Lyapunov acceptance test. The accepted path goes to the applied input; the rejected path goes to GART-LMPC fallback before joining the applied-input path. Process feedback closes the loop, while reward, replay, and policy updates appear in a separate training-only lane.

Developed an RL-first control architecture in which TD3 proposes continuous coolant and monomer flow commands and a Lyapunov-guided GART-LMPC layer evaluates each move before it is applied to a simulated polymerization reactor.

Collaboration: Linde

Open case study

06 / SOFTWARE & DATA

Finance Assistance

Layered architecture showing generic read-only financial inputs flowing through encrypted evidence stores and typed adapters into an exact canonical ledger, reconciliation, categorization, operations, typed queries, and Dashboard v2, with a dashed planned AI layer.

Finance Assistance is a local-first platform that converts heterogeneous financial records into traceable accounting and read-only analytics, with guarded machine-learning categorization and a planned path toward human-reviewed AI portfolio decision support.

Open case study

Technical expertise

Reinforcement Learning

Value-based, actor-critic, and policy-optimization methods for discrete and continuous control, including DQN, TD3, TD7, and SAC; behavioral cloning, imitation learning, advanced experience replay, offline-to-online learning, and safe-RL action screening.

Machine Learning

Deep-learning architectures spanning convolutional, recurrent, attention-based, and sequence-modeling methods; time-series modeling, PINNs, generative models, PCA/PLS, autoencoders, clustering, classical machine learning, and LLM applications.

Control & Optimization

Linear and nonlinear control, model predictive control, linear and nonlinear optimization, and metaheuristic optimization for nonlinear process systems.

Software & Platforms

Python, PyTorch, MATLAB/Simulink, Aspen Plus/Dynamics, Pyomo/IPOPT, SQL, Power BI, Tableau, Minitab, Git, and LaTeX; laboratory automation and hardware integration.

Current trajectory

Graduate Researcher and PhD Candidate

2022 - Present

McMaster University

Research in deep reinforcement learning, safe reinforcement learning, scientific machine learning, and control for nonlinear process systems across simulation, Aspen Dynamics, and laboratory experimentation.

Teaching Assistant

2023 - 2026

McMaster University

Supported Process Control, Transport Phenomena, and Reactor Design through tutorials, grading, student consultation, and examination support.

Selected publications

2026

A Practical MPC-Pretrained Reinforcement Learning Framework for Complex Process Systems

Amir Hossein Hamedi, Hesam Hassanpour, Ankur Kumar, Atharva Vijay Suryavanshi, Prashant Mhaskar

Industrial & Engineering Chemistry Research

2026

Critic-Based Supervisory Gating for Multi-Channel Reinforcement Learning-Assisted Model Predictive Control

Amir Hossein Hamedi, Hesam Hassanpour, Ankur Kumar, Atharva Vijay Suryavanshi, Prashant Mhaskar

Computers & Chemical Engineering

2026

Practical Stability Net Based Reinforcement Learning Control from Step-Test Data

Amir Hossein Hamedi, Ankur Kumar, Atharva Vijay Suryavanshi, Prashant Mhaskar

Optimal Control Applications and Methods

View all publications →

Let’s connect

I welcome conversations about intelligent process systems, control, machine learning, reinforcement learning, and applied research collaborations.