InfoResearchPeer-reviewed
Offline Inverse Constrained Reinforcement Learning for Safe-Critical Decision Making in Healthcare
- Published
- Record updated
Summary
Researchers propose the constraint transformer (CT), a method for inferring safety constraints from offline healthcare treatment records, since existing inverse constrained reinforcement learning assumes Markovian decisions and real-time interaction. CT uses causal attention over historical decisions and observations, a non-Markovian weighted-constraint layer, and a generative world model for data augmentation. In several medical scenarios, CT captured unsafe states and approximated lower mortality rates while reducing unsafe behavior probability.