The paper's findings, part by part

Optimal Monetary Policy When the Economy Must Be Learned

The paper trains a monetary policy rule by reinforcement learning inside a world model estimated from the real-time record of the United States and reads the rule against the FOMC's decisions.

The four learners and the finding

What the paper finds

Optimal policy against a model that must be learned from the record is a rule whose optimality is conditional on four learners, each measured on real-time data for the United States; the rule sits above the FOMC's decisions on average, and the distance is learned from the record.

+0.768
mean difference of the agent of record from the FOMC, points, all 118 quarters
+0.235
mean difference of the agent frozen at 2015:Q4 from the FOMC over the 42 quarters after it, points
+1.297
mean difference of the agent of record from the FOMC over the same 42 quarters, points
+0.02
mean difference of the rolling real-time agent from the FOMC, 2006:Q1–2015:Q4, points

The four learners

Learning enters at four levels: the economy's agents, the econometrician, a correction, and the policymaker.

The economy's agents

The question is whether the agents' expectation of inflation is the model's own forecast, an anchor, a discounted forecast, or a level updated from experience. On the record, three families of departures each estimate at the model-consistent value.

The econometrician

The blocks of the world model are learned from the real-time record by a likelihood filter. The record fixes the Phillips slope and the weight on expected inflation; it does not fix the scale of the policy block, which a convention does.

The correction

Nonparametric components on the residuals learn what the blocks miss. Against a null that carries a floor spell, the Phillips component carries no signal, and the IS component does; neither enters the environment the rule is trained in.

The policymaker

The rule is learned by reinforcement inside the estimated economy, so what the first three learners get wrong is the fourth learner's opportunity. The rule is selected on a held-out validation set, and its distance from the FOMC is read against what the record had taught it by the decision date.