Table 5.

Environment parameters across endophenotypes controlled by the RL model

NameDescriptionValue
NTNumber of states22
NGNumber goal states1
NDNumber drug/aftereffect states15
NnNumber neutral states6
NaNumber of actions9
S0Starting state4
RpPunishment at the end of drug/aftereffect consumption-4
RcPunishment in drug/aftereffect area-1.2
RddReward at drug consumption (f2,f4)10
RdtReward at drug consumption in treatment-1
RgReward when entering goal state1
dinitDuration initial (no drug) phase50
ddrug1Duration first drug phase1000
dtpyDuration treatment phase1000
ddrug2Duration second drug phase600