Table 1.

Environment transition probabilities across endophenotypes controlled by the RL model

Transition DescriptionProbability for each phase
P (f1)P (f2)P (f3)P (f4)
P(s=i|s=i,a=as=i), i neutral state1111From Neutral States
P(s=i+j|s=i,a=as=i+j),j=+1/-1, i neutral
state, i+j neutral state
0.990.990.990.99
P(s=i|s=i,a=as=i+j) ,j=+1/-1, i neutral state,
i+j neutral state
0.010.010.010.01
P(s=i+k|s=i,a=as=i+k),k!=+1/-1, i neutral
state, i+k neutral state
0.00010.00010.00010.0001
P(s=i|s=i,a=as=i+k),k!=+1/-1, i neutral
state, i+k neutral state
0.99990.99990.99990.9999
P(s=i|s=i,a=aw), i neutral state1111
P(s=1|s=2,a=ag)1111
P(s=i|s=i,a=ag), i!=2 neutral state1111
P(s=8|s=7,a=ad)1111
P(s=i|s=i,a=ad), i!=7 neutral state1111
P(s=i|s=i,a=ag), i drug/aft state0.9990.9990.80.999From Drug/aft States
P(s=4|s=i,a=ag), i drug/aft state0.0010.0010.20.001
P(s=i|s=i,a=as=*), i drug/aft state0.9990.9990.80.999
P(s=4|s=i,a=as=*), i drug/aft state0.0010.0010.20.001
P(s=j|s=i,a=aw), i!=15 drug/aft state, j next or previous drug/aft state0.49950.49950.44.995
P(s=4|s=i,a=aw), i!=15 drug/aft state0.0010.0010.20.001
P(s=14/16|s=15,a=aw)0.20.20.150.2
P(s=4|s=15,a=aw)0.60.60.70.6
P(s=j|s=i,a=ad), i drug/aft state, j next drug/aft state0.7450.7450.60.745
P(s=j|s=i,a=ad), i drug/aft state, j previous drug/aft state0.2450.2450.20.245
P(s=4|s=i,a=ad), i drug/aft state0.010.010.20.01
P(s=4|s=1,a=ag)1111Goal
P(s=1|s=1,a=as=*)1111
P(s=1|s=1,a=aw)1111
P(s=1|s=1,a=ad)1111
  • Changes during phases in italic.