Marginal conditional expectations
marginal_expectation(rew, pos, N, alpha, S, obs, weight)A vector with the expected time spent in each state by the marginal, conditional on the observations.
Column of the reward matrix corresponding to its marginal.
Vector that indicates which state is associated to a positive reward.
Uniformization parameter.
Marginal initial distribution vector.
Marginal sub-intensity matrix.
Marginal observations.
Marginal weights.