L2

Question 1

Reward of a state

Answer 1

Immediate feedback from entering a state.

Question 2

Utility of a state

Answer 2

Long term feedback from entering a state including future reward based on the policy.

Question 3

Markovian Property

Answer 3

Only the present matters / Your transition state only depends on the current state.