Gittins index

The Gittins index is a measure of the reward that can be achieved through a given stochastic process with certain properties, namely: the process has an ultimate termination state and evolves with an option, at each intermediate state, of terminating. Upon terminating at a given state, the reward achieved is the sum of the probabilistic expected rewards associated with every state from the actual terminating state to the ultimate terminal state, inclusive. The index is a real scalar.

Gittins index - Wikipedia Jump to content From Wikipedia, the free encyclopedia Measure in decision theory The Gittins index is a measure of the reward that can be achieved through a given stochastic process with certain properties, namely: the process has an ultimate termination state and evolves with an option, at each intermediate state, of terminating. Upon terminating at a given state, the reward achieved is the sum of the probabilistic expected rewards associated with every state from the actual terminating state to the ultimate terminal state, inclusive. The index is a real scalar . Ter

related reading

• Multi-armed bandit - Wikipediaen.wikipedia.org
• The Multi-Armed Bandit Problem and Its Solutions | Lil'Loglilianweng.github.io
• Optimal stopping - Wikipediaen.wikipedia.org
• Gregory Gundersengregorygundersen.com
• Minimax - Wikipediaen.wikipedia.org
• K V Subrahmanyamcmi.ac.in
• rltheorybook_ABJKS.pdfrltheorybook.github.io
• Joint Optimization at Lunchlydianottingham.substack.com
• Bradley–Terry model - Wikipediaen.wikipedia.org
• The Bayes Banditfrancesco215.github.io
• Pareto front - Wikipediaen.wikipedia.org
• SuttonBartoIPRLBook2ndEd.pdfweb.stanford.edu