You might also like

More about Indexable Restless Bandits

• Book details
• Synopsis
• Trending among others

You get 189 loyalty points

Book synopsis

This book concerns two broad classes of Markov §decision problems that fall within the family §of "restless bandits", an intractable class of §decision processes introduced by P. Whittle.§For the first class of problems, we employ Gittins'' §index theory to establish the indexability of (inter-§alia) general families of restless bandits that §arise in problems of machine maintenance and §stochastic scheduling with switching penalties. We §also give formulae for the resulting indices.§The second class of problems involves two families §of Markov decision problems that can be identified §as "bi-directional" restless bandits. The "spinning §plates" problem concerns the optimal management of a §portfolio of reward-generating assets whose yields §grow with investment but otherwise tend to decline. §In the model of asset exploitation called the "squad §system", the yield from an asset tends to decline §when it is used but will recover when the asset is §at rest. In both cases simply stated conditions are §given which guarantee indexability of the problem. §In all cases, numerical investigations testify the §outstandingly good performance of the index §heuristics concerned.

Book details

Book category Books in English Mathematics & science Mathematics

• Full title: Indexable Restless Bandits
• Subtitle: Index Policies for Some Families of Stochastic Scheduling and Dynamic Allocation Problems
• Author: Diego Ruiz-Hernandez
• Language: English
• Binding: Paperback
• Number of pages: 204
• EAN: 9783639038958
• ISBN: 3639038959
• ID: 06813531
• Publisher: VDM Verlag Dr. Mueller E.K.
• Weight: 299 g
• Dimensions: 229 × 152 × 11 mm
• Date of publishing: 01. October 2008

Trending among others

---

---

---