Hallo! Tracked shipping to Netherlands with Delivery Duty Paid for just €7 

Ship to
Netherlands
0

My Account

  • argentina
  • chile
  • colombia
  • españa
  • méxico
  • perú
  • estados unidos
  • internacional

menu

Select your country

Americas

Europe

Rest of the world

portada Discrete-Time Markov Control Processes: Basic Optimality Criteria
Type
Physical Book
Author
Publisher
Language
English
Pages
216
Format
Paperback
Dimensions
23.4x15.6x1.3 cm
Weight
0.34 kg.
ISBN13
9781461268840
Categories

Discrete-Time Markov Control Processes: Basic Optimality Criteria

Jean B. Lasserre (Author) · Onésimo Hernández-Lerma (Author) · Springer · Paperback

Discrete-Time Markov Control Processes: Basic Optimality Criteria - Hernandez-Lerma, Onesimo ; Lasserre, Jean B.

New Book Imported to Netherlands
Delivery: 18 Sep - 22 Sep Shipping: 6 to 7 business days.
€ 134,25
Import costs and 9% BTW included in the price ✅
€ 134,25

Choose the list to add your product or create one New List

Go to My Wishlists
Calculate shipping cost

Synopsis "Discrete-Time Markov Control Processes: Basic Optimality Criteria"

This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro- grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re- source management, (control of) epidemics, etc. However, most of the lit- erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-satisfies none of these conditions. Moreover, when dealing with "partially observable" systems) a standard approach is to transform them into equivalent "completely observable" sys- tems in a larger state space (in fact, a space of probability measures), which is uncountable even if the original state process is finite-valued.

Customers reviews

More customer reviews
  • 0% (0)
  • 0% (0)
  • 0% (0)
  • 0% (0)
  • 0% (0)

Frequently Asked Questions about the Book

Is the book original?

All books in our catalog are Original.

In what language is the book written?

The book is written in English.

What is the format of this book?

The binding of this edition is Paperback.

Questions and Answers about the Book

Do you have a question about the book? Login to be able to add your own question.

Opinions about Bookdelivery

More customer reviews