Markov processes

Books

Adaptive Markov control processes
Hernández-Lerma, O.  Hern?dez-Lerma, O.  Hern?andez-Lerma, O. 
Publisher: Springer-Verlag
ISBN10: 0387969667 ISBN13: 9780387969664 DDC: 510 s LCC: QA1 Edition: (alk. paper)

Additive and cancellative interacting particle systems
Griffeath, David 
Publisher: Springer-Verlag
ISBN10: 038709508X ISBN13: 9780387095080 DDC: 510 s LCC: QA3

Algorithms for random generation and counting: a Markov chain approach
Sinclair, Alistair 
Publisher: Birkhäuser
ISBN10: 0817636587 ISBN13: 9780817636586 DDC: 519.2/33 LCC: QA274.7 Edition: (acid-free)