Rabi Bhattacharya

This graduate text presents the elegant and profound theory of continuous parameter Markov processes and many of its applications. The authors focus on developing context and intuition before formalizing the theory of each topic, illustrated with examples. After a review of some background material, the reader is introduced to semigroup theory, including the Hille–Yosida Theorem, used to construct continuous parameter Markov processes. Illustrated with examples, it is a cornerstone of Feller’s seminal theory of the most general one-dimensional diffusions studied in a later chapter. This is followed by two chapters with probabilistic constructions of jump Markov processes, and processes with independent increments, or Lévy processes. The greater part of the book is devoted to Itô’s fascinating theory of stochastic differential equations, and to the study of asymptotic properties of diffusions in all dimensions, such as explosion, transience, recurrence, existence of steady states, and the speed of convergence to equilibrium. A broadly applicable functional central limit theorem for ergodic Markov processes is presented with important examples. Intimate connections between diffusions and linear second order elliptic and parabolic partial differential equations are laid out in two chapters, and are used for computational purposes. Among Special Topics chapters, two study anomalous diffusions: one on skew Brownian motion, and the other on an intriguing multi-phase homogenization of solute transport in porous media.

This graduate text presents the elegant and profound theory of continuous parameter Markov processes and many of its applications. The authors focus on developing context and intuition before formalizing the theory of each topic, illustrated with examples. After a review of some background material, the reader is introduced to semigroup theory, including the Hille–Yosida Theorem, used to construct continuous parameter Markov processes. Illustrated with examples, it is a cornerstone of Feller’s seminal theory of the most general one-dimensional diffusions studied in a later chapter. This is followed by two chapters with probabilistic constructions of jump Markov processes, and processes with independent increments, or Lévy processes. The greater part of the book is devoted to Itô’s fascinating theory of stochastic differential equations, and to the study of asymptotic properties of diffusions in all dimensions, such as explosion, transience, recurrence, existence of steady states, and the speed of convergence to equilibrium. A broadly applicable functional central limit theorem for ergodic Markov processes is presented with important examples. Intimate connections between diffusions and linear second order elliptic and parabolic partial differential equations are laid out in two chapters, and are used for computational purposes. Among Special Topics chapters, two study anomalous diffusions: one on skew Brownian motion, and the other on an intriguing multi-phase homogenization of solute transport in porous media.

This textbook explores two distinct stochastic processes that evolve at random: weakly stationary processes and discrete parameter Markov processes. Building from simple examples, the authors focus on developing context and intuition before formalizing the theory of each topic. This inviting approach illuminates the key ideas and computations in the proofs, forming an ideal basis for further study. After recapping the essentials from Fourier analysis, the book begins with an introduction to the spectral representation of a stationary process. Topics in ergodic theory follow, including Birkhoff’s Ergodic Theorem and an introduction to dynamical systems. From here, the Markov property is assumed and the theory of discrete parameter Markov processes is explored on a general state space. Chapters cover a variety of topics, including birth–death chains, hitting probabilities and absorption, the representation of Markov processes as iterates of random maps, and large deviation theory for Markov processes. A chapter on geometric rates of convergence to equilibrium includes a splitting condition that captures the recurrence structure of certain iterated maps in a novel way. A selection of special topics concludes the book, including applications of large deviation theory, the FKG inequalities, coupling methods, and the Kalman filter. Featuring many short chapters and a modular design, this textbook offers an in-depth study of stationary and discrete-time Markov processes. Students and instructors alike will appreciate the accessible, example-driven approach and engaging exercises throughout. A single, graduate-level course in probability is assumed.

This textbook offers an approachable introduction to stochastic processes that explores the four pillars of random walk, branching processes, Brownian motion, and martingales. Building from simple examples, the authors focus on developing context and intuition before formalizing the theory of each topic. This inviting approach illuminates the key ideas and computations in the proofs, forming an ideal basis for further study. Consisting of many short chapters, the book begins with a comprehensive account of the simple random walk in one dimension. From here, different paths may be chosen according to interest. Themes span Poisson processes, branching processes, the Kolmogorov–Chentsov theorem, martingales, renewal theory, and Brownian motion. Special topics follow, showcasing a selection of important contemporary applications, including mathematical finance, optimal stopping, ruin theory, branching random walk, and equations of fluids. Engaging exercises accompany the theorythroughout. Random Walk, Brownian Motion, and Martingales is an ideal introduction to the rigorous study of stochastic processes. Students and instructors alike will appreciate the accessible, example-driven approach. A single, graduate-level course in probability is assumed.

This graduate-level textbook is primarily aimed at graduate students of statistics, mathematics, science, and engineering who have had an undergraduate course in statistics, an upper division course in analysis, and some acquaintance with measure theoretic probability. It provides a rigorous presentation of the core of mathematical statistics. Part I of this book constitutes a one-semester course on basic parametric mathematical statistics. Part II deals with the large sample theory of statistics - parametric and nonparametric, and its contents may be covered in one semester as well. Part III provides brief accounts of a number of topics of current interest for practitioners and other disciplines whose work involves statistical methods.

This text develops the necessary background in probability theory underlying diverse treatments of stochastic processes and their wide-ranging applications. In this second edition, the text has been reorganized for didactic purposes, new exercises have been added and basic theory has been expanded. General Markov dependent sequences and their convergence to equilibrium is the subject of an entirely new chapter. The introduction of conditional expectation and conditional probability very early in the text maintains the pedagogic innovation of the first edition; conditional expectation is illustrated in detail in the context of an expanded treatment of martingales, the Markov property, and the strong Markov property. Weak convergence of probabilities on metric spaces and Brownian motion are two topics to highlight. A selection of large deviation and/or concentration inequalities ranging from those of Chebyshev, Cramer–Chernoff, Bahadur–Rao, to Hoeffding have been added,with illustrative comparisons of their use in practice. This also includes a treatment of the Berry–Esseen error estimate in the central limit theorem. The authors assume mathematical maturity at a graduate level; otherwise the book is suitable for students with varying levels of background in analysis and measure theory. For the reader who needs refreshers, theorems from analysis and measure theory used in the main text are provided in comprehensive appendices, along with their proofs, for ease of reference. Rabi Bhattacharya is Professor of Mathematics at the University of Arizona. Edward Waymire is Professor of Mathematics at Oregon State University. Both authors have co-authored numerous books, including a series of four upcoming graduate textbooks in stochastic processes with applications.

This graduate-level textbook is primarily aimed at graduate students of statistics, mathematics, science, and engineering who have had an undergraduate course in statistics, an upper division course in analysis, and some acquaintance with measure theoretic probability. It provides a rigorous presentation of the core of mathematical statistics. Part I of this book constitutes a one-semester course on basic parametric mathematical statistics. Part II deals with the large sample theory of statistics - parametric and nonparametric, and its contents may be covered in one semester as well. Part III provides brief accounts of a number of topics of current interest for practitioners and other disciplines whose work involves statistical methods.

This book introduces in a systematic manner a general nonparametric theory of statistics on manifolds, with emphasis on manifolds of shapes. The theory has important and varied applications in medical diagnostics, image analysis, and machine vision. An early chapter of examples establishes the effectiveness of the new methods and demonstrates how they outperform their parametric counterparts. Inference is developed for both intrinsic and extrinsic Fréchet means of probability distributions on manifolds, then applied to shape spaces defined as orbits of landmarks under a Lie group of transformations - in particular, similarity, reflection similarity, affine and projective transformations. In addition, nonparametric Bayesian theory is adapted and extended to manifolds for the purposes of density estimation, regression and classification. Ideal for statisticians who analyze manifold data and wish to develop their own methodology, this book is also of interest to probabilists, mathematicians, computer scientists, and morphometricians with mathematical training.

This book introduces in a systematic manner a general nonparametric theory of statistics on manifolds, with emphasis on manifolds of shapes. The theory has important and varied applications in medical diagnostics, image analysis, and machine vision. An early chapter of examples establishes the effectiveness of the new methods and demonstrates how they outperform their parametric counterparts. Inference is developed for both intrinsic and extrinsic Fréchet means of probability distributions on manifolds, then applied to shape spaces defined as orbits of landmarks under a Lie group of transformations - in particular, similarity, reflection similarity, affine and projective transformations. In addition, nonparametric Bayesian theory is adapted and extended to manifolds for the purposes of density estimation, regression and classification. Ideal for statisticians who analyze manifold data and wish to develop their own methodology, this book is also of interest to probabilists, mathematicians, computer scientists, and morphometricians with mathematical training.

These notes are based on lectures presented during the seminar on " Asymptotic Statistics" held at SchloB Reisensburg, Gunzburg, May 29-June 5, 1988. They consist of two parts, the theory of asymptotic expansions in statistics and probabilistic aspects of the asymptotic distribution theory in nonparametric statistics. Our intention is to provide a comprehensive presentation of these two subjects, leading from elementary facts to the advanced theory and recent results. Prospects for further research are also included. We would like to thank all participants for their stimulating discussions and their interest in the subjects, which made lecturing very pleasant. Special thanks are due H. Zimmer for her excellent typing. We would also like to take this opportunity to to express our thanks to the Gesellschaft fur mathematische Forschung and to the Deutsche Mathematiker Vereinigung, especially to Professor G. Fischer, for the opportunity to present these lectures and to the Birkhauser Verlag for the publication of these lecture notes. R. Bhattacharya, M. Denker Part I: Asymptotic Expansions in Statistics Rabi Bhattacharya 11 1. CRAMER-EDGEWORTH EXPANSIONS Let Q be a probability measure on (IRk, B"), B" denoting the Borel sigmafield on IR". Assume that the s - th absolute moment of Q is finite, (1.1) P. := J II x lis Q(dx)

This treatment provides an exposition of discrete time dynamic processes evolving over an infinite horizon. Chapter 1 reviews some mathematical results from the theory of deterministic dynamical systems, with particular emphasis on applications to economics. The theory of irreducible Markov processes, especially Markov chains, is surveyed in Chapter 2. Equilibrium and long run stability of a dynamical system in which the law of motion is subject to random perturbations is the central theme of Chapters 3-5. A unified account of relatively recent results, exploiting splitting and contractions, that have found applications in many contexts is presented in detail. Chapter 6 explains how a random dynamical system may emerge from a class of dynamic programming problems. With examples and exercises, readers are guided from basic theory to the frontier of applied mathematical research.

This treatment provides an exposition of discrete time dynamic processes evolving over an infinite horizon. Chapter 1 reviews some mathematical results from the theory of deterministic dynamical systems, with particular emphasis on applications to economics. The theory of irreducible Markov processes, especially Markov chains, is surveyed in Chapter 2. Equilibrium and long run stability of a dynamical system in which the law of motion is subject to random perturbations is the central theme of Chapters 3-5. A unified account of relatively recent results, exploiting splitting and contractions, that have found applications in many contexts is presented in detail. Chapter 6 explains how a random dynamical system may emerge from a class of dynamic programming problems. With examples and exercises, readers are guided from basic theory to the frontier of applied mathematical research.

These notes are based on lectures presented during the seminar on " Asymptotic Statistics" held at SchloB Reisensburg, Gunzburg, May 29-June 5, 1988. They consist of two parts, the theory of asymptotic expansions in statistics and probabilistic aspects of the asymptotic distribution theory in nonparametric statistics. Our intention is to provide a comprehensive presentation of these two subjects, leading from elementary facts to the advanced theory and recent results. Prospects for further research are also included. We would like to thank all participants for their stimulating discussions and their interest in the subjects, which made lecturing very pleasant. Special thanks are due H. Zimmer for her excellent typing. We would also like to take this opportunity to to express our thanks to the Gesellschaft fur mathematische Forschung and to the Deutsche Mathematiker Vereinigung, especially to Professor G. Fischer, for the opportunity to present these lectures and to the Birkhauser Verlag for the publication of these lecture notes. R. Bhattacharya, M. Denker Part I: Asymptotic Expansions in Statistics Rabi Bhattacharya 11 1. CRAMER-EDGEWORTH EXPANSIONS Let Q be a probability measure on (IRk, B"), B" denoting the Borel sigmafield on IR". Assume that the s - th absolute moment of Q is finite, (1.1) P. := J II x lis Q(dx)