Definition of stochastic process. Cylinder σ-algebra, finite-dimensional distributions, the Kolmogorov theorem -- Characteristics of a stochastic process. Mean and covariance functions. Characteristic functions -- Trajectories. Modifications. Filtrations -- Continuity. Differentiability. Integrability -- Stochastic processes with independent increments. Wiener and Poisson processes. Poisson point measures -- Gaussian processes -- Martingales and related processes in discrete and continuous time. Stopping times -- Stationary discrete- and continuous-time processes. Stochastic integral over measure with orthogonal values -- Prediction and interpolation -- Markov chains: Discrete and continuous time -- Renewal theory. Queueing theory -- Markov and diffusion processes -- Itô stochastic integral. Itô formula. Tanaka formula -- Stochastic differential equations -- Optimal stopping of random sequences and processes -- Measures in a functional spaces. Weak convergence, probability metrics. Functional limit theorems -- Statistics of stochastic processes -- Stochastic processes in financial mathematics (discrete time) -- Stochastic processes in financial mathematics (continuous time) -- Basic functionals of the risk theory.

This book is a collection of exercises covering all the main topics in the modern theory of stochastic processes and its applications, including finance, actuarial mathematics, queuing theory, and risk theory. The aim of this book is to provide the reader with the theoretical and practical material necessary for deeper understanding of the main topics in the theory of stochastic processes and its related fields. The book is divided into chapters according to the various topics. Each chapter contains problems, hints, solutions, as well as a self-contained theoretical part which gives all the necessary material for solving the problems. References to the literature are also given. The exercises have various levels of complexity and vary from simple ones, useful for students studying basic notions and technique, to very advanced ones that reveal some important theoretical facts and constructions. This book is one of the largest collections of problems in the theory of stochastic processes and its applications. The problems in this book can be useful for undergraduate and graduate students, as well as for specialists in the theory of stochastic processes.