Stochastic process

Some things change in a random way.

They do not follow a set plan.

Math helps us study these changes. We call them random processes.

Tiny bugs move in water this way. A phone might get many calls. Even money in a market changes like this.

One way to see this is a coin flip. You can guess if it is heads.

Math lets us learn about these patterns. It helps us understand our world.

Imagine a tiny bug swimming in water. It moves in a way that looks messy. It does not follow a straight path. This kind of movement is a random process.

In math, we call this a stochastic process.

It is a way to study things that change by chance. These changes can happen over time. We can use math to model many things. For example, we can track how many bacteria grow. We can also study how phone calls arrive.

One famous example is the Wiener process. It is also called Brownian motion. It helps us understand how things move in liquids. Mathematician Norbert Wiener helped prove how it works.

Another example is a random walk. Imagine a person taking steps. Each step could be left or right by chance. This is like a series of coin flips. If the coin is fair, the steps are even. These ideas help us understand the world. They even help people study money in markets.

Imagine watching a tiny bug swim through water. Its path looks messy and unpredictable. It does not move in a straight line. This kind of movement is a random process. In math, we call this a stochastic process.

These processes help us model things that change by chance. They can describe many different things in our world. They can track how a group of bacteria grows. They can also show how electrical currents flicker.

A stochastic process is a collection of random variables. These variables are linked to a special set called an index set. Often, this set represents time. The values these variables take belong to a state space. This space can be simple numbers or complex shapes. The amount a process changes is called an increment. One single outcome of a process is called a realization.

History shows us many people worked on these ideas. The word stochastic comes from a Greek word. It means to guess or aim at a mark. Jakob Bernoulli used the term in his 1713 book. Later, Joseph Doob used the term in a 1934 paper.

Other mathematicians like Aleksandr Khinchin also used it. These thinkers helped turn guessing into a formal math study. They wanted to understand the rules of chance.

There are many important types of these processes. The Wiener process is very famous. It is also called Brownian motion. Norbert Wiener proved it exists mathematically.

Louis Bachelier used it to study price changes in Paris. Another type is the Poisson process. A. K. Erlang used it to model phone calls. You might also hear about a random walk. This is like a person taking steps by chance.

You can see these ideas in your daily life. A simple coin flip is a Bernoulli process. If you flip a coin, it is either heads or tails. This is a very basic way to show randomness. Financial markets also use these models to study money. Scientists use them to study how gas molecules move. Even computer science uses these tools to process signals. Math helps us find patterns in the chaos.

A stochastic process, often called a random process, is a mathematical object used to model systems that change in unpredictable ways. Instead of following a single, fixed path, these processes represent phenomena that vary due to chance. In probability theory, a stochastic process is defined as a family of random variables. These variables are organized within a probability space. The index of this family is known as the index set, and it often represents the passage of time. By using these models, scientists can study complex movements like the growth of bacterial populations or the flickering of electrical currents caused by thermal noise.

To understand how these processes function, we must look at their internal structure. Each random variable in the collection is uniquely linked to an element in the index set. The values that these variables take belong to a mathematical area called the state space. This space can be simple, such as the set of integers, or more complex, like $n$-dimensional Euclidean space. When we measure the change in a process between two specific points in the index set, we call that change an increment. Because the process is driven by randomness, it can produce many different possible outcomes. A single, specific outcome from the process is called a realization or a sample function.

Mathematicians classify stochastic processes using several different criteria. One common method is to look at the cardinality, or size, of the index set and the state space. If the index set consists of a finite or countable number of elements, such as the natural numbers, the process is in discrete time. These are often called random sequences. If the index set is an interval of the real line, the process is in continuous time. Discrete-time processes are generally easier to study than continuous-time processes. This is because continuous-time processes require advanced mathematical tools to handle an uncountable index set.

The state space also determines the name of the process. If the state space is made of integers, it is a discrete or integer-valued process. If the state space is the real line, it is a real-valued process with a continuous state space. When the state space involves higher dimensions, it is called a vector process. If the index set is a higher-dimensional Euclidean space rather than a line, the collection of variables is called a random field. These classifications allow researchers to apply the correct mathematical frameworks to specific real-world problems.

The history of these ideas involves centuries of linguistic and mathematical evolution. The word "stochastic" comes from a Greek word meaning "to aim at a mark" or "to guess." In 1713, Jakob Bernoulli used the phrase "Ars Conjectandi sive Stochastice" in his work on probability. The specific English term "stochastic process" appeared in a 1934 paper by Joseph Doob.

Doob cited a German paper by Aleksandr Khinchin, who had used the term "stochastischer Prozeß." Other mathematicians, such as Andrei Kolmogorov, had used similar terms as early as 1931. These developments helped formalize the study of randomness.

Several classic processes serve as pillars for the field. The Wiener process, also known as Brownian motion, is one of the most central models. It is a continuous-time process where the increments are normally distributed. Norbert Wiener proved its mathematical existence.

Historically, Louis Bachelier used the Wiener process to model price changes on the Paris Bourse. Another essential model is the Poisson process, which A. K. Erlang used to model the number of phone calls occurring in a specific period. There are also random walks, which can be discrete or continuous, representing movements that change based on random steps.

Stochastic processes are vital across many scientific disciplines. In biology, they model population changes, while in physics, they describe the movement of gas molecules. Finance relies heavily on these models to understand the seemingly random fluctuations of markets. They are also used in neuroscience, ecology, and chemistry. Even modern technology uses them in image processing, signal processing, and telecommunications. By using tools from calculus, linear algebra, and measure theory, mathematicians continue to expand our understanding of the random world.