Nepedia
Back to Discover
Advanced Reader
⚛️

Introduction to entropy

physical science Maturity 11-13 Next article →

Entropy is a numerical quantity used in thermodynamics to describe the direction of physical processes. It explains why many events in our universe can only happen in one direction. For example, you can mix cream into coffee, but you cannot easily unmix them. You can burn a piece of wood, but you cannot unburn it. These are called irreversible processes. In popular use, people often use entropy to describe a lack of order or a decline into disorder. In physics, it refers to how energy or matter spreads out. It also describes the diversity of microscopic motion within a system.

The behavior of entropy is governed by the second law of thermodynamics. This law states that in an isolated system, entropy will increase over time. An isolated system is one that is not connected to any other system. This law helps scientists predict if a process can occur. For instance, heat spontaneously flows from a hotter body to a colder one. Entropy can be seen as a measure of how much energy becomes unavailable for doing work. As energy disperses or spreads out, the capacity of the system to perform thermodynamic work decreases.

Ice water
Ice water

Thermodynamic entropy can be calculated by looking at heat transfer and temperature. Using the formalism of Clausius, the change in entropy is the heat added or subtracted, divided by the temperature. This calculation allows scientists to find the difference in entropy between two states. While it does not give an absolute value, it shows how entropy changes. The third law of thermodynamics can be used to find absolute entropy. It states that the entropy of perfectly crystalline substances is zero at absolute zero temperature. This provides a starting point for measuring entropy at other temperatures.

Systems move toward a state called thermodynamic equilibrium. This occurs when a body of matter or radiation reaches an unchanging state. In this state, there are no detectable flows of energy. At equilibrium, the entropy of the system reaches its maximum value. When two systems in equilibrium are brought together, their total entropy increases as they reach a new, joint equilibrium. A common example is a glass of warm water containing an ice cube. Initially, the system has lower entropy. Eventually, the ice melts, and the system reaches a steady, cool temperature. This process is irreversible; a glass of cool water will not spontaneously grow an ice cube again.

In 1877, the physicist Ludwig Boltzmann provided a deeper explanation for these observations. He developed a theory known as statistical mechanics. This field explains thermodynamics by looking at the statistical behavior of atoms and molecules. Boltzmann realized there is a difference between a microstate and a macrostate. A microstate is the specific arrangement of every particle's position and velocity. A macrostate is the overall description of the system, such as its pressure, volume, or temperature. Many different microstates can result in the same macrostate.

Ice water
Ice water

Boltzmann's equation relates entropy to the number of possible microstates. The formula is S = k ln W, where S is entropy and W is the number of microstates. The natural logarithm of these microstates is also called information entropy. You can visualize this with a simple coin flip. If you flip two coins, the macrostate of "one head and one tail" has more microstates than "two heads." There are two ways to get one of each (HT and TH), but only one way to get two heads (HH). Because there are more ways to be disordered, systems naturally move toward macrostates with more microstates.

This concept connects thermodynamics to the study of probability and information theory. In a large system, like a gas in a container, there are a massive number of microstates. Most of these microstates result in a state of equilibrium. This is why we can predict the behavior of complex systems even if we cannot track every single molecule. While some processes, like planets orbiting the sun, appear almost reversible, most natural processes follow the path of increasing entropy. This fundamental principle helps us understand the very nature of time and energy in the universe.

681 words

Where will your curiosity go next?

Keep exploring at your chosen reading level.

🖼️ Images & Media (1)
File:Ice water.jpg
Ice water.jpg
More to explore

What is Nepedia?

A free, ad-free encyclopedia for children. Every article is written at five reading levels, so the same page works for a five-year-old and a fifteen-year-old — use the level switcher above to see this one change. No account needed to read.