Multiprocessing

A computer can have more than one brain. These brains are called processors. They work together to do many jobs at once. This is called multiprocessing.

Some computers have brains that are all equal. They share the same memory. This helps them work well together.

Other computers have a leader brain. This leader brain tells the other brains what to do. The other brains then do the tasks.

Some brains can even live on one small chip. This is a very fast way to work. It helps the computer stay small.

Using more brains helps a computer do more. It is like having many friends help you work!

A computer can have more than one brain. These brains are called CPUs. This way of working is called multiprocessing. It uses two or more CPUs in one system. This lets the computer do many jobs at once.

Some systems treat all CPUs the same. This is called symmetric multiprocessing, or SMP. In SMP, every CPU is equal. They all share the same main memory. This helps the computer work well.

Other systems have a leader and a follower. This is a master/slave system. The master CPU is in control. It tells the slave CPUs what to do. The CPUs can be different speeds. They can even have different parts. One early example was the TRS-80 Model 16. It had two different CPUs. They could even switch roles!

Some CPUs are very close together. They might live on one single chip. We call this multi-core computing. These are tightly coupled systems. They are small and use less power. Other systems use many separate computers. These are called clusters. They are loosely coupled. They can run different software on each part.

A computer can do many things at once using multiprocessing. This means the system uses two or more central processing units, or CPUs. You can think of a CPU as the brain of the computer. In a multiprocessing system, these brains work together to handle many tasks. This is different from multitasking. Multitasking uses only one processor that switches very quickly between jobs. Multiprocessing allows for true parallel execution. This means several jobs actually happen at the same time.

There are different ways these computer brains work together. In symmetric multiprocessing, or SMP, all the CPUs are equal. They all share the same main memory and parts. Some systems are not equal, which is called asymmetric multiprocessing. In a master/slave system, one CPU is the leader. The master CPU stays in control of the whole computer. It assigns tasks to the slave CPUs. These slave CPUs can be different speeds or have different designs.

We can look back at how these systems started. Two early examples of master/slave systems were the Bull Gamma 60 and the Burroughs B5000. In February 1982, a desktop called the Tandy/Radio Shack TRS-80 Model 16 was released. It used the Xenix operating system. This computer had two different microprocessors. One was an 8-bit Zilog Z80 running at 4 MHz. The other was a 16-bit Motorola 68000 running at 6 MHz. These two CPUs could even switch their roles!

Computers also group their processors in different ways. Tightly coupled systems have CPUs that are very close together. They often share a central memory. Chip multiprocessors, or multi-core computing, put more than one processor on a single chip. This is a very extreme form of being tightly coupled. On the other hand, loosely coupled systems are called clusters. These are groups of separate computers connected by high-speed paths. A Linux Beowulf cluster is one example of this.

Each way of working has its own benefits. Tightly coupled systems are usually smaller and use less power. They are also very efficient because they are built to work together. Loosely coupled clusters can run different types of software on each computer. However, merging data from many tasks can sometimes be a hard job. This is because the system must resolve conflicts to keep data consistent. Understanding these systems helps us see how modern technology stays so fast.

Multiprocessing is the use of two or more central processing units (CPUs) within a single computer system. A CPU is the primary component that executes instructions in a computer. Multiprocessing allows a system to support multiple processors or to distribute tasks between them. This capability enables true parallel execution. This means several processes actually run at the same time. This is different from multitasking. Multitasking uses a single processor that switches between tasks in time slices. In multiprocessing, the hardware itself allows for simultaneous work.

There are different ways to organize how these processors interact. In symmetric multiprocessing (SMP) systems, all CPUs are treated as equals. They share the same main memory and peripheral devices. Some systems are not equal, which is called asymmetric multiprocessing (ASMP). In these systems, certain CPUs might be reserved for special tasks. For example, one CPU might handle all hardware interrupts. Other CPUs might handle user-mode code. This can make a system easier to design, but it is often less efficient than SMP. Other types include non-uniform memory access (NUMA) and clustered multiprocessing.

One specific method is the master/slave multiprocessor system. In this setup, one CPU acts as the master to control the computer. The other CPU, or CPUs, act as slaves to perform assigned tasks. The master and slave can have different speeds or architectures. They might share a common bus or have private buses for specific resources. They can also share common RAM or use private RAM that others cannot access. Interestingly, the roles of master and slave can change between CPUs during operation.

History shows us how these systems evolved. Two early examples of master/slave mainframes were the Bull Gamma 60 and the Burroughs B5000. In February 1982, the Tandy/Radio Shack TRS-80 Model 16 desktop was released. It ran the Xenix operating system, which was Microsoft's version of UNIX. This machine used two different microprocessors. It had an 8-bit Zilog Z80 running at 4 MHz. It also had a 16-bit Motorola 68000 running at 6 MHz. During boot, the Z80 was the master. Once the 68000 was initialized, the roles switched. The Z80 became a slave responsible for I/O operations like the disk and keyboard. Meanwhile, the 68000 ran the operating system and applications.

We can also classify these systems by how the processors are connected. Tightly coupled systems contain multiple CPUs connected at the bus level. These CPUs often share a central memory. An example of a high-end SMP system is the IBM p690 Regatta. Chip multiprocessors, also called multi-core computing, are an extreme form of tight coupling. They place more than one processor on a single chip. Intel Xeon processors dominated the business PC market for a long time. In 2004, AMD released the Opteron range, which became a major competitor. Both used onboard cache but provided access to shared memory.

Loosely coupled multiprocessor systems are often called clusters. These are groups of standalone computers connected by a high-speed communication system. Gigabit Ethernet is a common connection method. A Linux Beowulf cluster is a well-known example. Tightly coupled systems are generally smaller and more energy-efficient. They are designed from the start to work together. Loosely coupled clusters use inexpensive commodity computers. These nodes can be recycled as independent machines when they are no longer part of the cluster. Clusters also allow different computers to run different operating systems.

Despite the power of multiprocessing, there are technical challenges. Merging data from multiple threads or processes can cause significant overhead. This happens because the system must manage conflict resolution. It must also handle data consistency and synchronization. These tasks ensure that all processors see the correct information at the right time. Understanding these different architectures helps us see how computers manage complex workloads efficiently.