Parallel computing and distributed computing are ways of exploiting parallelism in computing to achieve higher performance. Multiple processing elements are used to solve a problem, either to have it done faster or to have a larger size problem been solved. To state simply, if the processing elements share the memory, it is called parallel computing, other wise it is called distributed computing. Some have opinion that distributed computing is a special form of parallel computing.

The definition of parallel computing is the processing of data many bits at a time as opposed to serial computing which is the processing of data one bit at a time.

"Distributed" or "grid" computing in general is a special type of parallel computing, it is advanced in the means of using distributed computing.

EPIC, which stands for Explicitly Parallel Instruction Computing.

One advantage to parallel computing is the ability to process information quicker. A disadvantage is maintaining the system because it is complex.