speedup: Definition from Answers.com

"Speed Up" redirects here. For the song by Krokus, see Heart Attack (album).

In parallel computing, speedup refers to how much a parallel algorithm is faster than a corresponding sequential algorithm.

Definition

Speedup is defined by the following formula:

$S_p = \frac{T_1}{T_p}$

where:

p is the number of processors
$T 1$ is the execution time of the sequential algorithm
$T p$ is the execution time of the parallel algorithm with p processors

Linear speedup or ideal speedup is obtained when $\,S_p = p$ . When running an algorithm with linear speedup, doubling the number of processors doubles the speed. As this is ideal, it is considered very good scalability.

The speedup is called absolute speedup when $T 1$ is the execution time of the best sequential algorithm, and relative speedup when $T 1$ is the execution time of the same parallel algorithm on one processor. Relative speedup is usually implied if the type of speedup is not specified, because it doesn't require implementation of the sequential algorithm.

Efficiency is a performance metric defined as

$E_p = \frac{S_p}{p} = \frac{T_1}{pT_p}$ .

It is a value, typically between zero and one, estimating how well-utilized the processors are in solving the problem, compared to how much effort is wasted in communication and synchronization. Algorithms with linear speedup and algorithms running on a single processor have an efficiency of 1, while many difficult-to-parallelize algorithms have efficiency such as $\frac{1}{\log p}$ that approaches zero as the number of processors increases.

Super linear speedup

Sometimes a speedup of more than N when using N processors is observed in parallel computing, which is called super linear speedup. Super linear speedup rarely happens and often confuses beginners, who believe the theoretical maximum speedup should be N when N processors are used.

One possible reason for a super linear speedup is the cache effect resulting from the different memory hierarchies of a modern computer: In parallel computing, not only do the numbers of processors change, but so does the size of accumulated caches from different processors. With the larger accumulated cache size, more or even all core data set can fit into caches and the memory access time reduces dramatically, which causes the extra speedup in addition to that from the actual computation.

Super linear speedups can also occur when performing backtracking in parallel: One thread can prune a branch of the exhaustive search that another thread would have taken otherwise.

v • d • e Parallel computing topics

General	Cloud computing · High-performance computing · Cluster computing · Distributed computing · Grid computing

Parallelism (levels)	Bit · Instruction · Data · Task

Threads	Superthreading · Hyperthreading

Theory	Amdahl's law · Gustafson's law · Cost efficiency · Karp-Flatt metric · slowdown · speedup

Elements	Process · Thread · Fiber · PRAM

Coordination	Multiprocessing · Multithreading · Memory coherency · Cache coherency · Barrier · Synchronization · Application checkpointing

Programming	Models (Implicit parallelism · Explicit parallelism · Concurrency) · Flynn's taxonomy (SISD • SIMD • MISD • MIMD (SPMD))

Hardware	Multiprocessing (Symmetric · Asymmetric) · Memory (NUMA · COMA · distributed · shared · distributed shared) · SMT MPP · Superscalar · Vector processor · Supercomputer · Beowulf

APIs	POSIX Threads · OpenMP · PVM · MPI · UPC · Intel Threading Building Blocks · Boost.Thread · Global Arrays · Charm++ · Cilk

Problems	Embarrassingly parallel · Grand Challenge · Software lockout · Scalability · Race conditions · Deadlock · Deterministic algorithm

This entry is from Wikipedia, the leading user-contributed encyclopedia. It may not have been reviewed by professional editors (see full disclaimer)

Donate to Wikimedia

		Dictionary. The American Heritage® Dictionary of the English Language, Fourth Edition Copyright © 2007, 2000 by Houghton Mifflin Company. Updated in 2009. Published by Houghton Mifflin Company. All rights reserved. Read more
		Business Dictionary. Dictionary of Business Terms. Copyright © 2000 by Barron's Educational Series, Inc. All rights reserved. Read more
		WordNet. WordNet 1.7.1 Copyright © 2001 by Princeton University. All rights reserved. Read more
		Wikipedia. This article is licensed under the Creative Commons Attribution/Share-Alike License. It uses material from the Wikipedia article "Speedup". Read more

	Stretchout (business term)
	Cybill Shepherd (Actor, Drama/Mystery)
	Concert, for violin, piano & string quartet in D major, Op. 21 (Classical Work)

	What is the difference between speedup and cost?
	How can i speedup my dial up connection?
	How do you speedup the process of periods?

speedup

Definition

Super linear speedup

See also