CSC/ECE 506 Spring 2012/1b ps: Difference between revisions

From Expertiza_Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(26 intermediate revisions by one other user not shown)
Line 1: Line 1:
In 1965, Intel co-founder predicted that the number of transistors on a chip would double every 24 months. This was a rough predictive statement (not a true law of course) that has been claimed to be quite accurate in the decades since. This article explores different interpretations of Moore's law, whether it has failed to hold true during certain intervals of time, and, finally, whether it will continue to hold and, if so, for how long?
== Moore's Law ==


The rate of growth Moore predicted is truly staggering. The equation form of the law is: T(t)=T0 * 2^(t/2) where T0 represents the initial transistor count in the start year and Tn the transistor count in t years. This is somewhat lost on transistors so we'll switch to something everyone understands, money. If one could double his wealth every 24 months and started with $1, he would have $5,931,641 in 45 years!
In 1965, Intel co-founder Gordon Moore predicted that the number of [http://en.wikipedia.org/wiki/Transistor transistors] on a die would double every 24 months. This was a rough predictive statement that has brought Moore acclaim for its reputed accuracy and foresight. This article explores different interpretations of Moore's law, whether it has indeed held true across the years in all significant intervals of time, and whether it will hold true in the future.


But this is exactly what Intel claims it has done with their chips (and certainly their bottom line). To a large extent, the company has symbiotically harnessed and fueled the public awareness of Moore's law to their advantage as a marketing device, but it's still valuable to study the context of the prediction (the 60s and the advent of transistors) and the reasons Moore believed the prediction would hold and whether he was right.
The rate of growth Moore predicted is truly staggering. The equation form of the law is: T(t)=T0 * 2^(t/2) where T0 represents the initial transistor count in the start year and T(t) the transistor count in t years. Exponential growth is somewhat lost on transistors so we'll switch to counting something more tangible: money. If one could double his wealth every 24 months and started with $1, he would have $5,931,641 in 45 years!


If Moore was right, he wasn't right on the first try. His initial prediction was that transistor counts would double every year. In 1975 he revised this prediction to every two years (credit: http://news.cnet.com/Myths-of-Moores-Law/2010-1071_3-1014887.html). If we take 1971 and the Intel 4004 processor as our starting point, we see the following growth alongside the predicted growth and the variance and variance percentage next to each (credit for raw data: http://en.wikipedia.org/wiki/Transistor_count)
But this is exactly what Intel claims it has done with the transistor density of their processors (and certainly their bottom line). To a large extent, the company has symbiotically harnessed and fueled the public awareness of Moore's law to its advantage as a marketing device, but it is still valuable to study the context of the prediction (the 60s, the advent of semi-conductor technology and miniaturization) and the reasons Moore believed the prediction would hold and whether he was right.
 
== Historic Context ==
 
According to David C. Brock in Understanding Moore's Law: Four Decades of Innovation: "By 1960 miniaturization was a fundamental issue for semiconductor technology and its industry. It had become, moreover, a central factor in the semiconductor community's discussions surrounding the new integrated circuits that had been touted in 1959 by Texas Instrucments as the first realization of the "monolothic" circuit ideal." .<ref>Brock, David C. ''Understanding Moore's Law: Four Decades of Innovation. Chemical Heritage Foundation, 2006, p. 26.</ref> Two ideas are most striking about this statement: The focus on miniaturization and the concept of the "monolothic" circuit ideal. In the early 1960s, the semi-conductor industry was gravitating towards building [http://en.wikipedia.org/wiki/Integrated_circuit integrated circuits] on wafers of silicon versus discrete transistors for use as components in electronic devices. The arguments presented were largely those based on cost reduction. Integrated or monolothic circuits were cheaper to produce than devices based on connected discrete transistors.
 
Among the seminal presentations of the time predating Moore's publication of Moore's Law is C. Harry Knowles (manager for Westinghouse's molecular electronics division). Knowles addressed two critical ideas that helps put Moore's Law into proper context:
Knowles argued that with technological progress, devices could produce integrated circuits with greater functionality and complexity at higher [http://en.wikipedia.org/wiki/Yield yields] (measure of output). (Brock). Secondly, Knowles brought attention to the issue of performance as a function of size.
 
== Transistor Counts Over The Years ==
 
The stage was set: smaller was faster and miniaturized, integrated circuits were cheaper. Moore made several contributions to Knowles in his presentation of Moore's Law, including a significant simplification of ideas to transistor counts over time.
 
If Moore was right, he wasn't right on the first try. His initial prediction was that transistor counts would double every year. In 1975 he revised this prediction to every two years <ref>
[http://news.cnet.com/Myths-of-Moores-Law/2010-1071_3-1014887.html "Kanellos, Michael. Perspective: Myths of Moore's Law"]
</ref>
 
If we take 1971 and the Intel 4004 processor as our starting point <ref>
[http://en.wikipedia.org/wiki/Transistor_count "Microprocessors"]
</ref>, we see the following growth alongside the predicted growth and the variance and variance percentage next to each processor.




Line 111: Line 130:
|}
|}


== Data Review ==


So it's quite clear that the "law" is not to be taken too literally. It's a general marker for what to expect in upcoming years. One sees actually that the number jump to catch up (by 2011, the variance is only %8 with the 10-Core Xeon chip). The Dual Core Itanium also lurches forward nearly %300.
So it's quite clear that the "law" is not to be taken too literally. It's a general marker for what to expect in upcoming years. One sees actually that the number jumps in several years to catch up (by 2011, the variance is only %8 with the 10-Core Xeon chip). The Dual Core Itanium also lurches forward nearly %300.


The following chart shows the actual and predicted transistor counts:
The following chart shows the actual and predicted transistor counts:
Line 118: Line 138:


[[File:TransistorCountVariance.JPG]]
[[File:TransistorCountVariance.JPG]]
== Variance Years ==




Line 124: Line 147:
So it is important when evaluating whether Moore's law has failed to hold to compare chips of the same family, or perhaps take the best technology for a given year. For example, in years 1979, 1982, 1985, 1989 with the Motorola 68000, Intel 80286, Intel 80386 and Intel 80486, the best chips available in the data above, either exceed Moore's predictions or come very close.
So it is important when evaluating whether Moore's law has failed to hold to compare chips of the same family, or perhaps take the best technology for a given year. For example, in years 1979, 1982, 1985, 1989 with the Motorola 68000, Intel 80286, Intel 80386 and Intel 80486, the best chips available in the data above, either exceed Moore's predictions or come very close.


But there are many intervals where this is not true, including 1971-1978, 1993-2000, which show poor performance. One also sees certain chips and chip families which cause transistor counts to lurch forward (for example, the first Itanium 2 which included 221 million transistors, 4 times Moore's prediction for 2006).
But there are many intervals where this is not true, including 1971-1978, 1993-2000, which show poor performance. One explanation is that other chip factors started to become more important during this time (power consumption, for example). One also sees certain chips and chip families which cause transistor counts to lurch forward (for example, the first Itanium 2 which included 221 million transistors, 4 times Moore's prediction for 2006). This lurching forward may have an effect that for subsequent years, the hardware outstrips market needs and it takes some time for operating systems and software to catch up. During this period, there is less demand for more powerful chips so market forces require the production of less expensive chips with lower transistor counts.
 
 
== Moore's Law - The Future ==
 
With a good survey of data and historic context firmly in view, we can now consider whether Moore's Law will hold in future years. Clearly, Moore's predictions concerned transistor counts, not processor speed. But like Knowles, Moore was searching for a simple metric of complexity and performance with respect to cost. His ultimate aim was to predict future performance at costs that were feasible in the marketplace. Hence, on the one hand, one can take Moore's Law to apply to performance versus the specific metric of transistor counts.
 
Performance is a function of many factor besides transistor counts, including memory management and overall processor architecture (pipelining, cache levels, etc.). Still, in the context of miniaturization and monlithic architectures, it is possible that Moore underestimated the importance of these factors despite his ultimate interest in the sustained future improvement in performance with respect to cost. We must also consider that, as with any new technology, the semi-conductor industry was struggling to convince the engineering community and public of the importance of integrated circuits. The focus was deliberate and simple: adopt integrated circuits as the future.
 
Those who argue that transistor counts will eventually hit a wall typically do so on the basis of physical limitations. The arguments seem reasonable given that Moore's prediction concerned the number of transistors on a single die and the general unsustainability of exponential growth. Even if the physical limitations were surmounted by better materials and semi-conductor manufacturing processes, it is likely their benefits will be outweighed by alternative innovations at other levels.
 
The exponential growth predicted by Moore's law is ultimately not sustainable, even as a rough guideline. Even if it were and the above physical limitations are overcome, the resulting transistor count or performance improvement will likely also significantly outrun Moore's predictions since the technology to work with materials at an atomic level will likely lead to completely different architectures Moore could never have predicted.
 
== References ==
*Brock, David C. (2006). Understanding Moore's Law: Four Decades of Innovation ''Chemical Heritage Foundation''.
 
==Notes==
<references>
{{reflist}}
</references>

Latest revision as of 07:07, 4 February 2013

Moore's Law

In 1965, Intel co-founder Gordon Moore predicted that the number of transistors on a die would double every 24 months. This was a rough predictive statement that has brought Moore acclaim for its reputed accuracy and foresight. This article explores different interpretations of Moore's law, whether it has indeed held true across the years in all significant intervals of time, and whether it will hold true in the future.

The rate of growth Moore predicted is truly staggering. The equation form of the law is: T(t)=T0 * 2^(t/2) where T0 represents the initial transistor count in the start year and T(t) the transistor count in t years. Exponential growth is somewhat lost on transistors so we'll switch to counting something more tangible: money. If one could double his wealth every 24 months and started with $1, he would have $5,931,641 in 45 years!

But this is exactly what Intel claims it has done with the transistor density of their processors (and certainly their bottom line). To a large extent, the company has symbiotically harnessed and fueled the public awareness of Moore's law to its advantage as a marketing device, but it is still valuable to study the context of the prediction (the 60s, the advent of semi-conductor technology and miniaturization) and the reasons Moore believed the prediction would hold and whether he was right.

Historic Context

According to David C. Brock in Understanding Moore's Law: Four Decades of Innovation: "By 1960 miniaturization was a fundamental issue for semiconductor technology and its industry. It had become, moreover, a central factor in the semiconductor community's discussions surrounding the new integrated circuits that had been touted in 1959 by Texas Instrucments as the first realization of the "monolothic" circuit ideal." .<ref>Brock, David C. Understanding Moore's Law: Four Decades of Innovation. Chemical Heritage Foundation, 2006, p. 26.</ref> Two ideas are most striking about this statement: The focus on miniaturization and the concept of the "monolothic" circuit ideal. In the early 1960s, the semi-conductor industry was gravitating towards building integrated circuits on wafers of silicon versus discrete transistors for use as components in electronic devices. The arguments presented were largely those based on cost reduction. Integrated or monolothic circuits were cheaper to produce than devices based on connected discrete transistors.

Among the seminal presentations of the time predating Moore's publication of Moore's Law is C. Harry Knowles (manager for Westinghouse's molecular electronics division). Knowles addressed two critical ideas that helps put Moore's Law into proper context: Knowles argued that with technological progress, devices could produce integrated circuits with greater functionality and complexity at higher yields (measure of output). (Brock). Secondly, Knowles brought attention to the issue of performance as a function of size.

Transistor Counts Over The Years

The stage was set: smaller was faster and miniaturized, integrated circuits were cheaper. Moore made several contributions to Knowles in his presentation of Moore's Law, including a significant simplification of ideas to transistor counts over time.

If Moore was right, he wasn't right on the first try. His initial prediction was that transistor counts would double every year. In 1975 he revised this prediction to every two years <ref> "Kanellos, Michael. Perspective: Myths of Moore's Law" </ref>

If we take 1971 and the Intel 4004 processor as our starting point <ref> "Microprocessors" </ref>, we see the following growth alongside the predicted growth and the variance and variance percentage next to each processor.


Processor Transistor count Year Predicted Value Variance Percent Error (Variance/Predicted Transistor Count)
Intel 4004 2,300 1971 2,300 N/A
Intel 8008 3,500 1972 3,253 247 8%
Motorola 6800 4,100 1974 6,505 -2,405 -37%
Intel 8080 4,500 1974 6,505 -2,005 -31%
RCA 1802 5,000 1974 6,505 -1,505 -23%
MOS Technology 6502 3,510 1975 9,200 -5,690 -62%
Intel 8085 6,500 1976 13,011 -6,511 -50%
Zilog Z80 8,500 1976 13,011 -4,511 -35%
Motorola 6809 9,000 1978 26,022 -17,022 -65%
Intel 8086 29,000 1978 26,022 2,978 11%
Intel 8088 29,000 1979 36,800 -7,800 -21%
Motorola 68000 68,000 1979 36,800 31,200 85%
Intel 80186 55,000 1982 104,086 -49,086 -47%
Intel 80286 134,000 1982 104,086 29,914 29%
Intel 80386 275,000 1985 294,400 -19,400 -7%
Intel 80486 1,180,000 1989 1,177,600 2,400 0%
Pentium 3,100,000 1993 4,710,400 -1,610,400 -34%
AMD K5 4,300,000 1996 13,323,023 -9,023,023 -68%
Pentium II 7,500,000 1997 18,841,600 -11,341,600 -60%
AMD K6 8,800,000 1997 18,841,600 -10,041,600 -53%
Pentium III 9,500,000 1999 37,683,200 -28,183,200 -75%
AMD K6-III 21,300,000 1999 37,683,200 -16,383,200 -43%
AMD K7 22,000,000 1999 37,683,200 -15,683,200 -42%
Pentium 4 42,000,000 2000 53,292,093 -11,292,093 -21%
Barton 54,300,000 2003 150,732,800 -96,432,800 -64%
AMD K8 105,900,000 2003 150,732,800 -44,832,800 -30%
Itanium 2 220,000,000 2003 150,732,800 69,267,200 46%
Itanium 2 with 9MB cache 592,000,000 2004 213,168,370 378,831,630 178%
Cell 241,000,000 2006 426,336,740 -185,336,740 -43%
Core 2 Duo 291,000,000 2006 426,336,740 -135,336,740 -32%
Dual-Core Itanium 2 1,700,000,000 2006 426,336,740 1,273,663,260 299%
AMD K10 463,000,000 2007 602,931,200 -139,931,200 -23%
POWER6 789,000,000 2007 602,931,200 186,068,800 31%
Atom 47,000,000 2008 852,673,480 -805,673,480 -94%
AMD K10 758,000,000 2008 852,673,480 -94,673,480 -11%
Core i7 (Quad) 731,000,000 2008 852,673,480 -121,673,480 -14%
Six-Core Xeon 7400 1,900,000,000 2008 852,673,480 1,047,326,520 123%
Six-Core Opteron 2400 904,000,000 2009 1,205,862,400 -301,862,400 -25%
16-Core SPARC T3 1,000,000,000 2010 1,705,346,960 -705,346,960 -41%
Six-Core Core i7 (Gulftown) 1,170,000,000 2010 1,705,346,960 -535,346,960 -31%
8-core POWER7 1,200,000,000 2010 1,705,346,960 -505,346,960 -30%
Quad-core z196[3] 1,400,000,000 2010 1,705,346,960 -305,346,960 -18%
Quad-Core Itanium Tukwila 2,000,000,000 2010 1,705,346,960 294,653,040 17%
8-Core Xeon Nehalem-EX 2,300,000,000 2010 1,705,346,960 594,653,040 35%
Six-Core Core i7 (Sandy Bridge-E) 2,270,000,000 2011 2,411,724,800 -141,724,800 -6%
10-Core Xeon Westmere-EX 2,600,000,000 2011 2,411,724,800 188,275,200 8%

Data Review

So it's quite clear that the "law" is not to be taken too literally. It's a general marker for what to expect in upcoming years. One sees actually that the number jumps in several years to catch up (by 2011, the variance is only %8 with the 10-Core Xeon chip). The Dual Core Itanium also lurches forward nearly %300.

The following chart shows the actual and predicted transistor counts:



Variance Years

We see that there are probably exceptions which should be taken out of the data; for example, the Atom processor, which is an ultra-low voltage processor embedded in netbooks. These are special purpose processors that do not reflect the state of the technology at the time (for example, the Intel Core i7 chip in 2008, the same year as the Atom chip, is closer to the mark at a variance of only -14%, versus the Atom's -94%.

So it is important when evaluating whether Moore's law has failed to hold to compare chips of the same family, or perhaps take the best technology for a given year. For example, in years 1979, 1982, 1985, 1989 with the Motorola 68000, Intel 80286, Intel 80386 and Intel 80486, the best chips available in the data above, either exceed Moore's predictions or come very close.

But there are many intervals where this is not true, including 1971-1978, 1993-2000, which show poor performance. One explanation is that other chip factors started to become more important during this time (power consumption, for example). One also sees certain chips and chip families which cause transistor counts to lurch forward (for example, the first Itanium 2 which included 221 million transistors, 4 times Moore's prediction for 2006). This lurching forward may have an effect that for subsequent years, the hardware outstrips market needs and it takes some time for operating systems and software to catch up. During this period, there is less demand for more powerful chips so market forces require the production of less expensive chips with lower transistor counts.


Moore's Law - The Future

With a good survey of data and historic context firmly in view, we can now consider whether Moore's Law will hold in future years. Clearly, Moore's predictions concerned transistor counts, not processor speed. But like Knowles, Moore was searching for a simple metric of complexity and performance with respect to cost. His ultimate aim was to predict future performance at costs that were feasible in the marketplace. Hence, on the one hand, one can take Moore's Law to apply to performance versus the specific metric of transistor counts.

Performance is a function of many factor besides transistor counts, including memory management and overall processor architecture (pipelining, cache levels, etc.). Still, in the context of miniaturization and monlithic architectures, it is possible that Moore underestimated the importance of these factors despite his ultimate interest in the sustained future improvement in performance with respect to cost. We must also consider that, as with any new technology, the semi-conductor industry was struggling to convince the engineering community and public of the importance of integrated circuits. The focus was deliberate and simple: adopt integrated circuits as the future.

Those who argue that transistor counts will eventually hit a wall typically do so on the basis of physical limitations. The arguments seem reasonable given that Moore's prediction concerned the number of transistors on a single die and the general unsustainability of exponential growth. Even if the physical limitations were surmounted by better materials and semi-conductor manufacturing processes, it is likely their benefits will be outweighed by alternative innovations at other levels.

The exponential growth predicted by Moore's law is ultimately not sustainable, even as a rough guideline. Even if it were and the above physical limitations are overcome, the resulting transistor count or performance improvement will likely also significantly outrun Moore's predictions since the technology to work with materials at an atomic level will likely lead to completely different architectures Moore could never have predicted.

References

  • Brock, David C. (2006). Understanding Moore's Law: Four Decades of Innovation Chemical Heritage Foundation.

Notes

<references>

</references>