CSC/ECE 506 Spring 2014/1b ms - Revision history

Mapatwar: /* On demand supercomputing and cloud */

2014-02-08T01:57:20Z

On demand supercomputing and cloud

← Older revision		Revision as of 01:57, 8 February 2014
Line 73:		Line 73:

	=== On demand supercomputing and cloud ===		=== On demand supercomputing and cloud ===
	<p>The current paradigm in the cloud computing<ref>http://en.wikipedia.org/wiki/Cloud_computing</ref> tribe will be the availability of supercomputing application to ubiquitous computer. Computing big analytical calculations using supercomputer available to small industries or individuals using cloud will change the dynamics of process of manufacturing in small scale industries. On demand supercomputing will enable companies and enterprises to significantly decrease the development and evaluation time of their prototype and this will help them change their costing structure along with decrease in time to market a product.</p>		<p>The current paradigm in the cloud computing<ref>http://en.wikipedia.org/wiki/Cloud_computing</ref> tribe will be the availability of supercomputing application to ubiquitous computer. Computing big analytical calculations using supercomputer available to small industries or individuals using cloud will change the dynamics of process of manufacturing in small scale industries. On demand supercomputing will enable companies and enterprises to significantly decrease the development and evaluation time of their prototype and this will help them change their costing structure along with decrease in time to market a product<ref>http://arstechnica.com/information-technology/2013/11/18-hours-33k-and-156314-cores-amazon-cloud-hpc-hits-a-petaflop/</ref>.</p>
	<p>The [http://www.open-power.org/ OpenPOWER] Foundation is one a prominent example which in a way represents the shape of things to come. It is a consortium initiated by IBM in collaboration with Google, [http://www.tyan.com/ Tyan], [http://www.tyan.com/ Nvidia] and [http://www.mellanox.com/ Mellanox] as the founding members. IBM is opening up its POWER Architecture technology on a liberal license which will enable the server vendor ecosystem build and configure their own customized server, networking and storage hardware for cloud computing and data centers<ref>http://en.wikipedia.org/wiki/OpenPOWER_Foundation</ref>.</p>		<p>The [http://www.open-power.org/ OpenPOWER] Foundation is one a prominent example which in a way represents the shape of things to come. It is a consortium initiated by IBM in collaboration with Google, [http://www.tyan.com/ Tyan], [http://www.tyan.com/ Nvidia] and [http://www.mellanox.com/ Mellanox] as the founding members. IBM is opening up its POWER Architecture technology on a liberal license which will enable the server vendor ecosystem build and configure their own customized server, networking and storage hardware for cloud computing and data centers<ref>http://en.wikipedia.org/wiki/OpenPOWER_Foundation</ref>.</p>
	<p>Though the cloud a viable platform for medium scale applications; interconnects and bandwidth still is a major bottleneck to executing large scale tightly coupled high performance computing applications on the cloud. The large scale interest and migration to optical networks does instill some hope but it is highly unlikely that the cloud can ever replace supercomputers<ref>http://www.computer.org/portal/web/computingnow/archive/september2012</ref><ref>http://gigaom.com/2011/11/14/how-the-cloud-is-reshaping-supercomputers/</ref>.</p>		<p>Though the cloud a viable platform for medium scale applications; interconnects and bandwidth still is a major bottleneck to executing large scale tightly coupled high performance computing applications on the cloud. The large scale interest and migration to optical networks does instill some hope but it is highly unlikely that the cloud can ever replace supercomputers<ref>http://www.computer.org/portal/web/computingnow/archive/september2012</ref><ref>http://gigaom.com/2011/11/14/how-the-cloud-is-reshaping-supercomputers/</ref>.</p>

Mapatwar: /* Characteristics of supercomputers */

2014-02-08T01:53:08Z

Characteristics of supercomputers

← Older revision		Revision as of 01:53, 8 February 2014
Line 5:		Line 5:
	== Characteristics of supercomputers ==		== Characteristics of supercomputers ==
	[[Image:4.jpg\|thumb\|right\|center\|upright\|500px\|<b>Tianhe-2 - The fastest supercomputer as of 2013</b> http://www.engineering.com/DesignerEdge/DesignerEdgeArticles/ArticleID/6676/Tianhe-2-Tops-Supercomputer-List.aspx]]		[[Image:4.jpg\|thumb\|right\|center\|upright\|500px\|<b>Tianhe-2 - The fastest supercomputer as of 2013</b> http://www.engineering.com/DesignerEdge/DesignerEdgeArticles/ArticleID/6676/Tianhe-2-Tops-Supercomputer-List.aspx]]
	<p>The definition of a supercomputer established in the previous section gives some insights into the nature and features of such computing systems. As a result, certain patterns or a combination of features emerge, which are unique to supercomputers. This section discusses those features and ~~characteristics. Based on the [http://www.TOP500.org TOP500.org] data as of November 2013, today’s supercomputers share the following key~~ characteristics<ref>http://royal.pingdom.com/2012/11/13/new-top-supercomputer-dumps-cores-and-increases-power-efficiency/</ref>.</p>		<p>The definition of a supercomputer established in the previous section gives some insights into the nature and features of such computing systems. As a result, certain patterns or a combination of features emerge, which are unique to supercomputers. This section discusses those features and characteristics<ref>http://royal.pingdom.com/2012/11/13/new-top-supercomputer-dumps-cores-and-increases-power-efficiency/</ref></p>
	*'''Processing Speed:'''		*'''Processing Speed:'''
	<p>The common feature uniting the [http://en.wikipedia.org/wiki/Human_Genome_Project Human Genome Project], the [http://home.web.cern.ch/topics/large-hadron-collider Large Hadron collider] and other such challenging scientific experiments of our era has been their demand for massive computing power. The ever accelerating growth of our knowledgebase coupled with the IT revolution has made '''processing speed''' as the most critical parameter in characterizing supercomputers. This hunger for increasing processing speed is evident from the fact that the faster supercomputer today is a thousand times faster than the fastest supercomputer a decade ago. As supercomputers find more and more applications is a wide horizon of fields such as meteorology, defense and biology; this demand for high computing power is far for subsiding.</P>		<p>The common feature uniting the [http://en.wikipedia.org/wiki/Human_Genome_Project Human Genome Project], the [http://home.web.cern.ch/topics/large-hadron-collider Large Hadron collider] and other such challenging scientific experiments of our era has been their demand for massive computing power. The ever accelerating growth of our knowledgebase coupled with the IT revolution has made '''processing speed''' as the most critical parameter in characterizing supercomputers. This hunger for increasing processing speed is evident from the fact that the faster supercomputer today is a thousand times faster than the fastest supercomputer a decade ago. As supercomputers find more and more applications is a wide horizon of fields such as meteorology, defense and biology; this demand for high computing power is far for subsiding.</P>

Ssingh14: /* Characteristics of supercomputers */

2014-02-08T01:50:47Z

Characteristics of supercomputers

← Older revision		Revision as of 01:50, 8 February 2014
Line 5:		Line 5:
	== Characteristics of supercomputers ==		== Characteristics of supercomputers ==
	[[Image:4.jpg\|thumb\|right\|center\|upright\|500px\|<b>Tianhe-2 - The fastest supercomputer as of 2013</b> http://www.engineering.com/DesignerEdge/DesignerEdgeArticles/ArticleID/6676/Tianhe-2-Tops-Supercomputer-List.aspx]]		[[Image:4.jpg\|thumb\|right\|center\|upright\|500px\|<b>Tianhe-2 - The fastest supercomputer as of 2013</b> http://www.engineering.com/DesignerEdge/DesignerEdgeArticles/ArticleID/6676/Tianhe-2-Tops-Supercomputer-List.aspx]]
	<p>Based on the [http://www.TOP500.org TOP500.org] data as of November 2013, today’s supercomputers share the following key characteristics<ref>http://royal.pingdom.com/2012/11/13/new-top-supercomputer-dumps-cores-and-increases-power-efficiency/</ref>.</p>		<p>The definition of a supercomputer established in the previous section gives some insights into the nature and features of such computing systems. As a result, certain patterns or a combination of features emerge, which are unique to supercomputers. This section discusses those features and characteristics. Based on the [http://www.TOP500.org TOP500.org] data as of November 2013, today’s supercomputers share the following key characteristics<ref>http://royal.pingdom.com/2012/11/13/new-top-supercomputer-dumps-cores-and-increases-power-efficiency/</ref>.</p>
	*'''Processing Speed:'''		*'''Processing Speed:'''
	<p>The common feature uniting the [http://en.wikipedia.org/wiki/Human_Genome_Project Human Genome Project], the [http://home.web.cern.ch/topics/large-hadron-collider Large Hadron collider] and other such challenging scientific experiments of our era has been their demand for massive computing power. The ever accelerating growth of our knowledgebase coupled with the IT revolution has made '''processing speed''' as the most critical parameter in characterizing supercomputers. This hunger for increasing processing speed is evident from the fact that the faster supercomputer today is a thousand times faster than the fastest supercomputer a decade ago. As supercomputers find more and more applications is a wide horizon of fields such as meteorology, defense and biology; this demand for high computing power is far for subsiding.</P>		<p>The common feature uniting the [http://en.wikipedia.org/wiki/Human_Genome_Project Human Genome Project], the [http://home.web.cern.ch/topics/large-hadron-collider Large Hadron collider] and other such challenging scientific experiments of our era has been their demand for massive computing power. The ever accelerating growth of our knowledgebase coupled with the IT revolution has made '''processing speed''' as the most critical parameter in characterizing supercomputers. This hunger for increasing processing speed is evident from the fact that the faster supercomputer today is a thousand times faster than the fastest supercomputer a decade ago. As supercomputers find more and more applications is a wide horizon of fields such as meteorology, defense and biology; this demand for high computing power is far for subsiding.</P>

Mapatwar: /* Cluster Computing */

2014-02-08T01:46:44Z

Cluster Computing

← Older revision		Revision as of 01:46, 8 February 2014
Line 57:		Line 57:
	[[Image:3a.png\|thumb\|right\|center\|upright\|600px\|<b>A Generic Cluster System</b>		[[Image:3a.png\|thumb\|right\|center\|upright\|600px\|<b>A Generic Cluster System</b>
	http://en.wikipedia.org/wiki/File:Beowulf.png]]		http://en.wikipedia.org/wiki/File:Beowulf.png]]
	<p>Clusters are group of computers which are connected together through networking and they appear as a single system to the outside world. All the processing in this architecture is carried out using load balancing and resource sharing which is done completely on the back ground. Invented by Digital Equipment Corporation in the 1980's, clusters of computers form the largest number of supercomputers available today.</p>		<p>Clusters are group of computers which are connected together through networking and they appear as a single system to the outside world. All the processing in this architecture is carried out using load balancing and resource sharing which is done completely on the back ground. Invented by Digital Equipment Corporation<ref>http://en.wikipedia.org/wiki/Digital_Equipment_Corporation</ref> in the 1980's, clusters of computers form the largest number of supercomputers available today.</p>
	<p>TOP500.org<ref>http://www.TOP500.org TOP500.org</ref> data as of November 2013 shows that Cluster computing makes up the largest subset of supercomputers at 84.6 percent.</p>		<p>TOP500.org<ref>http://www.TOP500.org TOP500.org</ref> data as of November 2013 shows that Cluster computing makes up the largest subset of supercomputers at 84.6 percent.</p>
	<p>In cluster architecture computers are harnessed together and they work independent of the application interacting with it. In fact the application or user running on the architecture sees them as a single resource<ref>http://wiki.expertiza.ncsu.edu/index.php/CSC/ECE_506_Spring_2013/1b_dj#Supercomputers Architecture</ref>.</p>		<p>In cluster architecture computers are harnessed together and they work independent of the application interacting with it. In fact the application or user running on the architecture sees them as a single resource<ref>http://wiki.expertiza.ncsu.edu/index.php/CSC/ECE_506_Spring_2013/1b_dj#Supercomputers Architecture</ref>.</p>

Mapatwar: /* Cluster Computing */

2014-02-08T01:45:32Z

Cluster Computing

← Older revision		Revision as of 01:45, 8 February 2014
Line 57:		Line 57:
	[[Image:3a.png\|thumb\|right\|center\|upright\|600px\|<b>A Generic Cluster System</b>		[[Image:3a.png\|thumb\|right\|center\|upright\|600px\|<b>A Generic Cluster System</b>
	http://en.wikipedia.org/wiki/File:Beowulf.png]]		http://en.wikipedia.org/wiki/File:Beowulf.png]]
	<p>Clusters are group of computers are connected together through networking and they appear as a single system to the outside world. All the processing in this architecture is carried out using load balancing and resource sharing which is done completely on the back ground. Invented by Digital Equipment Corporation in the 1980's, clusters of computers form the largest number of supercomputers available today.</p>		<p>Clusters are group of computers which are connected together through networking and they appear as a single system to the outside world. All the processing in this architecture is carried out using load balancing and resource sharing which is done completely on the back ground. Invented by Digital Equipment Corporation in the 1980's, clusters of computers form the largest number of supercomputers available today.</p>
	<p>TOP500.org<ref>http://www.TOP500.org TOP500.org</ref> data as of November 2013 shows that Cluster computing makes up the largest subset of supercomputers at 84.6 percent.</p>		<p>TOP500.org<ref>http://www.TOP500.org TOP500.org</ref> data as of November 2013 shows that Cluster computing makes up the largest subset of supercomputers at 84.6 percent.</p>
	<p>In cluster architecture computers are harnessed together and they work independent of the application interacting with it. In fact the application or user running on the architecture sees them as a single resource<ref>http://wiki.expertiza.ncsu.edu/index.php/CSC/ECE_506_Spring_2013/1b_dj#Supercomputers Architecture</ref>.</p>		<p>In cluster architecture computers are harnessed together and they work independent of the application interacting with it. In fact the application or user running on the architecture sees them as a single resource<ref>http://wiki.expertiza.ncsu.edu/index.php/CSC/ECE_506_Spring_2013/1b_dj#Supercomputers Architecture</ref>.</p>

Mapatwar: /* Architecture of parallel computers */

2014-02-08T01:44:21Z

Architecture of parallel computers

← Older revision		Revision as of 01:44, 8 February 2014
Line 29:		Line 29:

	== Architecture of parallel computers ==		== Architecture of parallel computers ==
	The architecture of parallel systems can be classified on the basis of the hardware level at which they support parallelism. This is usually determined by the manner in which the processing elements are connected with each other, the level at which they communicate the memory resources they share.		The architecture of parallel systems<ref>https://computing.llnl.gov/tutorials/parallel_comp/#Whatis</ref> can be classified on the basis of the hardware level at which they support parallelism. This is usually determined by the manner in which the processing elements are connected with each other, the level at which they communicate the memory resources they share.
	=== Symmetric Multiprocessing ===		=== Symmetric Multiprocessing ===
	[[Image:super1.jpg\|thumb\|right\|center\|upright\|500px\|<b>A Generic Symmetric Multiprocessor System</b> http://upload.wikimedia.org/wikipedia/commons/1/1c/SMP_-_Symmetric_Multiprocessor_System.svg]]		[[Image:super1.jpg\|thumb\|right\|center\|upright\|500px\|<b>A Generic Symmetric Multiprocessor System</b> http://upload.wikimedia.org/wikipedia/commons/1/1c/SMP_-_Symmetric_Multiprocessor_System.svg]]

Mapatwar: /* Massive Parallel Processing */

2014-02-08T01:42:06Z

Massive Parallel Processing

← Older revision		Revision as of 01:42, 8 February 2014
Line 42:		Line 42:
	[[Image:mpp2.jpg\|left\|thumb\|upleft\|1000px\|<b>A Generic MPP System</b>		[[Image:mpp2.jpg\|left\|thumb\|upleft\|1000px\|<b>A Generic MPP System</b>
	http://encyclopedia2.thefreedictionary.com/MPP]]		http://encyclopedia2.thefreedictionary.com/MPP]]
	<p>[http://whatis.techtarget.com/definition/0,,sid9_gci214085,00.html Massively Parallel Processing] or MPP supercomputers are made up of hundreds of computing nodes and process data in a coordinated fashion ~~<refname="ttmppdef">http://whatis.techtarget.com/definition/0,,sid9_gci214085,00~~.~~html</ref>.~~ Each node of the MPP generally has its own memory and operating system and can be made up of nodes that have multiple processors and/or multiple cores ~~<ref name="ttmppdef" />~~.</p>		<p>[http://whatis.techtarget.com/definition/0,,sid9_gci214085,00.html Massively Parallel Processing] or MPP supercomputers are made up of hundreds of computing nodes and process data in a coordinated fashion .Each node of the MPP generally has its own memory and operating system and can be made up of nodes that have multiple processors and/or multiple cores.</p>

	<p>Processing elements in a Massive Parallel Processing [http://en.wikipedia.org/wiki/Massively_parallel_(computing) (MPP's)] have their own memory modules and communication circuitry and they are interconnected by a network. Contemporary topologies include meshes, hyper-cubes, rings and trees. These systems differ from cluster computers, the other class of distributed computers, in their communication scheme. MPP’s have specialized interconnect network where as clustered systems use off the shelf communication hardware.		<p>Processing elements in a Massive Parallel Processing [http://en.wikipedia.org/wiki/Massively_parallel_(computing) (MPP's)] have their own memory modules and communication circuitry and they are interconnected by a network. Contemporary topologies include meshes, hyper-cubes, rings and trees. These systems differ from cluster computers, the other class of distributed computers, in their communication scheme. MPP’s have specialized interconnect network where as clustered systems use off the shelf communication hardware.
	[[Image:super6.jpg\|thumb\|right\|upright\|300px\|<b>IBM Blue Gene/L Supercomputer</b>		[[Image:super6.jpg\|thumb\|right\|upright\|300px\|<b>IBM Blue Gene/L Supercomputer</b>

Mapatwar: /* Massive Parallel Processing */

2014-02-08T01:39:56Z

Massive Parallel Processing

← Older revision		Revision as of 01:39, 8 February 2014
Line 42:		Line 42:
	[[Image:mpp2.jpg\|left\|thumb\|upleft\|1000px\|<b>A Generic MPP System</b>		[[Image:mpp2.jpg\|left\|thumb\|upleft\|1000px\|<b>A Generic MPP System</b>
	http://encyclopedia2.thefreedictionary.com/MPP]]		http://encyclopedia2.thefreedictionary.com/MPP]]
			<p>[http://whatis.techtarget.com/definition/0,,sid9_gci214085,00.html Massively Parallel Processing] or MPP supercomputers are made up of hundreds of computing nodes and process data in a coordinated fashion <refname="ttmppdef">http://whatis.techtarget.com/definition/0,,sid9_gci214085,00.html</ref>. Each node of the MPP generally has its own memory and operating system and can be made up of nodes that have multiple processors and/or multiple cores <ref name="ttmppdef" />.</p>
	<p>Processing elements in a Massive Parallel Processing [http://en.wikipedia.org/wiki/Massively_parallel_(computing) (MPP's)] have their own memory modules and communication circuitry and they are interconnected by a network. Contemporary topologies include meshes, hyper-cubes, rings and trees. These systems differ from cluster computers, the other class of distributed computers, in their communication scheme. MPP’s have specialized interconnect network where as clustered systems use off the shelf communication hardware.		<p>Processing elements in a Massive Parallel Processing [http://en.wikipedia.org/wiki/Massively_parallel_(computing) (MPP's)] have their own memory modules and communication circuitry and they are interconnected by a network. Contemporary topologies include meshes, hyper-cubes, rings and trees. These systems differ from cluster computers, the other class of distributed computers, in their communication scheme. MPP’s have specialized interconnect network where as clustered systems use off the shelf communication hardware.
	[[Image:super6.jpg\|thumb\|right\|upright\|300px\|<b>IBM Blue Gene/L Supercomputer</b>		[[Image:super6.jpg\|thumb\|right\|upright\|300px\|<b>IBM Blue Gene/L Supercomputer</b>

Ssingh14: /* Architecture of parallel computers */

2014-02-08T01:35:40Z

Architecture of parallel computers

← Older revision		Revision as of 01:35, 8 February 2014
Line 29:		Line 29:

	== Architecture of parallel computers ==		== Architecture of parallel computers ==
			The architecture of parallel systems can be classified on the basis of the hardware level at which they support parallelism. This is usually determined by the manner in which the processing elements are connected with each other, the level at which they communicate the memory resources they share.
	=== Symmetric Multiprocessing ===		=== Symmetric Multiprocessing ===
	[[Image:super1.jpg\|thumb\|right\|center\|upright\|500px\|<b>A Generic Symmetric Multiprocessor System</b> http://upload.wikimedia.org/wikipedia/commons/1/1c/SMP_-_Symmetric_Multiprocessor_System.svg]]		[[Image:super1.jpg\|thumb\|right\|center\|upright\|500px\|<b>A Generic Symmetric Multiprocessor System</b> http://upload.wikimedia.org/wikipedia/commons/1/1c/SMP_-_Symmetric_Multiprocessor_System.svg]]

Mapatwar: /* Cluster Computing */

2014-02-08T01:33:00Z

Cluster Computing

← Older revision		Revision as of 01:33, 8 February 2014
Line 55:		Line 55:
	http://en.wikipedia.org/wiki/File:Beowulf.png]]		http://en.wikipedia.org/wiki/File:Beowulf.png]]
	<p>Clusters are group of computers are connected together through networking and they appear as a single system to the outside world. All the processing in this architecture is carried out using load balancing and resource sharing which is done completely on the back ground. Invented by Digital Equipment Corporation in the 1980's, clusters of computers form the largest number of supercomputers available today.</p>		<p>Clusters are group of computers are connected together through networking and they appear as a single system to the outside world. All the processing in this architecture is carried out using load balancing and resource sharing which is done completely on the back ground. Invented by Digital Equipment Corporation in the 1980's, clusters of computers form the largest number of supercomputers available today.</p>
	<p>TOP500.org data as of November 2013 shows that Cluster computing makes up the largest subset of supercomputers at 84.6 percent.</p>		<p>TOP500.org<ref>http://www.TOP500.org TOP500.org</ref> data as of November 2013 shows that Cluster computing makes up the largest subset of supercomputers at 84.6 percent.</p>
	<p>In cluster architecture computers are harnessed together and they work independent of the application interacting with it. In fact the application or user running on the architecture sees them as a single resource<ref>http://wiki.expertiza.ncsu.edu/index.php/CSC/ECE_506_Spring_2013/1b_dj#Supercomputers Architecture</ref>.</p>		<p>In cluster architecture computers are harnessed together and they work independent of the application interacting with it. In fact the application or user running on the architecture sees them as a single resource<ref>http://wiki.expertiza.ncsu.edu/index.php/CSC/ECE_506_Spring_2013/1b_dj#Supercomputers Architecture</ref>.</p>
	<p>There are three main components to cluster architecture namely interconnect technology, storage and memory.</p>		<p>There are three main components to cluster architecture namely interconnect technology, storage and memory.</p>