SlideShare a Scribd company logo
Introduction to
High-Performance Computing
2
What is High Performance Computing?
• There is no clear definition
– Computing on high performance computers
– Solving problems / doing research using computer modeling, simulation and analysis
– Engineering design using computer modeling, simulation and analysis
• My understanding
– A huge number of computational and memory requirements
– Cannot be afforded by a PC efficiently
– Speeds and feeds are the keywords
• Who uses High-Performance Computing
– Research institutes, universities and government labs
• Weather and climate research, bioscience, energy, military etc.
– Engineering design: more or less every product we use
• Automotive, aerospace, oil and gas explorations, digital media, financial simulation
• Mechanical simulation, package designs, silicon manufacturing etc.
• Similar concepts
– Parallel computing: computing on parallel computers
– Super computing: computing on world 500 fastest supercomputers
3
When Do We Need High Performance Computing?
• Case1: Complete a time-consuming operation in less time
– I am an automotive engineer
– I need to design a new car that consumes less gasoline
– I’d rather have the design completed in 6 months than in 2 years
– I want to test my design using computer simulations rather than building very expensive
prototypes and crashing them
• Case 2: Complete an operation under a tight deadline
– I work for a weather prediction agency
– I am getting input from weather stations/sensors
– I’d like to predict tomorrow’s forecast today
• Case 3: Perform a high number of operations per seconds
– I am an engineer at Amazon.com
– My Web server gets 1,000 hits per seconds
– I’d like my web server and databases to handle 1,000 transactions per seconds so that
customers do not experience bad delays
4
What Does High Performance Computing Include?
• High-performance computing is fast computing
– Computations in parallel over lots of compute elements (CPU, GPU)
– Very fast network to connect between the compute elements
• Hardware
– Computer Architecture
• Vector Computers, MPP, SMP, Distributed Systems, Clusters
– Network Connections
• InfiniBand, Ethernet, Proprietary (Myrinet, Quadrics, Cray-SeaStar etc.)
• Software
– Programming models
• MPI (Message Passing Interface), SHMEM (Shared Memory), PGAS, etc.
– Applications
• Open source, commercial
5
Rise and Fall of HPC Computer Architectures
• Vector Computers (VC) - proprietary system
– Provided the breakthrough needed for the emergence of computational science, but
they were only a partial answer
• Massively Parallel Processors (MPP) - proprietary systems
– High cost and a low performance/price ratio.
• Symmetric Multiprocessors (SMP)
– Suffers from scalability
• Distributed Systems
– Difficult to use and hard to extract parallel performance
• Clusters – commodity and highly popular
– High Performance Computing - Commodity Supercomputing
– High Availability Computing - Mission Critical Applications
6
Top500 Supercomputers List – System Architecture
Clusters have
become the most
used HPC system
architecture
More than 80% of
Top500 systems
are clusters
7
Computer Food Chain: Causing the Demise of Specialized Systems
Parallel Computing on a Large Number of Servers is More
Efficient than using Specialized Systems
8
HPC Clusters – Affordable, Efficient and Scalable HPC Solution
• Since the 1990s, there has been an increasing trend to move away from
expensive /specialized proprietary parallel supercomputers to clusters of
computers
– From specialized supercomputers to cost effective, general purpose systems
• So What’s So Different about Clusters?
– Commodity, standard, affordable, cost effective, scalable and reliable architecture
Server
Communications
Software
Network Interface
Hardware
Server
Communications
Software
Network Interface
Hardware
Server
Communications
Software
Network Interface
Hardware
Server
Communications
Software
Network Interface
Hardware
Cluster Interconnect Network
Cluster Architecture
9
• Commoditization/standardization are the clustering and interconnect driving forces
• InfiniBand and Ethernet are the most used interconnect solutions for HPC systems
Cluster Interconnect
10
Interconnect Trends – Top100 Status (Nov 2010)
11
Product Development Process
Preparation/Delivery
Without
Concept
Development
Prototype/
Physical Testing
Manufacturing
Design
Final
HPC
Time to Market
With
HPC
HPC-Supported
Simulation
Time Savings
The HPC Advantage: Reduction in Time to Market
Source: IDC
12
• From concept to engineering, from design to test and
manufacturing, from weather prediction to medical
discoveries, our day to day life depends more and more
on HPC simulations
– Safer products, accurate predictions, research, etc.
• High-performance compute clusters provide the most
efficient, flexible, cost effective HPC environment for any
HPC simulation
Summary
1313
Thank You
www.hpcadvisorycouncil.com
info@hpcadvisorycouncil.com
Ad

More Related Content

What's hot (20)

High Performance Computing
High Performance ComputingHigh Performance Computing
High Performance Computing
Divyen Patel
 
High performance computing
High performance computingHigh performance computing
High performance computing
punjab engineering college, chandigarh
 
Introduction to HPC
Introduction to HPCIntroduction to HPC
Introduction to HPC
Chris Dwan
 
Parallel Programming
Parallel ProgrammingParallel Programming
Parallel Programming
Uday Sharma
 
Introduction to Parallel and Distributed Computing
Introduction to Parallel and Distributed ComputingIntroduction to Parallel and Distributed Computing
Introduction to Parallel and Distributed Computing
Sayed Chhattan Shah
 
Introduction to High Performance Computing
Introduction to High Performance ComputingIntroduction to High Performance Computing
Introduction to High Performance Computing
Umarudin Zaenuri
 
Parallel computing persentation
Parallel computing persentationParallel computing persentation
Parallel computing persentation
VIKAS SINGH BHADOURIA
 
Parallel processing
Parallel processingParallel processing
Parallel processing
rajshreemuthiah
 
Memory consistency models
Memory consistency modelsMemory consistency models
Memory consistency models
palani kumar
 
Parallel computing
Parallel computingParallel computing
Parallel computing
Vinay Gupta
 
Distributed Operating Systems
Distributed Operating SystemsDistributed Operating Systems
Distributed Operating Systems
Ummiya Mohammedi
 
Distributed Operating System_1
Distributed Operating System_1Distributed Operating System_1
Distributed Operating System_1
Dr Sandeep Kumar Poonia
 
multiprocessors and multicomputers
 multiprocessors and multicomputers multiprocessors and multicomputers
multiprocessors and multicomputers
Pankaj Kumar Jain
 
cluster computing
cluster computingcluster computing
cluster computing
anjalibhandari11011995
 
Unit2 hci
Unit2 hciUnit2 hci
Unit2 hci
pradeepgupta266
 
Trends in distributed systems
Trends in distributed systemsTrends in distributed systems
Trends in distributed systems
Jayanthi Radhakrishnan
 
Process scheduling
Process schedulingProcess scheduling
Process scheduling
Riya Choudhary
 
Artificial Intelligence Notes Unit 1
Artificial Intelligence Notes Unit 1 Artificial Intelligence Notes Unit 1
Artificial Intelligence Notes Unit 1
DigiGurukul
 
Introduction to Parallel Distributed Computer Systems
Introduction to Parallel Distributed Computer SystemsIntroduction to Parallel Distributed Computer Systems
Introduction to Parallel Distributed Computer Systems
MrMaKKaWi
 
CS9222 ADVANCED OPERATING SYSTEMS
CS9222 ADVANCED OPERATING SYSTEMSCS9222 ADVANCED OPERATING SYSTEMS
CS9222 ADVANCED OPERATING SYSTEMS
Kathirvel Ayyaswamy
 
High Performance Computing
High Performance ComputingHigh Performance Computing
High Performance Computing
Divyen Patel
 
Introduction to HPC
Introduction to HPCIntroduction to HPC
Introduction to HPC
Chris Dwan
 
Parallel Programming
Parallel ProgrammingParallel Programming
Parallel Programming
Uday Sharma
 
Introduction to Parallel and Distributed Computing
Introduction to Parallel and Distributed ComputingIntroduction to Parallel and Distributed Computing
Introduction to Parallel and Distributed Computing
Sayed Chhattan Shah
 
Introduction to High Performance Computing
Introduction to High Performance ComputingIntroduction to High Performance Computing
Introduction to High Performance Computing
Umarudin Zaenuri
 
Memory consistency models
Memory consistency modelsMemory consistency models
Memory consistency models
palani kumar
 
Parallel computing
Parallel computingParallel computing
Parallel computing
Vinay Gupta
 
Distributed Operating Systems
Distributed Operating SystemsDistributed Operating Systems
Distributed Operating Systems
Ummiya Mohammedi
 
multiprocessors and multicomputers
 multiprocessors and multicomputers multiprocessors and multicomputers
multiprocessors and multicomputers
Pankaj Kumar Jain
 
Artificial Intelligence Notes Unit 1
Artificial Intelligence Notes Unit 1 Artificial Intelligence Notes Unit 1
Artificial Intelligence Notes Unit 1
DigiGurukul
 
Introduction to Parallel Distributed Computer Systems
Introduction to Parallel Distributed Computer SystemsIntroduction to Parallel Distributed Computer Systems
Introduction to Parallel Distributed Computer Systems
MrMaKKaWi
 
CS9222 ADVANCED OPERATING SYSTEMS
CS9222 ADVANCED OPERATING SYSTEMSCS9222 ADVANCED OPERATING SYSTEMS
CS9222 ADVANCED OPERATING SYSTEMS
Kathirvel Ayyaswamy
 

Viewers also liked (20)

High performance computing
High performance computingHigh performance computing
High performance computing
Guy Tel-Zur
 
High Performance Computing: an Introduction for the Society of Actuaries
High Performance Computing: an Introduction for the Society of ActuariesHigh Performance Computing: an Introduction for the Society of Actuaries
High Performance Computing: an Introduction for the Society of Actuaries
Adam DeConinck
 
High Performance Computing - The Future is Here
High Performance Computing - The Future is HereHigh Performance Computing - The Future is Here
High Performance Computing - The Future is Here
Martin Hamilton
 
High Performance Computing using MPI
High Performance Computing using MPIHigh Performance Computing using MPI
High Performance Computing using MPI
Ankit Mahato
 
High performance computing - building blocks, production & perspective
High performance computing - building blocks, production & perspectiveHigh performance computing - building blocks, production & perspective
High performance computing - building blocks, production & perspective
Jason Shih
 
Kalray TURBOCARD2 @ ISC'14
Kalray TURBOCARD2 @ ISC'14Kalray TURBOCARD2 @ ISC'14
Kalray TURBOCARD2 @ ISC'14
KALRAY
 
High Performance Computing in the Cloud?
High Performance Computing in the Cloud?High Performance Computing in the Cloud?
High Performance Computing in the Cloud?
Ian Lumb
 
High Performance Computing: The Essential tool for a Knowledge Economy
High Performance Computing: The Essential tool for a Knowledge EconomyHigh Performance Computing: The Essential tool for a Knowledge Economy
High Performance Computing: The Essential tool for a Knowledge Economy
Intel IT Center
 
Raspberry pi 2 demo
Raspberry pi 2 demoRaspberry pi 2 demo
Raspberry pi 2 demo
Viet Nguyen
 
Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...
Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...
Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...
xKinAnx
 
GPFS - graphical intro
GPFS - graphical introGPFS - graphical intro
GPFS - graphical intro
Alex Balk
 
Multi-faceted Classification of Big Data Use Cases and Proposed Architecture ...
Multi-faceted Classification of Big Data Use Cases and Proposed Architecture ...Multi-faceted Classification of Big Data Use Cases and Proposed Architecture ...
Multi-faceted Classification of Big Data Use Cases and Proposed Architecture ...
Geoffrey Fox
 
Unix _linux_fundamentals_for_hpc-_b
Unix  _linux_fundamentals_for_hpc-_bUnix  _linux_fundamentals_for_hpc-_b
Unix _linux_fundamentals_for_hpc-_b
Mohammad Reza Beygi
 
Accelerating Hadoop, Spark, and Memcached with HPC Technologies
Accelerating Hadoop, Spark, and Memcached with HPC TechnologiesAccelerating Hadoop, Spark, and Memcached with HPC Technologies
Accelerating Hadoop, Spark, and Memcached with HPC Technologies
inside-BigData.com
 
Delivering Transformational Solutions to Industry by Dr. Frederick Streitz, D...
Delivering Transformational Solutions to Industry by Dr. Frederick Streitz, D...Delivering Transformational Solutions to Industry by Dr. Frederick Streitz, D...
Delivering Transformational Solutions to Industry by Dr. Frederick Streitz, D...
Industrial Partnerships Office
 
Parallel structure
Parallel structureParallel structure
Parallel structure
rileyRmerrill
 
Parallelism
ParallelismParallelism
Parallelism
Melvin del Rosario
 
Parallelism ppt
Parallelism pptParallelism ppt
Parallelism ppt
lgenetti
 
High performance concrete ppt
High performance concrete pptHigh performance concrete ppt
High performance concrete ppt
Google
 
Storage Area Network(SAN)
Storage Area Network(SAN)Storage Area Network(SAN)
Storage Area Network(SAN)
Krishna Kahar
 
High performance computing
High performance computingHigh performance computing
High performance computing
Guy Tel-Zur
 
High Performance Computing: an Introduction for the Society of Actuaries
High Performance Computing: an Introduction for the Society of ActuariesHigh Performance Computing: an Introduction for the Society of Actuaries
High Performance Computing: an Introduction for the Society of Actuaries
Adam DeConinck
 
High Performance Computing - The Future is Here
High Performance Computing - The Future is HereHigh Performance Computing - The Future is Here
High Performance Computing - The Future is Here
Martin Hamilton
 
High Performance Computing using MPI
High Performance Computing using MPIHigh Performance Computing using MPI
High Performance Computing using MPI
Ankit Mahato
 
High performance computing - building blocks, production & perspective
High performance computing - building blocks, production & perspectiveHigh performance computing - building blocks, production & perspective
High performance computing - building blocks, production & perspective
Jason Shih
 
Kalray TURBOCARD2 @ ISC'14
Kalray TURBOCARD2 @ ISC'14Kalray TURBOCARD2 @ ISC'14
Kalray TURBOCARD2 @ ISC'14
KALRAY
 
High Performance Computing in the Cloud?
High Performance Computing in the Cloud?High Performance Computing in the Cloud?
High Performance Computing in the Cloud?
Ian Lumb
 
High Performance Computing: The Essential tool for a Knowledge Economy
High Performance Computing: The Essential tool for a Knowledge EconomyHigh Performance Computing: The Essential tool for a Knowledge Economy
High Performance Computing: The Essential tool for a Knowledge Economy
Intel IT Center
 
Raspberry pi 2 demo
Raspberry pi 2 demoRaspberry pi 2 demo
Raspberry pi 2 demo
Viet Nguyen
 
Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...
Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...
Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...
xKinAnx
 
GPFS - graphical intro
GPFS - graphical introGPFS - graphical intro
GPFS - graphical intro
Alex Balk
 
Multi-faceted Classification of Big Data Use Cases and Proposed Architecture ...
Multi-faceted Classification of Big Data Use Cases and Proposed Architecture ...Multi-faceted Classification of Big Data Use Cases and Proposed Architecture ...
Multi-faceted Classification of Big Data Use Cases and Proposed Architecture ...
Geoffrey Fox
 
Unix _linux_fundamentals_for_hpc-_b
Unix  _linux_fundamentals_for_hpc-_bUnix  _linux_fundamentals_for_hpc-_b
Unix _linux_fundamentals_for_hpc-_b
Mohammad Reza Beygi
 
Accelerating Hadoop, Spark, and Memcached with HPC Technologies
Accelerating Hadoop, Spark, and Memcached with HPC TechnologiesAccelerating Hadoop, Spark, and Memcached with HPC Technologies
Accelerating Hadoop, Spark, and Memcached with HPC Technologies
inside-BigData.com
 
Delivering Transformational Solutions to Industry by Dr. Frederick Streitz, D...
Delivering Transformational Solutions to Industry by Dr. Frederick Streitz, D...Delivering Transformational Solutions to Industry by Dr. Frederick Streitz, D...
Delivering Transformational Solutions to Industry by Dr. Frederick Streitz, D...
Industrial Partnerships Office
 
Parallelism ppt
Parallelism pptParallelism ppt
Parallelism ppt
lgenetti
 
High performance concrete ppt
High performance concrete pptHigh performance concrete ppt
High performance concrete ppt
Google
 
Storage Area Network(SAN)
Storage Area Network(SAN)Storage Area Network(SAN)
Storage Area Network(SAN)
Krishna Kahar
 
Ad

Similar to Introduction to High-Performance Computing (20)

Role of python in hpc
Role of python in hpcRole of python in hpc
Role of python in hpc
Dr Reeja S R
 
3 - Grid Computing.pptx
3 - Grid Computing.pptx3 - Grid Computing.pptx
3 - Grid Computing.pptx
RiazSalim1
 
OpenPOWER Roadmap Toward CORAL
OpenPOWER Roadmap Toward CORALOpenPOWER Roadmap Toward CORAL
OpenPOWER Roadmap Toward CORAL
inside-BigData.com
 
Cloud Computing Workshop
Cloud Computing WorkshopCloud Computing Workshop
Cloud Computing Workshop
Gaurav Malik
 
5 Ways Companies Are Using SUSE HPC in AI, ML and analytics
5 Ways Companies Are Using SUSE HPC in AI, ML and analytics5 Ways Companies Are Using SUSE HPC in AI, ML and analytics
5 Ways Companies Are Using SUSE HPC in AI, ML and analytics
Jeff Reser
 
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your MindDeliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
Avere Systems
 
5 Ways Companies Are Using SUSE HPC in AI, ML and Analytics
5 Ways Companies Are Using SUSE HPC in AI, ML and Analytics5 Ways Companies Are Using SUSE HPC in AI, ML and Analytics
5 Ways Companies Are Using SUSE HPC in AI, ML and Analytics
Jeff Reser
 
Cluster Computing
Cluster ComputingCluster Computing
Cluster Computing
Hitesh Mohapatra
 
understanding networked infrastructure
understanding networked infrastructureunderstanding networked infrastructure
understanding networked infrastructure
Mohammad Salman
 
Distributed Systems in Data Engineering
Distributed Systems in Data EngineeringDistributed Systems in Data Engineering
Distributed Systems in Data Engineering
Oluwasegun Matthew
 
Intro720T5.pptx
Intro720T5.pptxIntro720T5.pptx
Intro720T5.pptx
MahendraShukla27
 
Chapter 05- IT infrastucture and emerging technologies.pptx
Chapter 05- IT infrastucture and emerging technologies.pptxChapter 05- IT infrastucture and emerging technologies.pptx
Chapter 05- IT infrastucture and emerging technologies.pptx
jack732582
 
See the App Performance Future with Predictive Analytics Webcast
See the App Performance Future with Predictive Analytics WebcastSee the App Performance Future with Predictive Analytics Webcast
See the App Performance Future with Predictive Analytics Webcast
Compuware
 
CCUnit1.pdf
CCUnit1.pdfCCUnit1.pdf
CCUnit1.pdf
AnayGupta26
 
Introduction to Parallel Computing
Introduction to Parallel ComputingIntroduction to Parallel Computing
Introduction to Parallel Computing
Roshan Karunarathna
 
(19-23)CC Unit-1 ppt.pptx
(19-23)CC Unit-1 ppt.pptx(19-23)CC Unit-1 ppt.pptx
(19-23)CC Unit-1 ppt.pptx
NithishaYadavv
 
Foundation of High Performance Computing HPC
Foundation of High Performance Computing HPCFoundation of High Performance Computing HPC
Foundation of High Performance Computing HPC
nadiabha
 
42 grid computing
42 grid computing42 grid computing
42 grid computing
SALMAN SHAIKH
 
42 grid computing
42 grid computing42 grid computing
42 grid computing
SALMAN SHAIKH
 
Grid Computing
Grid ComputingGrid Computing
Grid Computing
Phương Đông
 
Role of python in hpc
Role of python in hpcRole of python in hpc
Role of python in hpc
Dr Reeja S R
 
3 - Grid Computing.pptx
3 - Grid Computing.pptx3 - Grid Computing.pptx
3 - Grid Computing.pptx
RiazSalim1
 
OpenPOWER Roadmap Toward CORAL
OpenPOWER Roadmap Toward CORALOpenPOWER Roadmap Toward CORAL
OpenPOWER Roadmap Toward CORAL
inside-BigData.com
 
Cloud Computing Workshop
Cloud Computing WorkshopCloud Computing Workshop
Cloud Computing Workshop
Gaurav Malik
 
5 Ways Companies Are Using SUSE HPC in AI, ML and analytics
5 Ways Companies Are Using SUSE HPC in AI, ML and analytics5 Ways Companies Are Using SUSE HPC in AI, ML and analytics
5 Ways Companies Are Using SUSE HPC in AI, ML and analytics
Jeff Reser
 
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your MindDeliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
Avere Systems
 
5 Ways Companies Are Using SUSE HPC in AI, ML and Analytics
5 Ways Companies Are Using SUSE HPC in AI, ML and Analytics5 Ways Companies Are Using SUSE HPC in AI, ML and Analytics
5 Ways Companies Are Using SUSE HPC in AI, ML and Analytics
Jeff Reser
 
understanding networked infrastructure
understanding networked infrastructureunderstanding networked infrastructure
understanding networked infrastructure
Mohammad Salman
 
Distributed Systems in Data Engineering
Distributed Systems in Data EngineeringDistributed Systems in Data Engineering
Distributed Systems in Data Engineering
Oluwasegun Matthew
 
Chapter 05- IT infrastucture and emerging technologies.pptx
Chapter 05- IT infrastucture and emerging technologies.pptxChapter 05- IT infrastucture and emerging technologies.pptx
Chapter 05- IT infrastucture and emerging technologies.pptx
jack732582
 
See the App Performance Future with Predictive Analytics Webcast
See the App Performance Future with Predictive Analytics WebcastSee the App Performance Future with Predictive Analytics Webcast
See the App Performance Future with Predictive Analytics Webcast
Compuware
 
Introduction to Parallel Computing
Introduction to Parallel ComputingIntroduction to Parallel Computing
Introduction to Parallel Computing
Roshan Karunarathna
 
(19-23)CC Unit-1 ppt.pptx
(19-23)CC Unit-1 ppt.pptx(19-23)CC Unit-1 ppt.pptx
(19-23)CC Unit-1 ppt.pptx
NithishaYadavv
 
Foundation of High Performance Computing HPC
Foundation of High Performance Computing HPCFoundation of High Performance Computing HPC
Foundation of High Performance Computing HPC
nadiabha
 
Ad

Recently uploaded (20)

AI x Accessibility UXPA by Stew Smith and Olivier Vroom
AI x Accessibility UXPA by Stew Smith and Olivier VroomAI x Accessibility UXPA by Stew Smith and Olivier Vroom
AI x Accessibility UXPA by Stew Smith and Olivier Vroom
UXPA Boston
 
fennec fox optimization algorithm for optimal solution
fennec fox optimization algorithm for optimal solutionfennec fox optimization algorithm for optimal solution
fennec fox optimization algorithm for optimal solution
shallal2
 
Optima Cyber - Maritime Cyber Security - MSSP Services - Manolis Sfakianakis ...
Optima Cyber - Maritime Cyber Security - MSSP Services - Manolis Sfakianakis ...Optima Cyber - Maritime Cyber Security - MSSP Services - Manolis Sfakianakis ...
Optima Cyber - Maritime Cyber Security - MSSP Services - Manolis Sfakianakis ...
Mike Mingos
 
Com fer un pla de gestió de dades amb l'eiNa DMP (en anglès)
Com fer un pla de gestió de dades amb l'eiNa DMP (en anglès)Com fer un pla de gestió de dades amb l'eiNa DMP (en anglès)
Com fer un pla de gestió de dades amb l'eiNa DMP (en anglès)
CSUC - Consorci de Serveis Universitaris de Catalunya
 
Bepents tech services - a premier cybersecurity consulting firm
Bepents tech services - a premier cybersecurity consulting firmBepents tech services - a premier cybersecurity consulting firm
Bepents tech services - a premier cybersecurity consulting firm
Benard76
 
machines-for-woodworking-shops-en-compressed.pdf
machines-for-woodworking-shops-en-compressed.pdfmachines-for-woodworking-shops-en-compressed.pdf
machines-for-woodworking-shops-en-compressed.pdf
AmirStern2
 
Enterprise Integration Is Dead! Long Live AI-Driven Integration with Apache C...
Enterprise Integration Is Dead! Long Live AI-Driven Integration with Apache C...Enterprise Integration Is Dead! Long Live AI-Driven Integration with Apache C...
Enterprise Integration Is Dead! Long Live AI-Driven Integration with Apache C...
Markus Eisele
 
Design pattern talk by Kaya Weers - 2025 (v2)
Design pattern talk by Kaya Weers - 2025 (v2)Design pattern talk by Kaya Weers - 2025 (v2)
Design pattern talk by Kaya Weers - 2025 (v2)
Kaya Weers
 
How to Install & Activate ListGrabber - eGrabber
How to Install & Activate ListGrabber - eGrabberHow to Install & Activate ListGrabber - eGrabber
How to Install & Activate ListGrabber - eGrabber
eGrabber
 
Developing System Infrastructure Design Plan.pptx
Developing System Infrastructure Design Plan.pptxDeveloping System Infrastructure Design Plan.pptx
Developing System Infrastructure Design Plan.pptx
wondimagegndesta
 
UiPath Automation Suite – Cas d'usage d'une NGO internationale basée à Genève
UiPath Automation Suite – Cas d'usage d'une NGO internationale basée à GenèveUiPath Automation Suite – Cas d'usage d'une NGO internationale basée à Genève
UiPath Automation Suite – Cas d'usage d'une NGO internationale basée à Genève
UiPathCommunity
 
RTP Over QUIC: An Interesting Opportunity Or Wasted Time?
RTP Over QUIC: An Interesting Opportunity Or Wasted Time?RTP Over QUIC: An Interesting Opportunity Or Wasted Time?
RTP Over QUIC: An Interesting Opportunity Or Wasted Time?
Lorenzo Miniero
 
Integrating FME with Python: Tips, Demos, and Best Practices for Powerful Aut...
Integrating FME with Python: Tips, Demos, and Best Practices for Powerful Aut...Integrating FME with Python: Tips, Demos, and Best Practices for Powerful Aut...
Integrating FME with Python: Tips, Demos, and Best Practices for Powerful Aut...
Safe Software
 
AI Agents at Work: UiPath, Maestro & the Future of Documents
AI Agents at Work: UiPath, Maestro & the Future of DocumentsAI Agents at Work: UiPath, Maestro & the Future of Documents
AI Agents at Work: UiPath, Maestro & the Future of Documents
UiPathCommunity
 
Could Virtual Threads cast away the usage of Kotlin Coroutines - DevoxxUK2025
Could Virtual Threads cast away the usage of Kotlin Coroutines - DevoxxUK2025Could Virtual Threads cast away the usage of Kotlin Coroutines - DevoxxUK2025
Could Virtual Threads cast away the usage of Kotlin Coroutines - DevoxxUK2025
João Esperancinha
 
Viam product demo_ Deploying and scaling AI with hardware.pdf
Viam product demo_ Deploying and scaling AI with hardware.pdfViam product demo_ Deploying and scaling AI with hardware.pdf
Viam product demo_ Deploying and scaling AI with hardware.pdf
camilalamoratta
 
GDG Cloud Southlake #42: Suresh Mathew: Autonomous Resource Optimization: How...
GDG Cloud Southlake #42: Suresh Mathew: Autonomous Resource Optimization: How...GDG Cloud Southlake #42: Suresh Mathew: Autonomous Resource Optimization: How...
GDG Cloud Southlake #42: Suresh Mathew: Autonomous Resource Optimization: How...
James Anderson
 
Smart Investments Leveraging Agentic AI for Real Estate Success.pptx
Smart Investments Leveraging Agentic AI for Real Estate Success.pptxSmart Investments Leveraging Agentic AI for Real Estate Success.pptx
Smart Investments Leveraging Agentic AI for Real Estate Success.pptx
Seasia Infotech
 
Limecraft Webinar - 2025.3 release, featuring Content Delivery, Graphic Conte...
Limecraft Webinar - 2025.3 release, featuring Content Delivery, Graphic Conte...Limecraft Webinar - 2025.3 release, featuring Content Delivery, Graphic Conte...
Limecraft Webinar - 2025.3 release, featuring Content Delivery, Graphic Conte...
Maarten Verwaest
 
Everything You Need to Know About Agentforce? (Put AI Agents to Work)
Everything You Need to Know About Agentforce? (Put AI Agents to Work)Everything You Need to Know About Agentforce? (Put AI Agents to Work)
Everything You Need to Know About Agentforce? (Put AI Agents to Work)
Cyntexa
 
AI x Accessibility UXPA by Stew Smith and Olivier Vroom
AI x Accessibility UXPA by Stew Smith and Olivier VroomAI x Accessibility UXPA by Stew Smith and Olivier Vroom
AI x Accessibility UXPA by Stew Smith and Olivier Vroom
UXPA Boston
 
fennec fox optimization algorithm for optimal solution
fennec fox optimization algorithm for optimal solutionfennec fox optimization algorithm for optimal solution
fennec fox optimization algorithm for optimal solution
shallal2
 
Optima Cyber - Maritime Cyber Security - MSSP Services - Manolis Sfakianakis ...
Optima Cyber - Maritime Cyber Security - MSSP Services - Manolis Sfakianakis ...Optima Cyber - Maritime Cyber Security - MSSP Services - Manolis Sfakianakis ...
Optima Cyber - Maritime Cyber Security - MSSP Services - Manolis Sfakianakis ...
Mike Mingos
 
Bepents tech services - a premier cybersecurity consulting firm
Bepents tech services - a premier cybersecurity consulting firmBepents tech services - a premier cybersecurity consulting firm
Bepents tech services - a premier cybersecurity consulting firm
Benard76
 
machines-for-woodworking-shops-en-compressed.pdf
machines-for-woodworking-shops-en-compressed.pdfmachines-for-woodworking-shops-en-compressed.pdf
machines-for-woodworking-shops-en-compressed.pdf
AmirStern2
 
Enterprise Integration Is Dead! Long Live AI-Driven Integration with Apache C...
Enterprise Integration Is Dead! Long Live AI-Driven Integration with Apache C...Enterprise Integration Is Dead! Long Live AI-Driven Integration with Apache C...
Enterprise Integration Is Dead! Long Live AI-Driven Integration with Apache C...
Markus Eisele
 
Design pattern talk by Kaya Weers - 2025 (v2)
Design pattern talk by Kaya Weers - 2025 (v2)Design pattern talk by Kaya Weers - 2025 (v2)
Design pattern talk by Kaya Weers - 2025 (v2)
Kaya Weers
 
How to Install & Activate ListGrabber - eGrabber
How to Install & Activate ListGrabber - eGrabberHow to Install & Activate ListGrabber - eGrabber
How to Install & Activate ListGrabber - eGrabber
eGrabber
 
Developing System Infrastructure Design Plan.pptx
Developing System Infrastructure Design Plan.pptxDeveloping System Infrastructure Design Plan.pptx
Developing System Infrastructure Design Plan.pptx
wondimagegndesta
 
UiPath Automation Suite – Cas d'usage d'une NGO internationale basée à Genève
UiPath Automation Suite – Cas d'usage d'une NGO internationale basée à GenèveUiPath Automation Suite – Cas d'usage d'une NGO internationale basée à Genève
UiPath Automation Suite – Cas d'usage d'une NGO internationale basée à Genève
UiPathCommunity
 
RTP Over QUIC: An Interesting Opportunity Or Wasted Time?
RTP Over QUIC: An Interesting Opportunity Or Wasted Time?RTP Over QUIC: An Interesting Opportunity Or Wasted Time?
RTP Over QUIC: An Interesting Opportunity Or Wasted Time?
Lorenzo Miniero
 
Integrating FME with Python: Tips, Demos, and Best Practices for Powerful Aut...
Integrating FME with Python: Tips, Demos, and Best Practices for Powerful Aut...Integrating FME with Python: Tips, Demos, and Best Practices for Powerful Aut...
Integrating FME with Python: Tips, Demos, and Best Practices for Powerful Aut...
Safe Software
 
AI Agents at Work: UiPath, Maestro & the Future of Documents
AI Agents at Work: UiPath, Maestro & the Future of DocumentsAI Agents at Work: UiPath, Maestro & the Future of Documents
AI Agents at Work: UiPath, Maestro & the Future of Documents
UiPathCommunity
 
Could Virtual Threads cast away the usage of Kotlin Coroutines - DevoxxUK2025
Could Virtual Threads cast away the usage of Kotlin Coroutines - DevoxxUK2025Could Virtual Threads cast away the usage of Kotlin Coroutines - DevoxxUK2025
Could Virtual Threads cast away the usage of Kotlin Coroutines - DevoxxUK2025
João Esperancinha
 
Viam product demo_ Deploying and scaling AI with hardware.pdf
Viam product demo_ Deploying and scaling AI with hardware.pdfViam product demo_ Deploying and scaling AI with hardware.pdf
Viam product demo_ Deploying and scaling AI with hardware.pdf
camilalamoratta
 
GDG Cloud Southlake #42: Suresh Mathew: Autonomous Resource Optimization: How...
GDG Cloud Southlake #42: Suresh Mathew: Autonomous Resource Optimization: How...GDG Cloud Southlake #42: Suresh Mathew: Autonomous Resource Optimization: How...
GDG Cloud Southlake #42: Suresh Mathew: Autonomous Resource Optimization: How...
James Anderson
 
Smart Investments Leveraging Agentic AI for Real Estate Success.pptx
Smart Investments Leveraging Agentic AI for Real Estate Success.pptxSmart Investments Leveraging Agentic AI for Real Estate Success.pptx
Smart Investments Leveraging Agentic AI for Real Estate Success.pptx
Seasia Infotech
 
Limecraft Webinar - 2025.3 release, featuring Content Delivery, Graphic Conte...
Limecraft Webinar - 2025.3 release, featuring Content Delivery, Graphic Conte...Limecraft Webinar - 2025.3 release, featuring Content Delivery, Graphic Conte...
Limecraft Webinar - 2025.3 release, featuring Content Delivery, Graphic Conte...
Maarten Verwaest
 
Everything You Need to Know About Agentforce? (Put AI Agents to Work)
Everything You Need to Know About Agentforce? (Put AI Agents to Work)Everything You Need to Know About Agentforce? (Put AI Agents to Work)
Everything You Need to Know About Agentforce? (Put AI Agents to Work)
Cyntexa
 

Introduction to High-Performance Computing

  • 2. 2 What is High Performance Computing? • There is no clear definition – Computing on high performance computers – Solving problems / doing research using computer modeling, simulation and analysis – Engineering design using computer modeling, simulation and analysis • My understanding – A huge number of computational and memory requirements – Cannot be afforded by a PC efficiently – Speeds and feeds are the keywords • Who uses High-Performance Computing – Research institutes, universities and government labs • Weather and climate research, bioscience, energy, military etc. – Engineering design: more or less every product we use • Automotive, aerospace, oil and gas explorations, digital media, financial simulation • Mechanical simulation, package designs, silicon manufacturing etc. • Similar concepts – Parallel computing: computing on parallel computers – Super computing: computing on world 500 fastest supercomputers
  • 3. 3 When Do We Need High Performance Computing? • Case1: Complete a time-consuming operation in less time – I am an automotive engineer – I need to design a new car that consumes less gasoline – I’d rather have the design completed in 6 months than in 2 years – I want to test my design using computer simulations rather than building very expensive prototypes and crashing them • Case 2: Complete an operation under a tight deadline – I work for a weather prediction agency – I am getting input from weather stations/sensors – I’d like to predict tomorrow’s forecast today • Case 3: Perform a high number of operations per seconds – I am an engineer at Amazon.com – My Web server gets 1,000 hits per seconds – I’d like my web server and databases to handle 1,000 transactions per seconds so that customers do not experience bad delays
  • 4. 4 What Does High Performance Computing Include? • High-performance computing is fast computing – Computations in parallel over lots of compute elements (CPU, GPU) – Very fast network to connect between the compute elements • Hardware – Computer Architecture • Vector Computers, MPP, SMP, Distributed Systems, Clusters – Network Connections • InfiniBand, Ethernet, Proprietary (Myrinet, Quadrics, Cray-SeaStar etc.) • Software – Programming models • MPI (Message Passing Interface), SHMEM (Shared Memory), PGAS, etc. – Applications • Open source, commercial
  • 5. 5 Rise and Fall of HPC Computer Architectures • Vector Computers (VC) - proprietary system – Provided the breakthrough needed for the emergence of computational science, but they were only a partial answer • Massively Parallel Processors (MPP) - proprietary systems – High cost and a low performance/price ratio. • Symmetric Multiprocessors (SMP) – Suffers from scalability • Distributed Systems – Difficult to use and hard to extract parallel performance • Clusters – commodity and highly popular – High Performance Computing - Commodity Supercomputing – High Availability Computing - Mission Critical Applications
  • 6. 6 Top500 Supercomputers List – System Architecture Clusters have become the most used HPC system architecture More than 80% of Top500 systems are clusters
  • 7. 7 Computer Food Chain: Causing the Demise of Specialized Systems Parallel Computing on a Large Number of Servers is More Efficient than using Specialized Systems
  • 8. 8 HPC Clusters – Affordable, Efficient and Scalable HPC Solution • Since the 1990s, there has been an increasing trend to move away from expensive /specialized proprietary parallel supercomputers to clusters of computers – From specialized supercomputers to cost effective, general purpose systems • So What’s So Different about Clusters? – Commodity, standard, affordable, cost effective, scalable and reliable architecture Server Communications Software Network Interface Hardware Server Communications Software Network Interface Hardware Server Communications Software Network Interface Hardware Server Communications Software Network Interface Hardware Cluster Interconnect Network Cluster Architecture
  • 9. 9 • Commoditization/standardization are the clustering and interconnect driving forces • InfiniBand and Ethernet are the most used interconnect solutions for HPC systems Cluster Interconnect
  • 10. 10 Interconnect Trends – Top100 Status (Nov 2010)
  • 11. 11 Product Development Process Preparation/Delivery Without Concept Development Prototype/ Physical Testing Manufacturing Design Final HPC Time to Market With HPC HPC-Supported Simulation Time Savings The HPC Advantage: Reduction in Time to Market Source: IDC
  • 12. 12 • From concept to engineering, from design to test and manufacturing, from weather prediction to medical discoveries, our day to day life depends more and more on HPC simulations – Safer products, accurate predictions, research, etc. • High-performance compute clusters provide the most efficient, flexible, cost effective HPC environment for any HPC simulation Summary
  翻译: