SlideShare a Scribd company logo
Introduction to Virtualization
Hwanju Kim
1
Outline
• Goals
• Understanding the benefits of virtualization in IT
industry and how to virtualize HW resources
• Schedule
• Introduction to virtualization
• OS vs. VMM
• CPU virtualization and scheduling
• Memory virtualization and management
• I/O virtualization
• Live VM migration
• Introduction to Systemtap
2/30
How to Learn Virtualization?
• Conference proceedings
• SOSP
• Symposium on Operating Systems Principles
• OSDI
• Symposium on Operating Systems Design and Implementation
• ASPLOS
• International Conference on Architectural Support for Programming
Languages and Operating Systems
• USENIX ATC
• USENIX Annual Technical Conference
• EUROSYS
• European Conference on Computer Systems
• VEE
• International Conference on Virtual Execution Environments
• SOCC
• ACM Symposium on Cloud Computing
• Open source software
• Xen, KVM, VirtualBox
3/30
What is Virtualization?
• Multiple OSes on a single machine
• Giving an illusion that each OS is running on real HW
• Virtual Machine Monitor (VMM)
• Another layer of kernel to virtualize multiple OSes
• Also called “hypervisor”
• An OS as a supervisor is no more HW-dictator!
Hardware
Virtual Machine Monitor
Windows
App App
App
Linux
App App
App
Mac
App App
4/30
History – Born and Died (1/4)
• 1960s-1970s
• High cost of computing machines
• IBM VM/370: A VMM for IBM mainframe
• 1980s-1990s
• But, lost attentions since PC era (1980s)
• Cheap HW  No need to share hardware
• CPU did not support virtualization well
• High engineering cost and overhead
Powerful &
expensive
hardware
5/30
History - Reborn (2/4)
• The late 1990s
• Regain attention for “server consolidation”
• Toward cost-effective large-scale computing
• Stanford’s research project: Disco
• They founded VMware in 1998
Disco: Running Commodity Operating Systems on Scalable Multiprocessors [SOSP’97]
6/30
History - Renaissance (3/4)
• 1998-2002
• VMware
• “Full-virtualization”
• Running unmodified OS
• Starting with SW-based binary translation
• Success in industry and academia
• VMware‘s state-of-the-art techniques in SOSP and OSDI
• 2003
• Xen
• University of Cambridge’s project: Open source!!!
• “Xen and Art of Virtualization” [SOSP’03]
• “Para-virtualization”
• Modified OS for near-native performance: Linux on x86
• 2003-
• Virtualization research renaissance based on Xen
• 2007: Acquired by Citrix
7/30
History - Ubiquitous (4/4)
• 2005-2006
• HW-assisted virtualization
• x86 virtualization
• Intel VT-x & AMD-V
• Running unmodified OS with near-native performance
• Default functionality now
• 2006-now
• Cloud computing
• Infrastructure-as-a-Service (IaaS)
• Virtual desktop infrastructure (VDI)
• Mobile virtualization
• ARM virtualization technology (Cortex-A15)
8/30
Why Virtualization? (1/6)
• Efficient resource utilization
• Low resource utilization of each server machine
• Low total cost of ownership (TCO)
• Low cost of infrastructure and energy
VM
VM
VM
VMM
CPU
CPU
CPU
CPU
The Case for Energy-Proportional Computing [IEEE Computer’07]
Average CPU utilization of 5000+ Google’s servers
Mostly 0-50% utilization
9/30
Why Virtualization? (2/6)
• Flexible VM relocation
• “Live VM migration”
• Flexible VM relocation with near-zero downtime
• Flexible load balancing
• Relieving resource bottleneck
VM
VM
VM
CPU
CPU
CPU
CPU
10/30
Why Virtualization? (3/6)
• Flexible VM relocation
• “Live VM migration”
• Flexible VM relocation with near-zero downtime
• High availability
VM
SW or HW maintenance
(upgrade or fix)
11/30
Why Virtualization? (4/6)
• Strong isolation
• Strong isolation between co-located VMs
• Fault containment or isolation
• Safe from bugs and malicious attacks
VMM
VM
Hardware
VM
Safe
OS OS
An empirical study of operating systems errors [SOSP’01]
Hardware
App
OS
App
VMM is much smaller than OS
 Low trusted computing base (TCB)
OSes, especially drivers, are error-prone
12/30
Why Virtualization? (5/6)
• Multiple OSes on a single device
• OS dependency of legacy SW
• Linux + Windows, Android + iOS
• Different requirements of SW
• Virtualization for embedded or mobile systems
• RTOS + GPOS
• Building secure systems
• Security-enhanced OS + GPOS
Allowing for GPOS and RTOS:
The unique virtualization
needs of mission-critical
embedded systems,
TenASysTerra: A Virtual Machine-Based Platform for Trusted Computing [SOSP’03]
Trusted VMM
13/30
Why Virtualization? (6/6)
• Other benefits
• Strong security monitoring
• Security monitoring outside OSes
• Ease of deployment
• Virtual appliance
• A bundle of OS and applications
• Flexible testing and debugging
• Building distributed environments on a single machine
• Kernel development and debugging
• VM-based recording and replaying
14/30
Use Cases
• Cloud computing
• Virtual desktop infrastructure
• Mobile virtualization
15/30
Virtualization & Cloud Computing
• Virtualized data centers
Virtualization 1.x: Near term
Virtualization 2.0: Emerging
Virtualization 3.0: Future Virtualization 3.0
The fully virtualized datacenter
for cloud services
2013+
Virtualization 1.x
Virtualization 2.0
2009
출처: IDC 2010 report
16/30
Virtualization & Cloud Computing
• VM-based resource pool for various demands
• Infrastructure-as-a-Service (IaaS)
17/30
Virtualization & Cloud Computing
• Many providers use commercial & open-source
VMMs
Virtualization Solutions Cloud Providers
18/30
Virtual Desktop Infrastructure (VDI)
• Desktop provisioning
Dedicated workstations
VM VM
VM
VM
VM
- Energy wastage by idle desktops
- Resource underutilization
- High management cost
- High maintenance cost
- Low level of security
+ Energy savings by consolidation
+ High resource utilization
+ Low management cost
(flexible HW/SW provisioning)
+ Low maintenance cost
(dynamic HW/SW upgrade)
+ High level of security
(centralized data containment)
VM-based shared environments
19/30
Virtual Desktop Infrastructure (VDI)
• VDI is also hot in Korea
20/30
Virtual Desktop Infrastructure (VDI)
• VMware VDI
• Pioneer of VDI
21/30
Mobile Virtualization
• Trends of consumer electronics
• Digital convergence
• What do consumer electronics(CE) devices want to achieve?
Reliability
Trustworthiness for primary functions
Extensibility
Flexibility for adding features as needed
Business
Phone
Personal
Phone
22/30
Mobile Virtualization
• BYOD: Bring Your Own Device
• Consolidating business and personal
computing environments on a single device
Business
VM
Personal
VM
Hypervisor
Managed
domain
23/30
Mobile Virtualization
• Academia
• Columbia university’s projects
• Cells [SOSP’11]
• KVM for ARM [OLS’10]
• Cortex-A8, A9
• Now running on A15
Cells: A Virtual Mobile Smartphone Architecture [SOSP’11]
Linaro Ubuntu 11.04 for ARM
running in VM by KVM/ARM
(Cortex-A15 in Fast Model 6.1)
OS-level virtualization
24/30
Mobile Virtualization
• Embracing all apps in a unified market
• iOS + Android + Windows
• Technically possible, but not yet by industry
• Currently, not much attractive.
• Multiple Androids
• Android + RTOS
• Issues
• Performance, performance, performance…
• Graphics acceleration  Challenging
• CPU, memory limitation
• High-end smartphones can resolve this limitation
25/30
Basic Terminologies
• Types of VMMs
• Type-1 vs. Type-2
• Virtualization methods
• Full-virtualization vs. Para-virtualization
26/30
Type-1 vs. Type-2
• Depending on what sits right on HW
Guest VM
Guest OS
Host OS
VMM
HW
Guest VM
Guest OS
VMM
Guest VM
Guest OS
HW
Guest VM
Guest OS
Type-1: VMM on HW Type-2: Host OS on HW
• Xen, VMware ESX server, Hyper-V
• Mostly for server, but not limited
• VMM by default
• OS-independent VMM
• KVM, VMware Workstation, VirtualBox
• Mostly for client devices, but not limited
• VMM on demand
• OS-dependent VMM
27/30
Xen: Type-1 VMM
• Type-1 VMM
• Para-virtualization and full-virtualization
• Domain0
• Privileged VM for guest VM (domainU) management
• Handling I/O operations requested from domainUs
• Including native device drivers to directly access HW
DomainU
(Guest VM)
Guest OS
Xen VMM
DomainU
Guest VM
Guest OS
Domain0
(Privileged VM)
Linux
28/30
KVM: Type-2 VMM
• Type-2 VMM for Linux as a host OS
• Based on HW-assisted virtualization
• Linux kernel mainline (2.6.20~)
Guest VM
Guest OS
Host OS
(Linux)
KVM VMM (kernel module)
QEMU
vCPU vCPU
User space
Kernel space
Linux Process
Linux Thread Linux Thread
Linux
Thread
I/O
emulation
29/30
Full- vs. Para-virtualization
• Depending on whether OS source is modified
• Full-virtualization = No OS source modification
• SW-based full virtualization
• Emulation
• HW-based full virtualization
• HW-assisted virtualization
• Para-virtualization = OS source modification
• Virtualization-aware OS
• Bridging semantic gap between VMM and OS
• Mostly for performance
Today’s virtualization solutions adopt both approaches
for optimized performance
30/30
Ad

More Related Content

What's hot (20)

What is Virtualization
What is VirtualizationWhat is Virtualization
What is Virtualization
Dhrupesh Kotadiya
 
Lecture5 virtualization
Lecture5 virtualizationLecture5 virtualization
Lecture5 virtualization
hktripathy
 
What is Virtualization
What is VirtualizationWhat is Virtualization
What is Virtualization
Israel Marcus
 
Virtualization
VirtualizationVirtualization
Virtualization
Kumar Harsha
 
Virtualization
VirtualizationVirtualization
Virtualization
Kingston Smiler
 
Virtual machine
Virtual machineVirtual machine
Virtual machine
Rinaldo John
 
An Introduction To Server Virtualisation
An Introduction To Server VirtualisationAn Introduction To Server Virtualisation
An Introduction To Server Virtualisation
Alan McSweeney
 
VMware vSphere technical presentation
VMware vSphere technical presentationVMware vSphere technical presentation
VMware vSphere technical presentation
aleyeldean
 
Introduction to virtualization
Introduction to virtualizationIntroduction to virtualization
Introduction to virtualization
Ahmad Hafeezi
 
Virtualization VMWare technology
Virtualization VMWare technologyVirtualization VMWare technology
Virtualization VMWare technology
sanjoysanyal
 
Virtualization Technology Overview
Virtualization Technology OverviewVirtualization Technology Overview
Virtualization Technology Overview
OpenCity Community
 
virtualization and hypervisors
virtualization and hypervisorsvirtualization and hypervisors
virtualization and hypervisors
Gaurav Suri
 
Virtualization basics
Virtualization basics Virtualization basics
Virtualization basics
Chandrani Ray Chowdhury
 
Virtualization and its Types
Virtualization and its TypesVirtualization and its Types
Virtualization and its Types
HTS Hosting
 
Virtualization with KVM (Kernel-based Virtual Machine)
Virtualization with KVM (Kernel-based Virtual Machine)Virtualization with KVM (Kernel-based Virtual Machine)
Virtualization with KVM (Kernel-based Virtual Machine)
Novell
 
Vmware overview
Vmware overviewVmware overview
Vmware overview
Syed Zeeshan
 
Virtualization in cloud
Virtualization in cloudVirtualization in cloud
Virtualization in cloud
Ashok Kumar
 
VMware Tutorial For Beginners | VMware Workstation | VMware Virtualization | ...
VMware Tutorial For Beginners | VMware Workstation | VMware Virtualization | ...VMware Tutorial For Beginners | VMware Workstation | VMware Virtualization | ...
VMware Tutorial For Beginners | VMware Workstation | VMware Virtualization | ...
Edureka!
 
Introduction to Virtualization
Introduction to VirtualizationIntroduction to Virtualization
Introduction to Virtualization
elliando dias
 
VMware Presentation
VMware PresentationVMware Presentation
VMware Presentation
Emirates Computers
 
Lecture5 virtualization
Lecture5 virtualizationLecture5 virtualization
Lecture5 virtualization
hktripathy
 
What is Virtualization
What is VirtualizationWhat is Virtualization
What is Virtualization
Israel Marcus
 
An Introduction To Server Virtualisation
An Introduction To Server VirtualisationAn Introduction To Server Virtualisation
An Introduction To Server Virtualisation
Alan McSweeney
 
VMware vSphere technical presentation
VMware vSphere technical presentationVMware vSphere technical presentation
VMware vSphere technical presentation
aleyeldean
 
Introduction to virtualization
Introduction to virtualizationIntroduction to virtualization
Introduction to virtualization
Ahmad Hafeezi
 
Virtualization VMWare technology
Virtualization VMWare technologyVirtualization VMWare technology
Virtualization VMWare technology
sanjoysanyal
 
Virtualization Technology Overview
Virtualization Technology OverviewVirtualization Technology Overview
Virtualization Technology Overview
OpenCity Community
 
virtualization and hypervisors
virtualization and hypervisorsvirtualization and hypervisors
virtualization and hypervisors
Gaurav Suri
 
Virtualization and its Types
Virtualization and its TypesVirtualization and its Types
Virtualization and its Types
HTS Hosting
 
Virtualization with KVM (Kernel-based Virtual Machine)
Virtualization with KVM (Kernel-based Virtual Machine)Virtualization with KVM (Kernel-based Virtual Machine)
Virtualization with KVM (Kernel-based Virtual Machine)
Novell
 
Virtualization in cloud
Virtualization in cloudVirtualization in cloud
Virtualization in cloud
Ashok Kumar
 
VMware Tutorial For Beginners | VMware Workstation | VMware Virtualization | ...
VMware Tutorial For Beginners | VMware Workstation | VMware Virtualization | ...VMware Tutorial For Beginners | VMware Workstation | VMware Virtualization | ...
VMware Tutorial For Beginners | VMware Workstation | VMware Virtualization | ...
Edureka!
 
Introduction to Virtualization
Introduction to VirtualizationIntroduction to Virtualization
Introduction to Virtualization
elliando dias
 

Viewers also liked (6)

Network virtualization
Network virtualizationNetwork virtualization
Network virtualization
Damian Parniewicz
 
Evaluation of Virtual Clusters Performance on a Cloud Computing Infrastructure
Evaluation of Virtual Clusters Performance on a Cloud Computing InfrastructureEvaluation of Virtual Clusters Performance on a Cloud Computing Infrastructure
Evaluation of Virtual Clusters Performance on a Cloud Computing Infrastructure
EuroCloud
 
An Implementation of Virtual Cluster on a Cloud
An Implementation of Virtual Cluster on a CloudAn Implementation of Virtual Cluster on a Cloud
An Implementation of Virtual Cluster on a Cloud
Pongsakorn U-chupala
 
Cs6703 grid and cloud computing unit 3
Cs6703 grid and cloud computing unit 3Cs6703 grid and cloud computing unit 3
Cs6703 grid and cloud computing unit 3
RMK ENGINEERING COLLEGE, CHENNAI
 
Cloud computing using virtualization (Virtual Data Center)
Cloud computing using virtualization (Virtual Data Center)Cloud computing using virtualization (Virtual Data Center)
Cloud computing using virtualization (Virtual Data Center)
Sonu Mamman
 
Virtualization and cloud Computing
Virtualization and cloud ComputingVirtualization and cloud Computing
Virtualization and cloud Computing
Rishikese MR
 
Evaluation of Virtual Clusters Performance on a Cloud Computing Infrastructure
Evaluation of Virtual Clusters Performance on a Cloud Computing InfrastructureEvaluation of Virtual Clusters Performance on a Cloud Computing Infrastructure
Evaluation of Virtual Clusters Performance on a Cloud Computing Infrastructure
EuroCloud
 
An Implementation of Virtual Cluster on a Cloud
An Implementation of Virtual Cluster on a CloudAn Implementation of Virtual Cluster on a Cloud
An Implementation of Virtual Cluster on a Cloud
Pongsakorn U-chupala
 
Cloud computing using virtualization (Virtual Data Center)
Cloud computing using virtualization (Virtual Data Center)Cloud computing using virtualization (Virtual Data Center)
Cloud computing using virtualization (Virtual Data Center)
Sonu Mamman
 
Virtualization and cloud Computing
Virtualization and cloud ComputingVirtualization and cloud Computing
Virtualization and cloud Computing
Rishikese MR
 
Ad

Similar to 1.Introduction to virtualization (20)

Virtualizacao de Servidores - Windows
Virtualizacao de Servidores - WindowsVirtualizacao de Servidores - Windows
Virtualizacao de Servidores - Windows
Sergio Maia
 
Client Side Hypervisors - Victoria Russell
Client Side Hypervisors - Victoria RussellClient Side Hypervisors - Victoria Russell
Client Side Hypervisors - Victoria Russell
russvd1
 
101 Virtualization and Private Cloud
101 Virtualization and Private Cloud101 Virtualization and Private Cloud
101 Virtualization and Private Cloud
Fazle Abbas Luqmani
 
Server virtualization
Server virtualizationServer virtualization
Server virtualization
ofsorganizer
 
Virtualization, the cloud enabler
Virtualization, the cloud enablerVirtualization, the cloud enabler
Virtualization, the cloud enabler
Praveen Hanchinal
 
KIIT_Cloud_scaling and Virtualization.pptx
KIIT_Cloud_scaling and Virtualization.pptxKIIT_Cloud_scaling and Virtualization.pptx
KIIT_Cloud_scaling and Virtualization.pptx
bhaskarkumar0125
 
Cloud Computing vs Virtualization From Desktop to Server
Cloud Computing vs Virtualization From Desktop to ServerCloud Computing vs Virtualization From Desktop to Server
Cloud Computing vs Virtualization From Desktop to Server
Fadly Rizal Ahmad Fadzil
 
VIRTUALIZATION-IMPLEMENTATION.pptx-TYPES
VIRTUALIZATION-IMPLEMENTATION.pptx-TYPESVIRTUALIZATION-IMPLEMENTATION.pptx-TYPES
VIRTUALIZATION-IMPLEMENTATION.pptx-TYPES
soundharya59
 
Esx short presentation
Esx short presentationEsx short presentation
Esx short presentation
xKinAnx
 
Virtualization
VirtualizationVirtualization
Virtualization
Avni Bindal
 
Virtual machine
Virtual machineVirtual machine
Virtual machine
Shivanshu Purwar
 
CC-5 - MOD.pptx Cloud Vertulization nand
CC-5 - MOD.pptx Cloud Vertulization nandCC-5 - MOD.pptx Cloud Vertulization nand
CC-5 - MOD.pptx Cloud Vertulization nand
AdeelAsghar36
 
VIRTUALIZATION
VIRTUALIZATIONVIRTUALIZATION
VIRTUALIZATION
Junaid Shaikh
 
Virtualization-the Cloud Enabler by INSPIRE-groups
Virtualization-the Cloud Enabler by INSPIRE-groupsVirtualization-the Cloud Enabler by INSPIRE-groups
Virtualization-the Cloud Enabler by INSPIRE-groups
Praveen Hanchinal
 
Cloud Computing Virtualization and containers
Cloud Computing Virtualization and containersCloud Computing Virtualization and containers
Cloud Computing Virtualization and containers
Selvaraj Kesavan
 
What's new in System Center 2012 R2: Virtual Machine Manager
What's new in System Center 2012 R2: Virtual Machine ManagerWhat's new in System Center 2012 R2: Virtual Machine Manager
What's new in System Center 2012 R2: Virtual Machine Manager
Tomica Kaniski
 
Cloud-computing.ppt
Cloud-computing.pptCloud-computing.ppt
Cloud-computing.ppt
Ajit Mali
 
Server Virtualization
Server VirtualizationServer Virtualization
Server Virtualization
webhostingguy
 
Operating system Virtualization_NEW.pptx
Operating system Virtualization_NEW.pptxOperating system Virtualization_NEW.pptx
Operating system Virtualization_NEW.pptx
Senthil Vit
 
Overview of System Virtualization
Overview of System VirtualizationOverview of System Virtualization
Overview of System Virtualization
Andre Odendaal
 
Virtualizacao de Servidores - Windows
Virtualizacao de Servidores - WindowsVirtualizacao de Servidores - Windows
Virtualizacao de Servidores - Windows
Sergio Maia
 
Client Side Hypervisors - Victoria Russell
Client Side Hypervisors - Victoria RussellClient Side Hypervisors - Victoria Russell
Client Side Hypervisors - Victoria Russell
russvd1
 
101 Virtualization and Private Cloud
101 Virtualization and Private Cloud101 Virtualization and Private Cloud
101 Virtualization and Private Cloud
Fazle Abbas Luqmani
 
Server virtualization
Server virtualizationServer virtualization
Server virtualization
ofsorganizer
 
Virtualization, the cloud enabler
Virtualization, the cloud enablerVirtualization, the cloud enabler
Virtualization, the cloud enabler
Praveen Hanchinal
 
KIIT_Cloud_scaling and Virtualization.pptx
KIIT_Cloud_scaling and Virtualization.pptxKIIT_Cloud_scaling and Virtualization.pptx
KIIT_Cloud_scaling and Virtualization.pptx
bhaskarkumar0125
 
Cloud Computing vs Virtualization From Desktop to Server
Cloud Computing vs Virtualization From Desktop to ServerCloud Computing vs Virtualization From Desktop to Server
Cloud Computing vs Virtualization From Desktop to Server
Fadly Rizal Ahmad Fadzil
 
VIRTUALIZATION-IMPLEMENTATION.pptx-TYPES
VIRTUALIZATION-IMPLEMENTATION.pptx-TYPESVIRTUALIZATION-IMPLEMENTATION.pptx-TYPES
VIRTUALIZATION-IMPLEMENTATION.pptx-TYPES
soundharya59
 
Esx short presentation
Esx short presentationEsx short presentation
Esx short presentation
xKinAnx
 
CC-5 - MOD.pptx Cloud Vertulization nand
CC-5 - MOD.pptx Cloud Vertulization nandCC-5 - MOD.pptx Cloud Vertulization nand
CC-5 - MOD.pptx Cloud Vertulization nand
AdeelAsghar36
 
Virtualization-the Cloud Enabler by INSPIRE-groups
Virtualization-the Cloud Enabler by INSPIRE-groupsVirtualization-the Cloud Enabler by INSPIRE-groups
Virtualization-the Cloud Enabler by INSPIRE-groups
Praveen Hanchinal
 
Cloud Computing Virtualization and containers
Cloud Computing Virtualization and containersCloud Computing Virtualization and containers
Cloud Computing Virtualization and containers
Selvaraj Kesavan
 
What's new in System Center 2012 R2: Virtual Machine Manager
What's new in System Center 2012 R2: Virtual Machine ManagerWhat's new in System Center 2012 R2: Virtual Machine Manager
What's new in System Center 2012 R2: Virtual Machine Manager
Tomica Kaniski
 
Cloud-computing.ppt
Cloud-computing.pptCloud-computing.ppt
Cloud-computing.ppt
Ajit Mali
 
Server Virtualization
Server VirtualizationServer Virtualization
Server Virtualization
webhostingguy
 
Operating system Virtualization_NEW.pptx
Operating system Virtualization_NEW.pptxOperating system Virtualization_NEW.pptx
Operating system Virtualization_NEW.pptx
Senthil Vit
 
Overview of System Virtualization
Overview of System VirtualizationOverview of System Virtualization
Overview of System Virtualization
Andre Odendaal
 
Ad

More from Hwanju Kim (9)

CPU Scheduling for Virtual Desktop Infrastructure
CPU Scheduling for Virtual Desktop InfrastructureCPU Scheduling for Virtual Desktop Infrastructure
CPU Scheduling for Virtual Desktop Infrastructure
Hwanju Kim
 
6. Live VM migration
6. Live VM migration6. Live VM migration
6. Live VM migration
Hwanju Kim
 
5. IO virtualization
5. IO virtualization5. IO virtualization
5. IO virtualization
Hwanju Kim
 
4. Memory virtualization and management
4. Memory virtualization and management4. Memory virtualization and management
4. Memory virtualization and management
Hwanju Kim
 
3. CPU virtualization and scheduling
3. CPU virtualization and scheduling3. CPU virtualization and scheduling
3. CPU virtualization and scheduling
Hwanju Kim
 
2. OS vs. VMM
2. OS vs. VMM2. OS vs. VMM
2. OS vs. VMM
Hwanju Kim
 
Demand-Based Coordinated Scheduling for SMP VMs
Demand-Based Coordinated Scheduling for SMP VMsDemand-Based Coordinated Scheduling for SMP VMs
Demand-Based Coordinated Scheduling for SMP VMs
Hwanju Kim
 
Scheduler Support for Video-oriented Multimedia on Client-side Virtualization
Scheduler Support for Video-oriented Multimedia on Client-side VirtualizationScheduler Support for Video-oriented Multimedia on Client-side Virtualization
Scheduler Support for Video-oriented Multimedia on Client-side Virtualization
Hwanju Kim
 
Task-aware Virtual Machine Scheduling for I/O Performance
Task-aware Virtual Machine Scheduling for I/O PerformanceTask-aware Virtual Machine Scheduling for I/O Performance
Task-aware Virtual Machine Scheduling for I/O Performance
Hwanju Kim
 
CPU Scheduling for Virtual Desktop Infrastructure
CPU Scheduling for Virtual Desktop InfrastructureCPU Scheduling for Virtual Desktop Infrastructure
CPU Scheduling for Virtual Desktop Infrastructure
Hwanju Kim
 
6. Live VM migration
6. Live VM migration6. Live VM migration
6. Live VM migration
Hwanju Kim
 
5. IO virtualization
5. IO virtualization5. IO virtualization
5. IO virtualization
Hwanju Kim
 
4. Memory virtualization and management
4. Memory virtualization and management4. Memory virtualization and management
4. Memory virtualization and management
Hwanju Kim
 
3. CPU virtualization and scheduling
3. CPU virtualization and scheduling3. CPU virtualization and scheduling
3. CPU virtualization and scheduling
Hwanju Kim
 
Demand-Based Coordinated Scheduling for SMP VMs
Demand-Based Coordinated Scheduling for SMP VMsDemand-Based Coordinated Scheduling for SMP VMs
Demand-Based Coordinated Scheduling for SMP VMs
Hwanju Kim
 
Scheduler Support for Video-oriented Multimedia on Client-side Virtualization
Scheduler Support for Video-oriented Multimedia on Client-side VirtualizationScheduler Support for Video-oriented Multimedia on Client-side Virtualization
Scheduler Support for Video-oriented Multimedia on Client-side Virtualization
Hwanju Kim
 
Task-aware Virtual Machine Scheduling for I/O Performance
Task-aware Virtual Machine Scheduling for I/O PerformanceTask-aware Virtual Machine Scheduling for I/O Performance
Task-aware Virtual Machine Scheduling for I/O Performance
Hwanju Kim
 

Recently uploaded (20)

Design Optimization of Reinforced Concrete Waffle Slab Using Genetic Algorithm
Design Optimization of Reinforced Concrete Waffle Slab Using Genetic AlgorithmDesign Optimization of Reinforced Concrete Waffle Slab Using Genetic Algorithm
Design Optimization of Reinforced Concrete Waffle Slab Using Genetic Algorithm
Journal of Soft Computing in Civil Engineering
 
David Boutry - Specializes In AWS, Microservices And Python
David Boutry - Specializes In AWS, Microservices And PythonDavid Boutry - Specializes In AWS, Microservices And Python
David Boutry - Specializes In AWS, Microservices And Python
David Boutry
 
[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...
[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...
[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...
Jimmy Lai
 
Using the Artificial Neural Network to Predict the Axial Strength and Strain ...
Using the Artificial Neural Network to Predict the Axial Strength and Strain ...Using the Artificial Neural Network to Predict the Axial Strength and Strain ...
Using the Artificial Neural Network to Predict the Axial Strength and Strain ...
Journal of Soft Computing in Civil Engineering
 
IPC-7711D-7721D_ EN 2023 TOC Rework, Modification and Repair of Electronic As...
IPC-7711D-7721D_ EN 2023 TOC Rework, Modification and Repair of Electronic As...IPC-7711D-7721D_ EN 2023 TOC Rework, Modification and Repair of Electronic As...
IPC-7711D-7721D_ EN 2023 TOC Rework, Modification and Repair of Electronic As...
ssuserd9338b
 
UNIT 3 Software Engineering (BCS601) EIOV.pdf
UNIT 3 Software Engineering (BCS601) EIOV.pdfUNIT 3 Software Engineering (BCS601) EIOV.pdf
UNIT 3 Software Engineering (BCS601) EIOV.pdf
sikarwaramit089
 
22PCOAM16 ML Unit 3 Full notes PDF & QB.pdf
22PCOAM16 ML Unit 3 Full notes PDF & QB.pdf22PCOAM16 ML Unit 3 Full notes PDF & QB.pdf
22PCOAM16 ML Unit 3 Full notes PDF & QB.pdf
Guru Nanak Technical Institutions
 
GROUP 2 - MANUFACTURE OF LIME, GYPSUM AND CEMENT.pdf
GROUP 2 - MANUFACTURE OF LIME, GYPSUM AND CEMENT.pdfGROUP 2 - MANUFACTURE OF LIME, GYPSUM AND CEMENT.pdf
GROUP 2 - MANUFACTURE OF LIME, GYPSUM AND CEMENT.pdf
kemimafe11
 
DeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFT
DeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFTDeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFT
DeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFT
Kyohei Ito
 
Lecture - 7 Canals of the topic of the civil engineering
Lecture - 7  Canals of the topic of the civil engineeringLecture - 7  Canals of the topic of the civil engineering
Lecture - 7 Canals of the topic of the civil engineering
MJawadkhan1
 
Unleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptx
Unleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptxUnleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptx
Unleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptx
SanjeetMishra29
 
Deepfake Phishing: A New Frontier in Cyber Threats
Deepfake Phishing: A New Frontier in Cyber ThreatsDeepfake Phishing: A New Frontier in Cyber Threats
Deepfake Phishing: A New Frontier in Cyber Threats
RaviKumar256934
 
vtc2018fall_otfs_tutorial_presentation_1.pdf
vtc2018fall_otfs_tutorial_presentation_1.pdfvtc2018fall_otfs_tutorial_presentation_1.pdf
vtc2018fall_otfs_tutorial_presentation_1.pdf
RaghavaGD1
 
IBAAS 2023 Series_Lecture 8- Dr. Nandi.pdf
IBAAS 2023 Series_Lecture 8- Dr. Nandi.pdfIBAAS 2023 Series_Lecture 8- Dr. Nandi.pdf
IBAAS 2023 Series_Lecture 8- Dr. Nandi.pdf
VigneshPalaniappanM
 
698642933-DdocfordownloadEEP-FAKE-PPT.pptx
698642933-DdocfordownloadEEP-FAKE-PPT.pptx698642933-DdocfordownloadEEP-FAKE-PPT.pptx
698642933-DdocfordownloadEEP-FAKE-PPT.pptx
speedcomcyber25
 
Understand water laser communication using Arduino laser and solar panel
Understand water laser communication using Arduino laser and solar panelUnderstand water laser communication using Arduino laser and solar panel
Understand water laser communication using Arduino laser and solar panel
NaveenBotsa
 
Smart City is the Future EN - 2024 Thailand Modify V1.0.pdf
Smart City is the Future EN - 2024 Thailand Modify V1.0.pdfSmart City is the Future EN - 2024 Thailand Modify V1.0.pdf
Smart City is the Future EN - 2024 Thailand Modify V1.0.pdf
PawachMetharattanara
 
Modeling the Influence of Environmental Factors on Concrete Evaporation Rate
Modeling the Influence of Environmental Factors on Concrete Evaporation RateModeling the Influence of Environmental Factors on Concrete Evaporation Rate
Modeling the Influence of Environmental Factors on Concrete Evaporation Rate
Journal of Soft Computing in Civil Engineering
 
Personal Protective Efsgfgsffquipment.ppt
Personal Protective Efsgfgsffquipment.pptPersonal Protective Efsgfgsffquipment.ppt
Personal Protective Efsgfgsffquipment.ppt
ganjangbegu579
 
Slide share PPT of SOx control technologies.pptx
Slide share PPT of SOx control technologies.pptxSlide share PPT of SOx control technologies.pptx
Slide share PPT of SOx control technologies.pptx
vvsasane
 
David Boutry - Specializes In AWS, Microservices And Python
David Boutry - Specializes In AWS, Microservices And PythonDavid Boutry - Specializes In AWS, Microservices And Python
David Boutry - Specializes In AWS, Microservices And Python
David Boutry
 
[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...
[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...
[PyCon US 2025] Scaling the Mountain_ A Framework for Tackling Large-Scale Te...
Jimmy Lai
 
IPC-7711D-7721D_ EN 2023 TOC Rework, Modification and Repair of Electronic As...
IPC-7711D-7721D_ EN 2023 TOC Rework, Modification and Repair of Electronic As...IPC-7711D-7721D_ EN 2023 TOC Rework, Modification and Repair of Electronic As...
IPC-7711D-7721D_ EN 2023 TOC Rework, Modification and Repair of Electronic As...
ssuserd9338b
 
UNIT 3 Software Engineering (BCS601) EIOV.pdf
UNIT 3 Software Engineering (BCS601) EIOV.pdfUNIT 3 Software Engineering (BCS601) EIOV.pdf
UNIT 3 Software Engineering (BCS601) EIOV.pdf
sikarwaramit089
 
GROUP 2 - MANUFACTURE OF LIME, GYPSUM AND CEMENT.pdf
GROUP 2 - MANUFACTURE OF LIME, GYPSUM AND CEMENT.pdfGROUP 2 - MANUFACTURE OF LIME, GYPSUM AND CEMENT.pdf
GROUP 2 - MANUFACTURE OF LIME, GYPSUM AND CEMENT.pdf
kemimafe11
 
DeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFT
DeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFTDeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFT
DeFAIMint | 🤖Mint to DeFAI. Vibe Trading as NFT
Kyohei Ito
 
Lecture - 7 Canals of the topic of the civil engineering
Lecture - 7  Canals of the topic of the civil engineeringLecture - 7  Canals of the topic of the civil engineering
Lecture - 7 Canals of the topic of the civil engineering
MJawadkhan1
 
Unleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptx
Unleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptxUnleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptx
Unleashing the Power of Salesforce Flows &amp_ Slack Integration!.pptx
SanjeetMishra29
 
Deepfake Phishing: A New Frontier in Cyber Threats
Deepfake Phishing: A New Frontier in Cyber ThreatsDeepfake Phishing: A New Frontier in Cyber Threats
Deepfake Phishing: A New Frontier in Cyber Threats
RaviKumar256934
 
vtc2018fall_otfs_tutorial_presentation_1.pdf
vtc2018fall_otfs_tutorial_presentation_1.pdfvtc2018fall_otfs_tutorial_presentation_1.pdf
vtc2018fall_otfs_tutorial_presentation_1.pdf
RaghavaGD1
 
IBAAS 2023 Series_Lecture 8- Dr. Nandi.pdf
IBAAS 2023 Series_Lecture 8- Dr. Nandi.pdfIBAAS 2023 Series_Lecture 8- Dr. Nandi.pdf
IBAAS 2023 Series_Lecture 8- Dr. Nandi.pdf
VigneshPalaniappanM
 
698642933-DdocfordownloadEEP-FAKE-PPT.pptx
698642933-DdocfordownloadEEP-FAKE-PPT.pptx698642933-DdocfordownloadEEP-FAKE-PPT.pptx
698642933-DdocfordownloadEEP-FAKE-PPT.pptx
speedcomcyber25
 
Understand water laser communication using Arduino laser and solar panel
Understand water laser communication using Arduino laser and solar panelUnderstand water laser communication using Arduino laser and solar panel
Understand water laser communication using Arduino laser and solar panel
NaveenBotsa
 
Smart City is the Future EN - 2024 Thailand Modify V1.0.pdf
Smart City is the Future EN - 2024 Thailand Modify V1.0.pdfSmart City is the Future EN - 2024 Thailand Modify V1.0.pdf
Smart City is the Future EN - 2024 Thailand Modify V1.0.pdf
PawachMetharattanara
 
Personal Protective Efsgfgsffquipment.ppt
Personal Protective Efsgfgsffquipment.pptPersonal Protective Efsgfgsffquipment.ppt
Personal Protective Efsgfgsffquipment.ppt
ganjangbegu579
 
Slide share PPT of SOx control technologies.pptx
Slide share PPT of SOx control technologies.pptxSlide share PPT of SOx control technologies.pptx
Slide share PPT of SOx control technologies.pptx
vvsasane
 

1.Introduction to virtualization

  • 2. Outline • Goals • Understanding the benefits of virtualization in IT industry and how to virtualize HW resources • Schedule • Introduction to virtualization • OS vs. VMM • CPU virtualization and scheduling • Memory virtualization and management • I/O virtualization • Live VM migration • Introduction to Systemtap 2/30
  • 3. How to Learn Virtualization? • Conference proceedings • SOSP • Symposium on Operating Systems Principles • OSDI • Symposium on Operating Systems Design and Implementation • ASPLOS • International Conference on Architectural Support for Programming Languages and Operating Systems • USENIX ATC • USENIX Annual Technical Conference • EUROSYS • European Conference on Computer Systems • VEE • International Conference on Virtual Execution Environments • SOCC • ACM Symposium on Cloud Computing • Open source software • Xen, KVM, VirtualBox 3/30
  • 4. What is Virtualization? • Multiple OSes on a single machine • Giving an illusion that each OS is running on real HW • Virtual Machine Monitor (VMM) • Another layer of kernel to virtualize multiple OSes • Also called “hypervisor” • An OS as a supervisor is no more HW-dictator! Hardware Virtual Machine Monitor Windows App App App Linux App App App Mac App App 4/30
  • 5. History – Born and Died (1/4) • 1960s-1970s • High cost of computing machines • IBM VM/370: A VMM for IBM mainframe • 1980s-1990s • But, lost attentions since PC era (1980s) • Cheap HW  No need to share hardware • CPU did not support virtualization well • High engineering cost and overhead Powerful & expensive hardware 5/30
  • 6. History - Reborn (2/4) • The late 1990s • Regain attention for “server consolidation” • Toward cost-effective large-scale computing • Stanford’s research project: Disco • They founded VMware in 1998 Disco: Running Commodity Operating Systems on Scalable Multiprocessors [SOSP’97] 6/30
  • 7. History - Renaissance (3/4) • 1998-2002 • VMware • “Full-virtualization” • Running unmodified OS • Starting with SW-based binary translation • Success in industry and academia • VMware‘s state-of-the-art techniques in SOSP and OSDI • 2003 • Xen • University of Cambridge’s project: Open source!!! • “Xen and Art of Virtualization” [SOSP’03] • “Para-virtualization” • Modified OS for near-native performance: Linux on x86 • 2003- • Virtualization research renaissance based on Xen • 2007: Acquired by Citrix 7/30
  • 8. History - Ubiquitous (4/4) • 2005-2006 • HW-assisted virtualization • x86 virtualization • Intel VT-x & AMD-V • Running unmodified OS with near-native performance • Default functionality now • 2006-now • Cloud computing • Infrastructure-as-a-Service (IaaS) • Virtual desktop infrastructure (VDI) • Mobile virtualization • ARM virtualization technology (Cortex-A15) 8/30
  • 9. Why Virtualization? (1/6) • Efficient resource utilization • Low resource utilization of each server machine • Low total cost of ownership (TCO) • Low cost of infrastructure and energy VM VM VM VMM CPU CPU CPU CPU The Case for Energy-Proportional Computing [IEEE Computer’07] Average CPU utilization of 5000+ Google’s servers Mostly 0-50% utilization 9/30
  • 10. Why Virtualization? (2/6) • Flexible VM relocation • “Live VM migration” • Flexible VM relocation with near-zero downtime • Flexible load balancing • Relieving resource bottleneck VM VM VM CPU CPU CPU CPU 10/30
  • 11. Why Virtualization? (3/6) • Flexible VM relocation • “Live VM migration” • Flexible VM relocation with near-zero downtime • High availability VM SW or HW maintenance (upgrade or fix) 11/30
  • 12. Why Virtualization? (4/6) • Strong isolation • Strong isolation between co-located VMs • Fault containment or isolation • Safe from bugs and malicious attacks VMM VM Hardware VM Safe OS OS An empirical study of operating systems errors [SOSP’01] Hardware App OS App VMM is much smaller than OS  Low trusted computing base (TCB) OSes, especially drivers, are error-prone 12/30
  • 13. Why Virtualization? (5/6) • Multiple OSes on a single device • OS dependency of legacy SW • Linux + Windows, Android + iOS • Different requirements of SW • Virtualization for embedded or mobile systems • RTOS + GPOS • Building secure systems • Security-enhanced OS + GPOS Allowing for GPOS and RTOS: The unique virtualization needs of mission-critical embedded systems, TenASysTerra: A Virtual Machine-Based Platform for Trusted Computing [SOSP’03] Trusted VMM 13/30
  • 14. Why Virtualization? (6/6) • Other benefits • Strong security monitoring • Security monitoring outside OSes • Ease of deployment • Virtual appliance • A bundle of OS and applications • Flexible testing and debugging • Building distributed environments on a single machine • Kernel development and debugging • VM-based recording and replaying 14/30
  • 15. Use Cases • Cloud computing • Virtual desktop infrastructure • Mobile virtualization 15/30
  • 16. Virtualization & Cloud Computing • Virtualized data centers Virtualization 1.x: Near term Virtualization 2.0: Emerging Virtualization 3.0: Future Virtualization 3.0 The fully virtualized datacenter for cloud services 2013+ Virtualization 1.x Virtualization 2.0 2009 출처: IDC 2010 report 16/30
  • 17. Virtualization & Cloud Computing • VM-based resource pool for various demands • Infrastructure-as-a-Service (IaaS) 17/30
  • 18. Virtualization & Cloud Computing • Many providers use commercial & open-source VMMs Virtualization Solutions Cloud Providers 18/30
  • 19. Virtual Desktop Infrastructure (VDI) • Desktop provisioning Dedicated workstations VM VM VM VM VM - Energy wastage by idle desktops - Resource underutilization - High management cost - High maintenance cost - Low level of security + Energy savings by consolidation + High resource utilization + Low management cost (flexible HW/SW provisioning) + Low maintenance cost (dynamic HW/SW upgrade) + High level of security (centralized data containment) VM-based shared environments 19/30
  • 20. Virtual Desktop Infrastructure (VDI) • VDI is also hot in Korea 20/30
  • 21. Virtual Desktop Infrastructure (VDI) • VMware VDI • Pioneer of VDI 21/30
  • 22. Mobile Virtualization • Trends of consumer electronics • Digital convergence • What do consumer electronics(CE) devices want to achieve? Reliability Trustworthiness for primary functions Extensibility Flexibility for adding features as needed Business Phone Personal Phone 22/30
  • 23. Mobile Virtualization • BYOD: Bring Your Own Device • Consolidating business and personal computing environments on a single device Business VM Personal VM Hypervisor Managed domain 23/30
  • 24. Mobile Virtualization • Academia • Columbia university’s projects • Cells [SOSP’11] • KVM for ARM [OLS’10] • Cortex-A8, A9 • Now running on A15 Cells: A Virtual Mobile Smartphone Architecture [SOSP’11] Linaro Ubuntu 11.04 for ARM running in VM by KVM/ARM (Cortex-A15 in Fast Model 6.1) OS-level virtualization 24/30
  • 25. Mobile Virtualization • Embracing all apps in a unified market • iOS + Android + Windows • Technically possible, but not yet by industry • Currently, not much attractive. • Multiple Androids • Android + RTOS • Issues • Performance, performance, performance… • Graphics acceleration  Challenging • CPU, memory limitation • High-end smartphones can resolve this limitation 25/30
  • 26. Basic Terminologies • Types of VMMs • Type-1 vs. Type-2 • Virtualization methods • Full-virtualization vs. Para-virtualization 26/30
  • 27. Type-1 vs. Type-2 • Depending on what sits right on HW Guest VM Guest OS Host OS VMM HW Guest VM Guest OS VMM Guest VM Guest OS HW Guest VM Guest OS Type-1: VMM on HW Type-2: Host OS on HW • Xen, VMware ESX server, Hyper-V • Mostly for server, but not limited • VMM by default • OS-independent VMM • KVM, VMware Workstation, VirtualBox • Mostly for client devices, but not limited • VMM on demand • OS-dependent VMM 27/30
  • 28. Xen: Type-1 VMM • Type-1 VMM • Para-virtualization and full-virtualization • Domain0 • Privileged VM for guest VM (domainU) management • Handling I/O operations requested from domainUs • Including native device drivers to directly access HW DomainU (Guest VM) Guest OS Xen VMM DomainU Guest VM Guest OS Domain0 (Privileged VM) Linux 28/30
  • 29. KVM: Type-2 VMM • Type-2 VMM for Linux as a host OS • Based on HW-assisted virtualization • Linux kernel mainline (2.6.20~) Guest VM Guest OS Host OS (Linux) KVM VMM (kernel module) QEMU vCPU vCPU User space Kernel space Linux Process Linux Thread Linux Thread Linux Thread I/O emulation 29/30
  • 30. Full- vs. Para-virtualization • Depending on whether OS source is modified • Full-virtualization = No OS source modification • SW-based full virtualization • Emulation • HW-based full virtualization • HW-assisted virtualization • Para-virtualization = OS source modification • Virtualization-aware OS • Bridging semantic gap between VMM and OS • Mostly for performance Today’s virtualization solutions adopt both approaches for optimized performance 30/30
  翻译: