1 of 39

1

CE443 : CLOUD COMPUTING

CH-1 CLUSTER COMPUTING, GRID COMPUTING SYSTEMS AND RESOURCE MANAGEMENT AT GLANCE

2 of 39

Trends in computing

Parallel computing (subset of distributed computing)
Distributed computing
Cluster computing
Grid computing
Utility computing
Cloud computing

2

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

3 of 39

�Distributed Computing

3

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

4 of 39

�Computers in a Distributed System

4

Server machines: computers which provide resources and services
Workstations: Computers used by end-users to perform computing
Personal Assistance/Mobile Devices: handheld computers connected to the system via a wireless communication link.

Examples of Distributed System:

•Network of workstations (NoW), Internet, Intranet

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

5 of 39

�Centralized vs. Distributed Computing

5

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

6 of 39

6

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

7 of 39

7

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

8 of 39

�Why distributed computing?

Economics

Distributed systems allow the pooling of resources, including CPU cycles, data storage, input/output devices, and services.

Reliability

A distributed system allow replication of resources and/or services, thus reducing service outage due to failures

The Internet has become a universal platform for distributed computing

8

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

9 of 39

�The Weaknesses and Strengths of Distributed Computing

Some of the reasons for the popularity of distributed computing

The affordability of computers and availability of network access
Resource sharing
Scalability
Fault Tolerance

9

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

10 of 39

The disadvantages of distributed computing:

•Multiple Points of Failures: the failure of one or more participating computers, or one or more network links, can spell trouble.

•Security Concerns: In a distributed system, there are more opportunities for unauthorized attack.

10

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

11 of 39

�Building Distributed Applications was Difficult?

Need to support
Transaction
Resource-pooling
Security
Threading
Persistence
Life-cycle etc….

Developers had to become specialists

Proprietary APIs resulted in non-portable code

11

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

12 of 39

�High-Performance Computing

A list of industries in which HPC systems are deployed can be found at www.top500.org

12

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

13 of 39

�Cluster Computing

It consists of cluster of PCs, workstations, dedicated to running high-performance computing tasks.

It is type of computing in which a group of computers are linked together so that they can act as Single Entity.

Network of workstations (e.g. SUN)

Beowulf clusters: (COTS pcs. With SAN)

13

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

14 of 39

14

1000 nodes Beowulf Cluster System
Used for genetic algorithm research by John Coza, Stanford University

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

15 of 39

Dedicated/non-dedicated, homogeneous/non-homogeneous, packed/geographically distributed???

Maybe we can extend this concept to geographically distributed resources…

15

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

16 of 39

�Peer-to-Peer Computing

Growth of user-friendly file-sharing networks, such as Napster, Kazaa or Gnutella: protocol

BitTorrent (Read http://www.bittorrent.org/bittorrentecon.pdf)

Skype (www.skype.com)

16

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

17 of 39

Internet Computing

The explosion of the Internet and increasing power of the home computer prompted computer scientists and engineers to apply techniques learned in HPC and cluster-based distributed computing to utilize the vast processing cycles available at users‘ desktops.

Internet Computing Projects

SETI@Home (Search for Extraterrestrial Intelligence) – Public Domain
Analytical Spectroscopy Research Group
eOn (https://eon.org/#/)
Distributed Particle Accelerator Design

17

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

18 of 39

Internet Computing Projects

Life Sciences

•Folderoi

•Folding@Home

•Genom e@Home

•FightAIDS@Home

•Ubero

•Drug Design Optimization Lab

•The Virtual Laboratory Project

•Distributed Folding, Community TSC

•Find-a-Drug

Cryptography

•Distributed, net

•ECCp-109

18

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

19 of 39

Internet Computing Projects

Mathematics

Great Internet Mersenne Prime Search
Proth Prime Search
ECMNET
n!+1 and n!-1 Prime Search
Minimal Equal Sums of Like Powers
GRISK
MM61 Project
3x +1 Problem

19

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

20 of 39

Pi(x) Project
Distributed Search for Format Number Divisors
PCP@Home
Generalized Woodal! Numbers
Generalized Fermat Prime Search
ZetaGrid, Strong Pseudoprime Search
Wilson Prime Search
Largest Proth Prime Search

20

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

21 of 39

Grid Computing

Grid computing tries to bring, under one definitional umbrella all the work being done in the high performance, cluster, peer-to-peer and Internet computing arenas

The grid links numerous computers together to share computing workloads, thus improving the efficiency of large-scale problem analysis.

21

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

22 of 39

Another definition by Dr. Rajkumar Buyya: ―Grid is a type of parallel and distributed system that enables the sharing, selection, and aggregation of geographically distributed "autonomous" resources dynamically at runtime depending on their availability, capability, performance, cost, and users' quality-of-service requirements.‖

22

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

23 of 39

A typical view of Grid environment

23

User

Resource Broker

Grid Resources

Grid Information Service

Computation result

Grid application

Computational jobs

Details of Grid resources

Processed jobs

1

2

3

4

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

24 of 39

It is type of computing in which a group of computers are linked together so that they can act as Single Entity.
It is a collection of computer resources from multiple locations to reach a common goal.

24

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

25 of 39

Grid Computing enables virtual organizations

www.globus.org

The Globus Project is a joint effort on the part of researchers and developers from around the world that are focused on the concept of grid computing.

It is organized around four main activities: Research , Software Tools Testbeds , Applications

www.ggf.org (the Global Grid Forum)

Heavy involvement of Academic Groups and Industry

(e.g. IBM Grid Computing, HP, United Devices, Oracle, UK e-Science Programme, US DOE, US NSF, Indiana University, and many others)

25

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

26 of 39

Some of the Major Grid Projects

26

Name	URL/Sponsor	Focus
EuroGrid, Grid Interoperability (GRIP)	eurogrid.org European Union	Create tech for remote access to super comp resources & simulation codes; in GRIP, integrate with Globus Toolkit™
Fusion Collaboratory	fusiongrid.org DOE Off. Science	Create a national computational collaboratory for fusion research
Globus Project™	globus.org DARPA, DOE, NSF, NASA, Msoft	Research on Grid technologies; development and support of Globus Toolkit™; application and deployment
GridLab	gridlab.org European Union	Grid technologies and applications
GridPP	gridpp.ac.uk U.K. eScience	Create & apply an operational grid within the U.K. for particle physics research
Grid Research Integration Dev. & Support Center	grids-center.org NSF	Integration, deployment, support of the NSF Middleware Infrastructure for research & education

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

27 of 39

The goal of grid computing is to explore fast solutions for large-scale computing problems. This objective is shared by computer clusters and massively parallel processor (MPP) systems

27

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

28 of 39

28

The layered grid service protocols and their relationship with the Internet service protocols

Languages/Frameworks

Collective Service Protocols

Resource Service Protocols

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

29 of 39

Grid Architecture

29

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

30 of 39

30

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

31 of 39

31

Grid Family	Reference
Computational Grids or Data Grids	TeraGrid (US), DataGrid (EU), ChinaGrid NAS (NASA), GriPhyN
Information Grids or Knowledge Grids	Semantic Grid, BOINC (Berkerly)
Business Grids or P2P/Volunteer Grids	SETI@Home, HP eSpeak, LHC@Home

http://www.gridcomputing.com/

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

32 of 39

32

1 BOINC credit= 1 Cobblestone�= 1/100 day of CPU time @ 1 GFLOPs/second�= 864 GFLOPs (billion instructions)

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

33 of 39

33

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

34 of 39

34

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

35 of 39

LHC@Home is a volunteer computing platform where you donate idle time on your computer to help physicists compare theory with experiment, in the search for new fundamental particles and answers to questions about the Univ

The Large Hadron Collider (LHC) is the world’s largest and most powerful particle accelerator.

Refer: https://lhcathome.web.cern.ch/

http://www.gridrepublic.org/

35

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

36 of 39

Grid Topologies

36

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

37 of 39

Intra grid�

37

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

38 of 39

Extra grid�

38

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT

39 of 39

Inter grid

39

Chandubhai S. Patel Institute of Technology (CSPIT), CHARUSAT