Hadoop , AWS Cloud, Redhat Command Automation using Python Code

Why Automation is needed ?

The term automation refers to the execution of the task with automated tools reducing human intervention. Through automation, complex and repeatative tasks are simplified with the help of software or programmed commands which improves efficiency, productivity and cuts down operational costs.

The advanced technology has become an integral part of our environment which makes human life easier and smarter. Adopting automation for your business process offers scalable benefits for your organisation. Here are the major key benefits of automating your business:

Cost efficiency :

Automation is a strategic investment for businesses which help to lower the operational costs, resources maintenance costs and paperwork etc. Integrating advanced technology is an easy way to reduce unnecessary expenditures and cost optimisation.

Time-saving :

Automating your business processes will simplify the day-to-day tasks saving massive time and efforts. It improves the turnaround time by faster processing of the complex tasks. Companies can get the processes done within seconds with the automated tools which help them to concentrate on other important business process.

Enhanced workflow :

Optimisation of cost and time improves workflow efficiencies. It streamlines the business process and helps employees to focus their attention on core business activities and generating revenue.

Operational accuracy :

Process automation with software’s, automated tools and robots improves the operational efficiency ensuring accurate results. Eliminates manual works and digitizes the data which operates accurately within the defined timeline.

Improved productivity :

Productivity is a major factor for every business. Automation can be the key to improve business productivity. The system improves the performance and speed of the employees in doing tasks which contributes to improved productivity.

The applications of automation are huge and much demanded across the industries. It is the best possible technology to streamline your business and achieve maximum business growth. Some of the industries where automation tools and software are being widely used are manufacturing, healthcare, educational institutions, customer support, transportation, sales and marketing and much more. Whatever may be the size or complexity of your business, introducing automation to your business can be a winning strategy that can uplift your business.

I have done the following things as follows ::

Redhat :

• Run any Linux Command Locally & Remotely
• Configure WebServer on Local OS , Remote OS and AWS Cloud
• Created LVM Partition
• Contribute Limited Storage to Hadoop Cluster
• Attach More hard-disks to Virtual group dynamically
• Increase Partition Size Dynamically

Hadoop

• Configure and start Namenode on Local OS and AWS Cloud
• Configure and start Datanode on Local OS and AWS Cloud

AWS Cloud

• Created & Deleted Key Pair
• Created & Deleted Security Group
• Adding Ingress rules to existing Security group
• Launch Instance
• Created EBS volume
• Attached EBS volume to Ec2 Instance
• Configured WebServer
• Created static partition and mount /var/www/html folder on EBS volume
• Created S3 bucket accessible to public
• Inserted the object inside s3 bucket which is accessible by everyone
• Created Cloudfront distribution providing S3 as origin
• Delete object inside S3 bucket
• Deleted S3 bucket
• Stop , Start and terminate Ec2 Instance

Print date command : -

Print any Redhat Command ::

code ->

Configure Web Server on Local OS :-

code - >

Configured Name-Node & Data Node on AWS Cloud ( Set-up Hadoop Cluster on Cloud using python )

Configuring Name-node on Cloud :

Configuring Data-node on cloud :

Creation of LVM Partition:

code ->

AWS Cloud

Creation of Key Pair :

Deletion of Key Pair :-

key-pair is successfully deleted .

Launch instances on cloud :

Create EBS volume : ->

When we create EBS Volume , here it is Available . so we have to attach this EBS Volume to Ec2 Instance .

Attach volume: - >

Start instances :

Stop instances :

There are so many function in my program menu. we have choosed some option to show you how our program menu is working .

Thank you.

Keep Learning