Team Arth2020.1.17

Automation with Python

We have created menu drive program to automate daily task with integrating multiple technologies like docker, hadoop, lvm, and AWS-CLI on local VM.

Priyanka Hajare

--

In this article we created one menu driven program to automate the things.

Let’s take look on our automation world .

After selecting option no.1 we can move to the main menu of the program.

📌 We have automated the following technologies

  1. Docker
  2. LVM
  3. AWS
  4. Hadoop

MAIN MENU OF PROGRAM:

From here user can select required technology by entering choice.

🎇 Docker

Docker is a software platform for building applications based on containers — small and lightweight execution environments that make shared use of the operating system kernel but otherwise run in isolation from one another.

After selecting 1 user can move to docker services .

We have created a simple menu program which asks your to input then according we using docker command as below.

our program contains following menus in Docker services.

🎇LVM SERVICES.

You can think of LVM as “dynamic partitions”, meaning that you can create/resize/delete LVM “partitions” (they’re called “Logical Volumes” in LVM-speak) from the command line while your Linux system is running: no need to reboot the system to make the kernel aware of the newly-created or resized partitions.

We have added LVM services in this automation program because any non-technical person can also use this technology easily.

In this service we have added menus as we shown in following picture

🎇 AWS-CLI with python

The AWS Command Line Interface (CLI) is a unified tool to manage your AWS services. With this tool, we can almost do everything with the AWS cloud. We are using the AWS CLI power with python os module.

We have implemented the below functionality till now…

Stay tuned for updates.

  • Services
  1. EC2

→ Create/Delete Key Pair

→ create/Delete Security group

→EC2 instance start/stop/terminate”

→Show all instances

→ Create a new Instance

2. EBS

→ Create EBS volume

→ Attach EBS volume to EC2 instance

3. S3

→ Create Bucket

→ List buckets and objects

→ Create Object

→ Delete Bucket

→Delete Object

🎇Hadoop

The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models.

Menu’s /options available in the automation of hadoop are as follows:

  1. To install hadoop
  2. To configure namenode
  3. To configure Datanode
  4. To configure client
  5. To see hadoop report
  6. To see hadoop file list
  7. To read file from cluster
  8. Exit

Here we can see the functionality of some menu’s from hadoop services

e.g after selecting option no : 2

We have implemented these many functionalities till now…

Stay tuned for updates.

Thank you !😃

--

--