Automating SPARK-YARN-HADOOP-HDFS Cluster Deployment using Ansible

Summary

This repository contains a part of my Computer Science BSc Degree's Final Graduation Project. In this project I wanted to implement a Cloud Computing platform with simple already-implmemented services for data storage and processing. This part coincide with the automation of the deployment process of a cluster formed by " SPAR-YARN-HADOOP-HDFS " using Ansible.

Collaborators

This project was devloped by me " Rshad Zhran " under the supervision of my tutors, D. José Manuel Benitez Sanchez and D. Manuel J. Parra Royón.

Contact Details

• Rshad Zhran: [email protected]
• José Manuel Benitez: [email protected]
• Manuel J. Parra Royón: [email protected]

Table of Contents

1. Introduction
2. Cluster Architecture and Components
3. Components Distribution
4. Ansible Scripting
5. Furhter Studies
6. References

1. Introduction

First of all, in order to start implementing a Cloud Computing Platfrom we need an Architecture Orchestrator, in this case I use OpenStack.