Standardizing headings and fixing typos
Kalyanasundaram Somasundaram
4 years ago
parent
de6c025271
commit
5c85391504
@ -1,35 +1,32 @@
|
||||
# School of SRE: Big Data
|
||||
# Big Data
|
||||
|
||||
## Pre - Reads
|
||||
## Prerequisites
|
||||
|
||||
- Basics of Linux File systems.
|
||||
- Basic understanding of System Design.
|
||||
|
||||
## Target Audience
|
||||
|
||||
The concept of Big Data has been around for years; most organizations now understand that if they capture all the data that streams into their businesses, they can apply analytics and get significant value from it.
|
||||
This training material covers the basics of Big Data(using Hadoop) for beginners, who would like to quickly get started and get their hands dirty in this domain.
|
||||
|
||||
## What to expect from this training
|
||||
## What to expect from this course
|
||||
|
||||
This course covers the basics of Big Data and how it has evolved to become what it is today. We will take a look at a few realistic scenarios where Big Data would be a perfect fit. An interesting assignment on designing a Big Data system is followed by understanding the architecture of Hadoop and the tooling around it.
|
||||
|
||||
## What is not covered under this training
|
||||
## What is not covered under this course
|
||||
|
||||
Writing programs to draw analytics from data.
|
||||
|
||||
## TOC:
|
||||
## Course Content
|
||||
|
||||
### Table of Contents
|
||||
|
||||
1. Overview of Big Data
|
||||
2. Usage of Big Data techniques
|
||||
3. Evolution of Hadoop
|
||||
4. Architecture of hadoop
|
||||
1. [Overview of Big Data](https://linkedin.github.io/school-of-sre/big_data/overview/)
|
||||
2. [Usage of Big Data techniques](https://linkedin.github.io/school-of-sre/big_data/overview/)
|
||||
3. [Evolution of Hadoop](https://linkedin.github.io/school-of-sre/big_data/evolution/)
|
||||
4. [Architecture of hadoop](https://linkedin.github.io/school-of-sre/big_data/architecture/)
|
||||
1. HDFS
|
||||
2. Yarn
|
||||
5. MapReduce framework
|
||||
6. Other tooling around hadoop
|
||||
5. [MapReduce framework](https://linkedin.github.io/school-of-sre/big_data/architecture/#mapreduce-framework)
|
||||
6. [Other tooling around hadoop](https://linkedin.github.io/school-of-sre/big_data/architecture/#other-tooling-around-hadoop)
|
||||
1. Hive
|
||||
2. Pig
|
||||
3. Spark
|
||||
4. Presto
|
||||
7. Data Serialisation and storage
|
||||
7. [Data Serialisation and storage](https://linkedin.github.io/school-of-sre/big_data/architecture/#data-serialisation-and-storage)
|
||||
|
||||
@ -1,19 +1,23 @@
|
||||
# School of SRE
|
||||
|
||||
Early 2019, we started visiting campuses to recruit the brightest minds to ensure LinkedIn and all the services that it is composed of is always available for everyone. This function at Linkedin falls in the purview of the Site Reliability Engineering team and Site Reliability Engineers ( SRE ) who are Software Engineers who specialize in reliability. SREs apply the principles of computer science and engineering to the design and development of computer systems: generally, large distributed ones. As we continued on this journey we started getting a lot of questions from these campuses on what exactly site engineering roll entails? and, how could someone learn the skills and the disciplines involved to become a successful site engineer? Fast forward a few months, and a few of these campus students had joined LinkedIn either as Interns or as full time engineers to become a part of the Site Engineering team, we also had a few lateral hires who joined our organization who were not from a traditional SRE background. That's when a few of us got together and started to think about how we can on board new new graduate engineers to the site engineering team.
|
||||
Early 2019, we started visiting campuses to recruit the brightest minds to ensure LinkedIn and all the services that it is composed of is always available for everyone. This function at Linkedin falls in the purview of the Site Reliability Engineering team and Site Reliability Engineers ( SRE ) who are Software Engineers who specialize in reliability. SREs apply the principles of computer science and engineering to the design and development of computer systems: generally, large distributed ones.
|
||||
|
||||
There is a vast amount of resources scattered throughout the web on what are the roles and responsibilities of an SREs, how to monitor site health, handling incidents, maintain SLO/SLI etc. But there are very few resources out there guiding someone on what all basic skill sets one has to acquire as a beginner. Because of the lack of these resources we felt that individuals are having a tough time getting into open positions in the industry. We created School Of SRE as a starting point for anyone wanting to build their career in the role of SRE. In this course we are focusing on building strong foundational skills. The course is structured in a way to provide more real life examples and how learning each of the topics can play a bigger role in your day to day SRE life. Currently we are covering the following topics under the School Of SRE:
|
||||
As we continued on this journey we started getting a lot of questions from these campuses on what exactly site engineering roll entails? and, how could someone learn the skills and the disciplines involved to become a successful site engineer? Fast forward a few months, and a few of these campus students had joined LinkedIn either as Interns or as full time engineers to become a part of the Site Engineering team, we also had a few lateral hires who joined our organization who were not from a traditional SRE background. That's when a few of us got together and started to think about how we can on board new new graduate engineers to the site engineering team.
|
||||
|
||||
There is a vast amount of resources scattered throughout the web on what are the roles and responsibilities of an SREs, how to monitor site health, handling incidents, maintain SLO/SLI etc. But there are very few resources out there guiding someone on what all basic skill sets one has to acquire as a beginner. Because of the lack of these resources we felt that individuals are having a tough time getting into open positions in the industry. We created School Of SRE as a starting point for anyone wanting to build their career in the role of SRE.
|
||||
|
||||
In this course we are focusing on building strong foundational skills. The course is structured in a way to provide more real life examples and how learning each of the topics can play a bigger role in your day to day SRE life. Currently we are covering the following topics under the School Of SRE:
|
||||
|
||||
- Linux basics
|
||||
- Git and python
|
||||
- Linux networking
|
||||
- Introduction to security concepts
|
||||
- [Git](https://linkedin.github.io/school-of-sre/git/git-basics/)
|
||||
- [Linux networking](https://linkedin.github.io/school-of-sre/linux_networking/intro/)
|
||||
- [Python](https://linkedin.github.io/school-of-sre/python_web/intro/)
|
||||
- Relational databases (MySQL)
|
||||
- NoSQL concepts
|
||||
- Introduction to BigData
|
||||
- Network/Web Security
|
||||
- System Design
|
||||
- NoSQL concepts
|
||||
- [Big Data](https://linkedin.github.io/school-of-sre/big_data/intro/)
|
||||
- [Systems Design](https://linkedin.github.io/school-of-sre/systems_design/intro/)
|
||||
- [Security](https://linkedin.github.io/school-of-sre/security/intro/)
|
||||
|
||||
We believe continuous learning will help in acquiring deeper knowledge and competencies in order to expand your skill sets, every module has added reference which could be a guide for further learning. Our hope is that by going through these modules we should be able build the essential skills required for a Site Reliability Engineer.
|
||||
|
||||
At linkedin we are using this curriculum for onboarding our non-traditional hires and new college grads to the SRE role. We had multiple rounds of successful onboarding experience with the new members and helped them to be productive in a very short period of time. This motivated us to opensource these contents for helping other organisations onboarding new engineers to the role and individuals to get into the role. We realise that the initial content we created is just a starting point and our hope is that the community can help in the journey refining and extending the contents.
|
||||
At Linkedin we are using this curriculum for onboarding our non-traditional hires and new college grads to the SRE role. We had multiple rounds of successful onboarding experience with the new members and helped them to be productive in a very short period of time. This motivated us to opensource these contents for helping other organisations onboarding new engineers to the role and individuals to get into the role. We realise that the initial content we created is just a starting point and our hope is that the community can help in the journey refining and extending the contents.
|
||||
|
||||
Loading…
Reference in New Issue