Published

July 7, 2012

Shell Outline


This will be a short brief intro of the Linux bash command as it relates to ETL. We’ll end up using other tools for pipeline creations that’s the reason we’ll skim over this part.

Setup

Linux Definition

Package Managers

Use GitBash instead

Install WSL

Install Ubuntu

Linux Basics

Administrative Commands

Hard Drive & Storage

Networking

User Management

System Resources

Environmental Variables

Kernel Information

Hardware Information

Command Basics

Pipe

tr

Metacharacters

Quoting

I/O Redirection

Command Substitution

Arguments

Conditionals

Logicals

Arithmetic Calculations

Arrays

Loops

File Permissions

File Ownership

chmod

Directory Permissions

File Manipulation

wget

curl

cut

grep

touch

cat

more

less

sort

uniq

paste

tail

wc

mv

cp

mkdir

ls

search locate

find

Summary

File Compression & Archiving

tar

zip

unzip

Executable Files & Scripts

variables

set = list all vars

env = list all env vars

export/extend vars

Make file executable

Examples

Schedule Tasks

crontab

more than once

@ - preset

cron

Add crontab

Edit crontab

Schedule crontab

Remove crontab

Parallel Tasks

Sequential Tasks

Linux Automation Techniques

Linux Scripting Cheat Sheet

Basics

Conditionals

Loops

User Input

Arithmetic Operators

Arithmetic Conditionals

Sting Comparison Operators

File Testing Operators

Boolean Operators

Informational

Text files, Networking & Archiving

Shell Scripting