1 of 6

Data Infrastructure�Management

Samuel, Jinun, Alex, Mattias, Ryan

2 of 6

This Week's Progress: Shell Scripting

Covered operations, if/else, loops, and functions

Worked with

awk: searches files for specific lines

grep: grabs/filters for specified inputs in a file

sed: manipulates lines within files

3 of 6

This Week's Progress: Installing Jupyter on the server containers

Created and activated the MiniConda3 environment

Installed Jupyter Notebook

Ran Jupiter Notebook in server mode through port 8888

Accessed Jupyter Notebook in the browser

4 of 6

This Week's Progress: Python in Linux and Jupyter

  • Ran through many of the basic python commands covering:
    • Data types
    • Operators
    • Collections
    • Loops
    • Conditionals
    • Functions

5 of 6

This Week's Progress: Python in Linux and Jupyter

  • Also ran through many topics relating to the server, including:
    • Reading/writing files
    • sys - Used to find system-specific parameters/functions
    • os - interacts with the operating system interface
    • shutil -  used for file operations
    • subprocess - spawns processes and allows you to connect to their input, output, and error pipes
    • pysftp - file commands via SFTP
    • re - run regular expressions

6 of 6

Plans for next week

START WORKING ON THE WAREWULF PROJECT(INVOLVES A BUNCH OF SERVICES).

SYSTEM PROVISIONING

PRESENTATION ON WEDNESDAY FOR EVERYTHING WE COVERED SO FAR

Thank You! Any questions?