1 of 11

Data Infrastructure Management

Samuel Kudrna, Jinun Kim, Ryan Baik, Alexander Kotelnikov, Mattias Dorey

2 of 11

Objectives

  • Gaining Linux skills
  • Manage our servers via remote connection
  • Create Linux diskless systems for installation and provisioning with Warewulf

3 of 11

4 of 11

Gaining Necessary Skills

  • Learned:
    • Basic Linux commands
    • Python/Shell scripting
    • Network File Systems (NFS)

    • How to troubleshoot
    • Node reinstallation
    • Start/stop services

    • Basic networking procedures

5 of 11

Definitions

  • SSH: Secure shell - The connection to the linux workspace
  • NFS: Network File System
  • DHCP: Dynamic Host Configuration Protocol
  • IPXE: Open source network-boot firmware
  • TFTP: A protocol that allows users to transfer to and from a remote machine

6 of 11

Warewulf Workflow

7 of 11

Warewulfd Commands

wwctl container (import, shell, list)

wwctl profile (set, list)

wwctl node (add, set, status, delete, list)

wwctl overlay build

8 of 11

Booting into Warewulf

9 of 11

Diskless Node File Systems

hostadm@node08:~$ df –h

Filesystem      Size Used Avail Use% Mounted on

rootfs   126G 773M 125G 1% /

devtmpfs      126G 0 126G 0% /dev

tmpfs   126G 1.8M 126G 1% /run

tmpfs    126G 0 126G 0% /dev/shm

tmpfs  5.0M 0 5.0M 0% /run/lock

tmpfs  126G   0   126G 0% /run/shm

/dev/sda1 440G 28K 417G 1% /scratch

192.168.5.127:/opt 49G 4.4G 43G 10% /opt

192.168.5.127:/home 49G 4.4G 43G 10% /home

NFS mounted

In memory on all linux systems

Root in memory

Local Disk

 

10 of 11

Conclusion

Learned:

    • Linux
    • Shell scripting
    • Python
    • Networking
    • And deployed the warewulf4 installer

11 of 11

Acknowledgements

  • Thank you:
    • Ivan Seskar, for managing the internship
    • Jenny Shane, for leading the groups
    • Ruddy Jacas, for presenting his work
    • Alexei Kotelnikov, for being our mentor
    • And the rest of the winlab team and interns, for making this such a fabulous experience