Senior Systems Administrator : Linux

We at Neysa believe that a good online experience is one where you don’t have to (necessarily) read the complete manual. A good online interface is intuitive, inviting and accommodating. Most importantly, good online experience should make life easy. Neysa was founded by people who believe in enabling a good online experience should which facilitates interactions, without getting in the way. So that you can get your job done quickly and efficiently. In today’s hyper-connected and online world, we are looking at a few good people who believe that there is a life outside of screens and are not afraid of saying that! Minimum Experience: 10 Years Education: B.Tech Role Specifics: A Day in Life: In this role you'll …• Work with a online, service provider grade, state of the art computing grid built to provide supercomputing levels of performance for high end jobs. • Ensure availability and uptime of all computing resource. • Work with developers other users and coach them to use their system to the fullest, without breaking it. • Keep an eye on workloads on the system, making sure that each gets access to the resources committed. Keep all workloads working, but fairly. • Interact with peers who have had decades of experience in various supporting infrastructure systems and work with them to maintain a high performing system at all times. • Work with vendors and OEMs, often guiding them to the requirements of your unique environment. Must Have Skills: On day one, you will need to be proficient with…• Linux Systems Management: o Manage, monitor, and maintain Linux servers, ensuring high availability and performance. o Perform routine system maintenance tasks, including kernel upgrades, system patching, and package management. o Conduct system audits and implement necessary security protocols. • Networking and Firewall Management: o Configure, manage, and troubleshoot network interfaces and services in a Linux environment. o Implement and manage firewalls using tools such as iptables, nftables, and firewalld. o Monitor and optimize network performance using tools like iftop, netstat, tcpdump, and Wireshark. o Troubleshoot network-related issues, ensuring minimal downtime and optimal network performance. • Security Management: o Implement and manage Linux security measures, including SELinux and AppArmor. o Conduct regular security assessments and apply necessary patches and updates. o Utilize security tools such as fail2ban, Tripwire, Lynis, etc. to monitor and enhance system security. o Develop and enforce security policies and procedures to safeguard critical data and resources. • Storage Management: o Manage and optimize storage solutions, including RAID configurations and logical volume management (LVM). o Monitor storage performance and troubleshoot related issues using tools such as iostat, iotop, df, du, and lsblk. o Ensure data integrity and availability through regular backups and recovery processes. • Virtualization and Kubernetes: o Design, deploy, and manage virtualized environments using technologies such as KVM, VMware, or Proxmox. o Manage and orchestrate containerized applications using Kubernetes and related tools like kubectl, Helm, and Prometheus. o Troubleshoot and optimize virtual machines and containers, ensuring efficient resource allocation and performance. o Implement and manage high-availability clusters, ensuring seamless failover and redundancy. • Kernel and Driver Management: o Compile, install, and configure custom Linux kernels as per organizational needs. o Manage and troubleshoot device drivers, ensuring compatibility with the system and hardware. o Utilize tools like dmesg, modprobe, lshw, lsmod, and insmod for kernel and driver management. • Troubleshooting and Performance Optimization: o Diagnose and resolve complex system issues, including hardware, software, and network conflicts. o Optimize system performance by tuning system parameters and managing resources efficiently. o Utilize performance monitoring tools such as top, htop, iotop, netstat, iftop, strace, and sar for system and network performance analysis. o Understand and address how one subsystem within the Linux environment can affect others, and recognize the impact of misconfigured systems on the broader network. • Automation and Scripting: o Develop and maintain shell scripts for automation of routine tasks, system monitoring, and reporting. o Implement and manage automation tools such as cron, systemd, and Ansible for configuration management and task automation. What separates us from the best Added bonuses if you have experience with... • Programming and Development Support: o Provide support in debugging and developing C programs that interact with system resources. o Contribute to the development and enhancement of system utilities written in C. o Utilize gdb, valgrind, and make for debugging and building C programs. • Benchmarking and systems performance acceptance criteria: o Be familiar with benchmarking tools that verify system performance as per expectations o Understanding the often complex interplay of various subsystems how they can affect each other. • Documentation and Compliance: o Create and maintain comprehensive documentation for system configurations, procedures, and troubleshooting guides. o Ensure compliance with organizational policies, industry standards, and best practices. And Lastly It would be amazing if you…• Work with users o All users are not created equal, and often they may lack (or may not be interested in) understanding of how their actions can affect system performance. Your attitude in dealing with (often frustrating, to you) would be critical in maintaining a good working order. What can you expect An environment where you can do your best work…. • The best equipment which complements your talents. • The best tools in the business for you to bring your ideas to life. • A great environment. • Flexible work hours, and flexible work locations. • The opportunity to make your mark and shape the future. • And have fun… The Technical Skill Tree Things you must know…

• Linux, in its various flavors viz. RedHat, Ubuntu, Rocky, Debian etc. The quirks and oddities of the various distributions and how they affect systems administration.
• Linux kernel internals like scheduling algorithms, disk management, PCIE subsystems, memory and swap space management. Kernel management, driver management, kernel compilation, ram disk management, boot time command lines, panic management.
• Tools, tools and more tools. From evaluating memory management to CPU spinlocks and deadlocks.
• Shell scripting, including advance techniques using awk, sed, tck/tk etc.
• Popular file systems, disk management, corruption recovery, network attached and direct
• Firewalling and networking, the way it is done in Linux systems.

• Enterprise GPU systems, their performance characteristics and profiling mechanisms.
• Cluster software like slurm and how they work, their dependencies and how totroubleshoot job scheduling.
• Job queue management, reprioritizing and de-prioritizing.
• Storage management internals viz. IOPs, disk performance, RAID, erasure coding, file systems.
• Supporting infrastructure software like web servers, load balancers, databases, and their internals.
• Good understanding of network concepts which include, but is not limited to network namespaces, bridge, ethernet bond/lacp, vlan and NAT

• Networking, storage, access management.
• Cloud computing, working with hyperscale providers, interconnects etc.
• Working with external systems like security, load balancing, monitoring.