Senior/Principal, Systems Analyst, HPC Development - Remote

Sandia National Laboratories is the nation's premier science and engineering lab for national security and technology innovation, with teams of specialists focused on cutting-edge work in a broad array of areas. Some of the main reasons we love our jobs:

• Challenging work with amazing impact that contributes to security, peace, and freedom worldwide
• Extraordinary co-workers
• Some of the best tools, equipment, and research facilities in the world
• Career advancement and enrichment opportunities
• Flexible work arrangements for many positions include 9/80 (work 80 hours every two weeks, with every other Friday off) and 4/10 (work 4 ten-hour days each week) compressed workweeks, part-time work, and telecommuting (a mix of onsite work and working from home)
• Generous vacation, strong medical and other benefits, competitive 401k, learning opportunities, relocation assistance and amenities aimed at creating a solid work/life balance*

World-changing technologies. Life-changing careers. Learn more about Sandia at: http://www.sandia.gov

*These benefits vary by job classification.

As a System Analyst (R&D Computer Science) specializing in High-Performance Computing within a Linux environment, you will play a critical role in developing data analysis techniques and interfaces to monitoring data. You will work closely with researchers and engineers to understand complex heterogeneous application runtime behaviors, and engineer approaches to extracting useful insights to improve application throughput and efficiencies on various testbed and production systems. Your expertise will help drive performance improvements and support complex computational tasks.

This is a unique opportunity to partner with researchers and vendors to explore and influence technical directions and drive transformation in how scientific and national security applications utilize computing in the coming decade and beyond.

Key Responsibilities:

• Conduct analyses of systems monitoring data, using tools like Grafana, and Jupyter Notebooks for capturing analyses.
• Communicate with stakeholders (Principal Investigators, Code Developers, Analysts, Systems Administrators) to improve the user experience of our data interfaces.
• Administer and design data collection, transformation, and disposition of HPC monitoring and application data in a Linux environment.
• Collaborate with cross-functional teams to understand computational needs and provide tailored solutions.
• Monitor system performance, troubleshoot issues, and implement solutions to maintain system reliability.
• Develop and maintain documentation for system configurations, processes, and procedures.
• Assist in the deployment and configuration of software applications in HPC, virtual, and AI enhanced environments.
• Provide technical support and training to users on HPC resources and best practices.
• Stay current with advancements in HPC technologies and recommend improvements.

* The selected applicant can be a remote worker located in any U.S. State or District of Columbia. Regular or periodic travel to your assigned work location may be required.

$117,500 - $235,700

*Salary range is estimated, and actual salary will be determined after consideration of the selected candidate's experience and qualifications, and application of any approved geographic salary differential.

• A Bachelor's degree in a relevant discipline and five (5) years of directly relevant experience, or an equivalent combination of directly relevant education and engineering or scientific experience that demonstrates the knowledge, skills, and ability to perform independent research and development.
• Ability to obtain and maintain a DOE Q Clearance.

The ideal R&D S&E Computer Science candidate for Sandia National Laboratories will in addition possess the following:

• Graduate degree in Computer Science or a highly related field where an independent research project was a graduation requirement (e.g., independent project, thesis, or dissertation).
• Demonstrated software development skills and familiarity with modern software development practices and tools (e.g., Agile).
• Strong verbal and written communication skills, ability to work effectively in multidisciplinary teams, and a passion to improve and expand technical skills.

Also, for this posting we are seeking individuals with the following experience:

• Proven experience as a Systems Analyst or similar role in an HPC environment.
• Proficient in Python data science modules, Linux operating systems and command-line tools.
• Experience with HPC architectures, job scheduling systems (e.g., SLURM, PBS, Flux), and parallel computing.
• Working knowledge of database technologies and performance profiling and benchmarking tools.
• Familiarity with programming/scripting languages such as Python, Bash, or C/C++.
• Experience with data visualization tools (e.g., Grafana).
• Experience with containerization technologies (e.g., Docker, Singularity) and continuous deployment/continuous integration workflows.
• Familiarity with cloud computing platforms and services, familiarity with generative AI, predictive modeling, and AIOps.
• Excellent problem-solving skills and the ability to work independently and collaboratively.
• Strong communication skills, with the ability to convey technical concepts to non-technical stakeholders.

The HPC Development Department (9328) partners with different scientific and computing disciplines at Sandia, and externally, to advance high performance computing (HPC) and operations. The Observation, Orchestration, & Optimization Team supplies the HPC and Cloud monitoring capability for Sandia National Laboratory to ensure actionability to performance or system anomalies, uses derived knowledge to inform workload management decisions and find opportunities to improve throughput and efficiencies, and innovate the future of HPC and Cloud Computing. The team supports production monitoring infrastructure and tools and implements innovative solutions to support cutting-edge computing technologies.

This posting will be open for application submissions for a minimum of seven (7) calendar days, including the 'posting date'. Sandia reserves the right to extend the posting date at any time.

Sandia is required by DOE to conduct a pre-employment drug test and background review that includes checks of personal references, credit, law enforcement records, and employment/education verifications. Applicants for employment need to be able to obtain and maintain a DOE Q-level security clearance, which requires U.S. citizenship. If you hold more than one citizenship (i.e., of the U.S. and another country), your ability to obtain a security clearance may be impacted.

Applicants offered employment with Sandia are subject to a federal background investigation to meet the requirements for access to classified information or matter if the duties of the position require a DOE security clearance. Substance abuse or illegal drug use, falsification of information, criminal activity, serious misconduct or other indicators of untrustworthiness can cause a clearance to be denied or terminated by DOE, resulting in the inability to perform the duties assigned and subsequent termination of employment.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or veteran status and any other protected class under state or federal law.

If you have a Medical Portable Electronic Device (MedPED), such as a pacemaker, defibrillator, drug-releasing pump, hearing aids, or diagnostic equipment and other equipment for measuring, monitoring, and recording body functions such as heartbeat and brain waves, if employed by Sandia National Laboratories you may be required to comply with NNSA security requirements for MedPEDs.

If you have a MedPED and you are selected for an on-site interview at Sandia National Laboratories, there may be additional steps necessary to ensure compliance with NNSA security requirements prior to the interview date.

This Limited Term Employee (LTE) position is a temporary position for one year term, which may be renewed at Sandia's discretion up to a maximum of seven years.

Individuals in LTE positions may bid on regular Sandia positions as internal candidates, and in some cases may be converted to regular career positions during their term if warranted by ongoing operational needs, continuing availability of funds, and satisfactory job performance.