Senior Splunk Administrator

Valiant Solutions is seeking a Senior Splunk Engineer  to join our rapidly growing and innovative cybersecurity team!

The Splunk Engineer will design, implement, and maintain secure, reliable data ingestion pipelines and integrations across Splunk environments, supporting logs, metrics, events, and other cybersecurity data sources. This role is responsible for Splunk administration, infrastructure performance, data integrity, system upgrades, custom Technical Add-Ons, alerting, and troubleshooting across on-premises and cloud-based environments. The Engineer will collaborate closely with SOC and cross-functional teams to optimize cybersecurity tools, support access controls, resolve technical issues, and improve operational processes and documentation. The ideal candidate brings strong Splunk engineering and SPL expertise, Linux experience, and the ability to manage high-volume data pipelines while ensuring performance, security, and compliance.

Named one of the Best Places to Work in the Washington DC area for 12 consecutive years, Valiant is proud of our employee-centric culture and commitment to excellence. If you are interested in learning more about Valiant and this opportunity, we invite you to apply now!

Location: This position allows for 100% remote work. Remote work requires a high level of trust in our employees, and we strictly adhere to the details outlined in our Remote Work Policy below. 

Eligibility Requirements: U.S. Citizenship is required due to federal contract obligations, along with the ability to successfully pass a federal background investigation. Must be able to obtain and maintain a Public Trust.

Required Experience

• 4 years of Information Technology Experience 
• Bachelor of Science in Computer Science, Information Systems, Mathematics, Engineering, related degree or an additional two (2) years of experience.
• 3+ years of Splunk administration or engineering experience.
• Proficiency in configuring and managing Splunk inputs, setting up data ingestion pipelines, and establishing system connections.
• Knowledge of Splunk's Search Processing Language (SPL), data parsing techniques, and the use of regular expressions for data extraction and transformation.
• Skilled in optimizing data pipelines for performance and efficiency, handling large data volumes, and implementing best practices for data integrity and consistency.

Preferred Qualifications: 

• Splunk Core Certified Consultant or Splunk Enterprise Certified Architect certification preferred.
• Splunk Enterprise or Splunk Cloud Certified Admin acceptable.
• Experience as an engineering team lead (representing the team's work to clients).
• Experience working with Splunk, syslog, syslog-ng or systems designed to collect and centralize logs.
• Experience leveraging Cribl to optimize Splunk ingest
• Experience assisting teams with Fraud Analytics
• Strong analytical and problem-solving skills, with the ability to effectively prioritize and execute tasks

Responsibilities

• Design, develop and implement processes for ingesting data from various sources into Splunk, ensuring seamless integration and minimal data loss. Processes may include HTTP Event Collector (HEC), Splunk Stream, Splunk Technical Add-Ons (TAs), Universal Forwarder (UF) Collections, custom APIs and other ingest mechanisms. 
• Configure and manage data inputs to accommodate different types of data sources, including logs, metrics, and events to determine compliance with M-26-14 requirements at the FISMA system boundary level.
• Establish and maintain secure and reliable connections between Splunk and external systems or data sources.
• Create, monitor, and maintain alerts for failed data inputs.
• Create and maintain custom Technical Add-Ons for non-standard ingest paths leveraging API connections.
• Ensure proper authentication and authorization mechanisms are in place for data transfer and system communication.
• Oversee the configuration and maintenance of Splunk infrastructure, ensuring optimal performance and security of the Splunk environment.
• Collaborate with cross-functional teams to troubleshoot and resolve issues related to Splunk functionality.
• Conduct root cause analysis for incidents and implement preventive measures.
• Utilize Linux skills to manage and maintain the underlying operating system or Cloud based containers of Splunk servers and other security applications.
• Monitor tool health and performance to identify issues, bugs, or potential improvements. 
• Develop, review, and update existing operational documentation (SOPs, Job Aids, application checklists, playbooks, etc).
• Support system access controls, including Account Management, Access Enforcement, Information Flow Enforcement, Least Privilege, and workflow for all user account requests and account recertifications.
• Collaborate with the Security Operations Center (SOC) teams for process optimization, tool tuning, tool integration, information sharing, playbook development, and incident response.
• Perform implementation, administration, operations and maintenance, optimization, & integration of cybersecurity tools, technologies, and services
• Conduct regular Splunk Enterprise upgrades for deployment servers, heavy forwarders, and syslog servers.

About Valiant Solutions

Valiant Solutions delivers cybersecurity and IT services to federal civilian, defense, and national security customers nationwide. We support the full cyber lifecycle, from secure system design and accreditation through AI-enabled operations, threat emulation, and continuous improvement, across classified and unclassified environments. Our work is independently certified for quality and security, including CMMI, CMMC, and ISO certifications.

Valiant is a multi-year Washington Business Journal Best Places to Work winner, and our growth and cyber leadership have been recognized by Washington Technology, Northern Virginia Technology Council, and the Triangle Business Journal. We offer strong benefits, rewards for earning industry certifications, and room to grow your career as we grow. Headquartered in McLean, Virginia, our distributed workforce supports customers from coast to coast. We go where the stakes are highest, and the margin for error is zero. If you want meaningful work alongside talented professionals, apply today.

Benefits Snapshot

Valiant takes care of the people who support our customers, with real choices in coverage and real investment in your career. Eligible full-time employees receive:

• A choice of medical plans, from an affordable HSA option to a full-featured PPO, with generous company contributions
• Dental and vision coverage for you and your family
• Company-paid life, short-term disability, and long-term disability insurance
• Optional supplemental life, accident, and critical illness coverage to round out your protection
• 401(k) retirement plan with company match
• Paid time off that grows with your years of service, plus paid federal holidays
• Paid certifications, professional development, and the Valiant University training portal
• Flexible spending accounts and a wellness and fitness program
• Referral bonuses when you help us bring great people to Valiant

Benefit eligibility and plan details are subject to the terms of each plan and may change from time to time.

The anticipated salary range for this position is $140,000 to $170,000. This range reflects Valiant Solutions' good-faith estimate of the base salary reasonably expected for this position upon hire, at the time of posting. The range has been established based on the scope of the role, market rates, and internal equity. Where a candidate falls within the posted range will depend on job-related factors, including relevant skills, experience, qualifications, achievements, education, geographic location, applicable security clearance requirements, additional corporate responsibilities, and other legitimate, non-discriminatory business considerations. The posted range does not guarantee an offer at any particular salary. In addition to base salary, this position includes the benefits described above. 

Remote Work Policy (Remote and Hybrid Positions Only)

Remote work necessitates a high level of trust in our employees. To ensure that employee performance does not suffer in a remote work environment, all employees who telecommute are expected to have a quiet and distraction-free workspace with adequate internet, dedicate their full attention and availability to their job duties during working hours, and maintain a schedule during core business hours that aligns with those of their coworkers and Valiant's clients. In alignment with Valiant's inclusive and engaging environment, cameras are encouraged and can be required to be on during virtual video conferences. Additionally, in alignment with the Office of the Inspector General’s effort to eliminate conflicting employment, all Valiant employees are required to disclose any current or future outside employment engagements. During onboarding and throughout employment, employees must disclose any current activities or intent to engage in outside employment or other professional activities and obtain written approval.  Employees may not solicit or conduct any outside business during core business hours for Valiant Solutions and our clients.

Equal Employment Opportunity

Valiant Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy), national origin, age, disability, genetic information, marital status, protected veteran status, or any other characteristic protected by federal, state, or local law. Valiant Solutions provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation during the application or hiring process, please contact [email protected].

Physical Demands

Sitting or standing at a desk for prolonged periods and consistently operating a computer. Frequent communication and exchanging of accurate information via electronic communication, phones, and in person. Occasionally lift and/or move moderate amounts of weight, typically less than 20 pounds. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions of the job.

Authorization to Share Resume and Personal Information

By submitting your resume for this position, you authorize Valiant Solutions to share your resume, as well as personal information included on the resume, with its subsidiaries, affiliates, and teaming partners for the purpose of considering you for this position and other available positions requiring comparable skills, education, and experience. Should Valiant Solutions or its affiliates and teaming partners wish to initiate pre-employment discussions, you will be asked to complete an employment application and related employment documents.

#LI-LH1