Captivation has built a reputation on providing customers exactly what is needed in a timely manner. Our team of engineers take pride in what they develop and constantly innovate to provide the best solution. Captivation is looking for software developers who can get stuff done while making a difference in support of the mission to protect our country.
Captivation Software is looking for a principal Data Flow Engineer is a senior technical leader responsible for designing, integrating, and sustaining enterprise-scale dataflow architectures that support mission-critical analytics across secure cloud and distributed environments. This role oversees high-availability Linux and Cloudera Hadoop infrastructures, develops and maintains end-to-end dataflow solutions using technologies such as Niagara files and XKS, and ensures reliable, secure, and compliant data ingestion, processing, and delivery. The position also leads automation, monitoring, troubleshooting, and DevOps initiatives to improve system performance and operational efficiency while coordinating across engineering, operations, analytics, and stakeholder teams to deploy scalable, resilient, and mission-focused dataflow capabilities.
Responsibilities
- Lead the design, integration, and sustainment of complex enterprise dataflow architectures supporting mission-critical analytics, ensuring reliable ingestion, processing, routing, and delivery across large-scale cloud and distributed environments
- Manage and optimize high-availability Linux and Cloudera Hadoop cloud infrastructures, including virtual machines, storage containers, and enterprise data repositories, to support thousands of secure operational dataflows
- Engineer and maintain end-to-end dataflow solutions using technologies such as Niagarafiles and XKS, and related processing systems, ensuring schema compatibility, metadata integrity, and proper data governance throughout the lifecycle
- Develop and implement monitoring, troubleshooting, and automation strategies utilizing system instrumentation, cron scripting, logging, and operational monitoring tools to improve system continuity, performance, and incident response capabilities
- Provide technical leadership for DevOps and Agile/Scrum initiatives, including task prioritization, workflow modernization, requirements management, and cross-functional coordination to improve operational efficiency and team performance
- Ensure compliance with enterprise security, classification, and data handling requirements by applying deep knowledge of intelligence community governance policies, access controls, and secure data routing methodologies
- Coordinate across engineering, operations, analytics, and stakeholder organizations to deploy new capabilities, transition systems into production, establish standard operating procedures, and support enterprise-wide mission objectives through scalable and resilient dataflow solutions.
RequirementsSecurity Clearance:
- Must currently hold a Top Secret/SCI U.S. Government security clearance with a favorable Polygraph, therefore all candidates must be a U.S. citizen
- Bachelor’s degree in a Qualified Engineering Field or related discipline from an accredited college or university with twenty (20) years of systems engineering experience.
- A High School Diploma or GED plus twenty-four (24) years of general systems engineering experience
- A Master’s degree in a Qualified Engineering Field or a related discipline from an accredited college or university plus eighteen (18) years of systems engineering experience.
This position is open for direct hires only. We will not consider candidates from third party staffing/recruiting firms.
- Annual Salary: $130,000 - $270,000 (Depends on the Years of Experience)
- Up to 20% 401k contribution (No Matching Required and Vested from Day 1)
- Above Market Hourly Rates
- $3,600 HSA Contribution
- 6 Weeks Paid Time Off
- Company Paid Employee Medical/Dental/Vision Insurance/Life Insurance/Short-Term & Long-Term Disability/AD&D
Skills Required
- Must currently hold Top Secret/SCI U.S. Government security clearance with favorable Polygraph
- U.S. citizenship (required to hold clearance)
- Bachelor's degree in a Qualified Engineering Field plus 20 years systems engineering experience (or HS +24 years, or Master's +18 years)
- Experience managing high-availability Linux and Cloudera Hadoop cloud infrastructures
- Experience engineering and maintaining end-to-end dataflow solutions using Niagarafiles / Apache NiFi and XKS
- Experience with automation, monitoring, troubleshooting using cron scripting, logging, and operational monitoring tools
- Technical leadership in DevOps and Agile/Scrum including task prioritization and cross-functional coordination
- Knowledge of intelligence community security, classification, access controls, and secure data handling
