Senior Manager, Data Engineering

Posted Yesterday
Be an Early Applicant
2 Locations
In-Office
146K-248K Annually
Senior level
Information Technology • Security • Software
The Role
Leads architecture and technical governance for a secure, enterprise-scale DoD data lake and brokerage platform. Oversees integration across platform, cloud, data engineering, data science, and software teams; establishes standards for scalability, reliability, security, and data governance; evaluates architectural tradeoffs; develops technical roadmaps; and communicates decisions to engineering, program, and government stakeholders. Requires expertise in petabyte-scale data systems, lakehouse technologies, Kubernetes, cloud infrastructure, data quality, metadata, access control, and distributed architectures.
Summary Generated by Built In

Clarity Innovations is a trusted national security partner, dedicated to safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission success in an evolving world.

Our mission-first software and data engineering platform modernizes data operations, utilizing advanced workflows, CI/CD, and secure DevSecOps practices. We focus on challenges in Information Warfare, Cyber Operations, Operational Security, and Data Structuring, enabling end-to-end solutions that drive operational impact.

We are committed to delivering cutting-edge tools and capabilities that address the most complex national security challenges, empowering our partners to stay ahead of emerging threats and ensuring the success of their critical missions. At Clarity, we are people-focused and set on being a destination employer for top talent, offering an environment where innovation thrives, careers grow, and individuals are valued. Join us as we continue to lead innovation and tackle the most pressing challenges in national security.

Position Overview

We are seeking an experienced Chief Engineer to provide technical leadership and architectural oversight for a large-scale enterprise data lake and data brokerage platform supporting a Department of Defense (DoD) mission.

The Chief Engineer will be responsible for defining the overarching technical architecture, ensuring integration across multiple engineering disciplines, and guiding the development of a secure, scalable, and highly available data ecosystem.

The ideal candidate possesses a broad understanding of Platform Engineering, Cloud Infrastructure, Data Engineering, and Data Science, with the ability to translate complex mission requirements into cohesive technical solutions.

This is a strategic technical leadership position requiring strong systems-level thinking, architectural decision-making, and the ability to guide specialized engineering teams. 

Key Responsibilities

  • Enterprise Architecture: Lead the design and evolution of an enterprise-scale data platform supporting data ingestion, storage, processing, discovery, analytics, and distribution.
  • Technical Leadership: Provide architectural direction and technical oversight across Platform Engineering, Cloud Infrastructure, Data Engineering, Data Science, and Software Development teams.
  • Systems Integration: Ensure interoperability across distributed systems, cloud environments, data pipelines, APIs, and mission applications.
  • Architecture Governance: Establish technical standards, design principles, and engineering best practices to ensure scalability, reliability, security, and maintainability.
  • Solution Development: Evaluate architectural alternatives, identify technical risks and dependencies, and develop solutions aligned with mission objectives.
  • Security & Compliance: Collaborate with cybersecurity and compliance stakeholders to incorporate appropriate security controls, data governance, and regulatory requirements into system architecture.
  • Technical Roadmapping: Support technical planning, capability prioritization, technology selection, and long-term platform modernization.
  • Stakeholder Engagement: Communicate complex technical concepts, architectural decisions, tradeoffs, and risks to engineering teams, program leadership, and government stakeholders.
Required Qualifications
  • 10+ years of experience in software engineering, systems engineering, cloud architecture, data engineering, or related technical disciplines, including significant experience leading complex technical initiatives.
  •  
  • Understands the DoD Zero Trust Reference Architecture, and its application in the context of Iceberg/Trino.
  • Understands technical considerations for operating Petabyte scale Iceberg warehouses including data pipelines, and data cataloging.
  • Demonstrated experience architecting or overseeing large-scale, distributed enterprise data systems, including experience with end-to-end ownership of vendor data onboarding, ETL, storage, governance, and access layers.
  • Hands-on depth with open-source ETL and data lakehouse technologies, including Apache NiFi (ingestion/routing/provenance), Apache Spark (processing/transformation), Apache Iceberg (storage), and Trino (query/access layer).
  • Experience with OpenMetadata or comparable tools (such as Datahub, Alation, etc…) for cataloging, lineage, governance, and data quality metrics.
  • Experience building usage analytics and Grafana dashboards that help customers measure the value and return on investment of individual vendor data feeds.
  • Experience designing automated data quality evaluation processes that evaluate new feeds at onboarding and continuously monitor completeness, accuracy, timeliness, and schema stability.
  • Strong understanding of fine-grained access control, including attribute-based and field-level security enforced by user entitlements, classification levels, and regulatory requirements.
  • Experience deploying and operating containerized data platforms on Kubernetes across Azure and AWS, including infrastructure as code, CI/CD, high availability, and security hardening.
  • Proven technical leadership across engineering teams, with the ability to set architectural standards and serve as the primary technical liaison to customer stakeholders.
  • Broad technical understanding across the following disciplines with hands on experience with at least two:
    • Platform Engineering: Container orchestration, Kubernetes, CI/CD, infrastructure automation, observability, and platform reliability.
    • Cloud Infrastructure: Cloud-native architectures, networking, compute, storage, identity and access management, and infrastructure as code.
    • Data Engineering: Data lakes, ETL/ELT pipelines, batch and streaming architectures, data integration, metadata management, and data governance.
    • Data Science: Foundational understanding of machine learning, statistical analysis, AI/ML workflows, and the infrastructure required to support advanced platform and data analytics.
  • Ability to develop and evaluate end-to-end technical architectures spanning multiple engineering domains.
  • Strong understanding of system scalability, high availability, fault tolerance, security, and performance optimization.
  • Demonstrated ability to lead technical design discussions, evaluate engineering tradeoffs, and guide multidisciplinary engineering teams.
  • Excellent communication skills with the ability to engage both technical and nontechnical stakeholders.
  • Experience with AWS, Azure, Kubernetes, Terraform, Apache NiFi, Apache Spark, Trino, or comparable technologies.
  • Experience designing large-scale data lakes, data fabrics, data mesh architectures, or enterprise data brokerage systems.
  • Experience supporting petabyte-scale data environments or high-throughput data processing systems.
Preferred Qualifications
  • Hands-on engineering experience in one or more of the following: Platform Engineering, Cloud Engineering, Data Engineering, Software Engineering, or Data Science.
  • Knowledge of DoD or Federal data governance policies, security requirements, and regulatory frameworks, including NIST, RMF, FedRAMP, and applicable DoD data management policies.
  • Familiarity with cross-domain data transfer, data classification, access control, and sensitive data handling requirements.
  • Experience supporting DoD, Intelligence Community, or other Federal enterprise technology programs.
  • Experience evaluating emerging technologies and incorporating AI/ML capabilities into enterprise data architectures.
Ideal Candidate

The successful candidate is a technical generalist with deep architectural expertise and hands on experience in two of the areas above who understands how complex engineering disciplines interact to deliver an integrated enterprise capability.

They must possess a T-shaped architectural profile, combining broad cross-domain awareness with deep, practical acumen in at least one technical discipline to credibly guide high-level decisions. While not expected to perform daily hands-on troubleshooting, they must leverage hands-on experience to evaluate engineering tradeoffs, challenge assumptions, and lead overall system architecture.

Above all, this individual must be capable of seeing the entire technical ecosystem, understanding its dependencies, and providing the engineering leadership necessary to deliver a secure, reliable, and scalable enterprise data platform.

Data Engineering Senior Manager
$145,900—$248,000 USD

Pay Range

The posted pay range reflects the national salary range for this position and is provided to give candidates a general understanding of the compensation opportunity. The actual salary offered will be determined based on the requirements of the position and a variety of job-related factors, which may include geographic location, applicable Federal Government contract labor categories and wage rates, relevant experience, skills and competencies, education, certifications, and the scope and responsibilities of the role.

Because this position may be performed in multiple locations and may be subject to different contract requirements, the salary ultimately offered may vary based on the applicable location and contract. The posted range is not a guarantee of a specific starting salary or an indication that an offer will be made at any particular point within the range.

Total Rewards

In addition to competitive base pay, Clarity provides a Total Rewards package designed to attract and retain exceptional professionals committed to excellence. Our benefits reflect the value we place on skilled individuals who drive our impact in critical digital missions.

At Clarity, a career means joining a high-performing team advancing vital work in the digital landscape. We encourage you to consider the total value of joining us—competitive compensation, comprehensive benefits, and resources that support your growth and impact.

Our Total Rewards package includes performance-based bonuses, extensive medical, dental, and vision coverage, a 401(k) plan with company match, substantial paid time off and holidays, flexible work arrangements where possible, and a range of income protection benefits. We are committed to supporting your well-being, professional growth, and ability to contribute to essential digital missions.

We are an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.

Skills Required

  • 10+ years of experience in software engineering, systems engineering, cloud architecture, data engineering, or related technical disciplines, including significant leadership of complex technical initiatives.
  • Understanding of the DoD Zero Trust Reference Architecture and its application with Iceberg and Trino.
  • Technical understanding of operating petabyte-scale Iceberg warehouses, including data pipelines and cataloging.
  • Experience architecting or overseeing large-scale distributed enterprise data systems, including vendor data onboarding, ETL, storage, governance, and access layers.
  • Hands-on experience with Apache NiFi, Apache Spark, Apache Iceberg, and Trino or comparable data lakehouse technologies.
  • Experience with OpenMetadata or comparable cataloging, lineage, governance, and data quality tools such as DataHub or Alation.
  • Experience building usage analytics and Grafana dashboards for measuring vendor data feed value and return on investment.
  • Experience designing automated data quality evaluation and continuous monitoring processes.
  • Strong understanding of fine-grained, attribute-based, and field-level access controls based on entitlements, classification, and regulatory requirements.
  • Experience deploying and operating containerized data platforms on Kubernetes across Azure and AWS.
  • Experience with infrastructure as code, CI/CD, high availability, and security hardening.
  • Proven technical leadership across engineering teams and experience serving as a primary technical liaison to customer stakeholders.
  • Broad technical understanding and hands-on experience in at least two of Platform Engineering, Cloud Infrastructure, Data Engineering, and Data Science.
  • Ability to develop and evaluate end-to-end architectures spanning multiple engineering domains.
  • Strong understanding of scalability, high availability, fault tolerance, security, and performance optimization.
  • Ability to lead technical design discussions, evaluate engineering tradeoffs, and guide multidisciplinary teams.
  • Excellent communication skills with technical and nontechnical stakeholders.
  • Experience with AWS, Azure, Kubernetes, Terraform, Apache NiFi, Apache Spark, Trino, or comparable technologies.
  • Experience designing large-scale data lakes, data fabrics, data mesh architectures, or enterprise data brokerage systems.
  • Experience supporting petabyte-scale data environments or high-throughput data processing systems.
  • Hands-on engineering experience in Platform Engineering, Cloud Engineering, Data Engineering, Software Engineering, or Data Science.
  • Knowledge of DoD or Federal data governance, security requirements, and frameworks including NIST, RMF, and FedRAMP.
  • Familiarity with cross-domain data transfer, data classification, access control, and sensitive data handling.
  • Experience supporting DoD, Intelligence Community, or other Federal enterprise technology programs.
  • Experience evaluating emerging technologies and incorporating AI/ML capabilities into enterprise data architectures.

Clarity Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Clarity and has not been reviewed or approved by Clarity.

  • Fair & Transparent Compensation — Pay is considered strong, with multiple references to “good” or “excellent” compensation. Salary snapshots for engineering and platform roles depict robust pay across multiple seniority levels.
  • Healthcare Strength — Benefits include medical, dental, and vision coverage alongside mental‑health support and wellness programs. The breadth of core offerings indicates comprehensive health support for individuals and families.
  • Leave & Time Off Breadth — Time‑off provisions cover company holidays, PTO, and defined leaves such as parental, bereavement, and jury duty. This range of leave types supports common personal and family needs.

Clarity Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Portland, OR
79 Employees
Year Founded: 2011

What We Do

Clarity Innovations designs, develops, and deploys force-enhancing software that links human ingenuity to powerful computing and makes our country and our world a better, safer place. Our principles of servant leadership, mutual respect, and technological excellence enable us to thrive on the challenges of the digital frontline. Clarity is focused on helping the Government redefine its relationship with technology by encouraging the use of DevSecOps and Agile methodologies, small-teams constructs, and process automation. To create an atmosphere that embraces the challenges inherent in progress, we honor creativity and curiosity, supporting exploration and growth with modern tech stacks and methodologies. We are as much a family as we are a team, collectively engineering technology that improves the lives and work of the people who use it. We empower our people with the tools, training, and vision they need to outperform the competition.

Similar Jobs

Remote or Hybrid
United States
500 Employees

Applied Systems Logo Applied Systems

Sr. Manager, Data Engineering

Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Remote or Hybrid
United States
3116 Employees
135K-185K Annually

Jackpocket Logo Jackpocket

Engineering Manager

Consumer Web • Gaming • Mobile • News + Entertainment • Software
Remote or Hybrid
United States
330 Employees

Samsara Logo Samsara

AVP, Federal Sales

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
440K-550K Annually

Similar Companies Hiring

Genius AI Thumbnail
Beauty • Enterprise Web • Fintech • Payments • Software
New York, NY
400 Employees
SharkNinja Thumbnail
Beauty • Robotics • Design • Appliances • Manufacturing
Needham, MA
4000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account