Principal Data Engineer

Reposted Yesterday
Easy Apply
Be an Early Applicant
Columbia, MD, USA
In-Office
Senior level
Information Technology • Security • Software
The Role
Design, implement, and validate secure data movement using Apache NiFi, ensuring compliance and reliability in classified environments. Troubleshoot integration issues and support Agile delivery.
Summary Generated by Built In

Clarity Innovations is a trusted national security partner, dedicated to safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission success in an evolving world.

Our mission-first software and data engineering platform modernizes data operations, utilizing advanced workflows, CI/CD, and secure DevSecOps practices. We focus on challenges in Information Warfare, Cyber Operations, Operational Security, and Data Structuring, enabling end-to-end solutions that drive operational impact.

We are committed to delivering cutting-edge tools and capabilities that address the most complex national security challenges, empowering our partners to stay ahead of emerging threats and ensuring the success of their critical missions. At Clarity, we are people-focused and set on being a destination employer for top talent, offering an environment where innovation thrives, careers grow, and individuals are valued. Join us as we continue to lead innovation and tackle the most pressing challenges in national security.

Position Overview

The Data Transport Engineer II is responsible for the design, implementation, and validation of secure data movement within the Unified Data Model (UDM) team. This role focuses on integration between UDM, Apache NiFi, and external stakeholder systems in constrained and classified environments where data flow correctness, schema integrity, and transport reliability are mission-critical. The position is delivery and compliance-oriented rather than availability or on-call focused.

Position Details

Clearance Required: Active TS/SCI with CI poly

Employment Type: Full-Time

Location: Hybrid - Maryland/DC

Key Responsibilities
  • Design, implement, and validate secure data movement between Apache NiFi and external stakeholder components.
  • Support ingestion pipelines, data transfer reliability, and format validation in constrained and classified environments.
  • Troubleshoot data flow issues, schema alignment failures, and transport-layer integration problems across system boundaries.
  • Partner with platform and infrastructure teams to ensure data movement architecture aligns with enterprise standards and security controls.
  • Develop and maintain documentation for data transport patterns, pipeline configurations, and integration test results.
  • Contribute to delivery timelines by meeting enterprise compliance requirements and integration milestones.
  • Participate in peer reviews of pipeline configurations, data schemas, and transport layer designs.
  • Support sprint-based delivery within an Agile/Scrum environment, reporting progress to program leadership.
Required Qualifications

Clearance & Compliance

  • Active TS/SCI  w/ CI Poly security clearance (required prior to start).
  • Ability to operate in classified environments and comply with all applicable government and program security protocols.

Technical Skills

  • Hands-on experience with Apache NiFi for data flow design, pipeline configuration, and processor development.
  • Working knowledge of data format conversion and schema validation (JSON, XML, Avro, Protobuf, or similar).
  • Familiarity with data modeling concepts and structured data interchange patterns.
  • Experience with REST APIs and integration patterns for data transport between distributed systems.
  • Proficiency in at least one scripting or programming language (Python, Groovy, Java) for pipeline customization.
  • Understanding of data transport security requirements including encryption in transit and access control.

Experience

  • 5-10 years of experience in data engineering, integration engineering, or a directly related role.
  • Experience working in government, defense, or other regulated/classified environments preferred.
  • Demonstrated ability to troubleshoot integration failures and resolve data consistency issues in production pipelines.
Preferred Qualifications
  • Experience with Kubernetes-based deployment environments and containerized data pipelines.
  • Familiarity with document/data ingestion workflows.
  • Experience with CI/CD pipelines and DevSecOps practices in a government contracting context.
  • Familiarity with Agile/Scrum delivery and working in cross-functional product teams.
We are an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.

Top Skills

Apache Nifi
Avro
Ci/Cd
Devsecops
Groovy
Java
JSON
Protobuf
Python
Rest Apis
XML
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Columbia, MD
79 Employees
Year Founded: 2011

What We Do

Clarity Innovations designs, develops, and deploys force-enhancing software that links human ingenuity to powerful computing and makes our country and our world a better, safer place. Our principles of servant leadership, mutual respect, and technological excellence enable us to thrive on the challenges of the digital frontline. Clarity is focused on helping the Government redefine its relationship with technology by encouraging the use of DevSecOps and Agile methodologies, small-teams constructs, and process automation. To create an atmosphere that embraces the challenges inherent in progress, we honor creativity and curiosity, supporting exploration and growth with modern tech stacks and methodologies. We are as much a family as we are a team, collectively engineering technology that improves the lives and work of the people who use it. We empower our people with the tools, training, and vision they need to outperform the competition.

Similar Jobs

ServiceTitan Logo ServiceTitan

Principal Software Engineer

Artificial Intelligence • Cloud • Fintech • Machine Learning • Mobile • Software
Remote or Hybrid
US
2760 Employees
247K-330K Annually

Citizens Logo Citizens

Data Engineer

Digital Media • Fintech • Information Technology • Machine Learning • Financial Services • Cybersecurity • Automation
In-Office or Remote
2 Locations
17000 Employees
150K-180K Annually

Motional Logo Motional

Principal Engineer

Artificial Intelligence • Automotive • Machine Learning • Transportation
Remote or Hybrid
3 Locations
765 Employees
175K-234K Annually

Similar Companies Hiring

Fairly Even Thumbnail
Hardware • Other • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account