Senior Data Engineer

Reposted 9 Days Ago
Easy Apply
Springfield, VA
In-Office
Mid level
Big Data • Cloud • Information Technology • Consulting • Cybersecurity
The Role
The Software Data Engineer ensures secure data handling by supporting EDW operations, designing ETL processes, and automating data pipelines within a TS/SCI environment.
Summary Generated by Built In

**ACTIVE TS/SCI SECURITY CLEARANCE REQUIRED**


The Data Engineer supports mission-critical data engineering and analytics operations within a classified federal environment, focusing on maintaining and enhancing an Enterprise Data Warehouse (EDW) built on Data Vault 2.0 principles. This position ensures the secure ingestion, transformation, and presentation of corporate data containing Personally Identifiable Information (PII) within a TS/SCI network enclave.

The engineer will develop and maintain automated data pipelines from enterprise business systems, implement best practices for secure data handling, and ensure compliance with all applicable DoD and IC data protection policies. The role requires strong technical skills in data integration, automation, and AWS-based data services, combined with deep experience supporting federal systems.

Key Responsibilities
  • Provide adaptive maintenance and development support for the organization’s Enterprise Data Warehouse in a classified TS/SCI environment with PII overlays

  • Design, implement, and optimize ETL/ELT processes using SQL Server Integration Services (SSIS), T-SQL, and Python to automate data ingest and transformation from multiple corporate systems.

  • Develop and sustain automated data pipelines from enterprise applications including PeopleSoft, Momentum, Prism, and Service Plus, ensuring end-to-end data integrity and retention within the classified data warehouse.

  • Implement AWS-native tools (e.g., Lambda, Glue) to enhance automation and scalability of data ingestion and transformation processes.

  • Leverage PowerShell scripting and Visual Studio for automation, environment configuration, and integration workflows.

  • Utilize SharePoint and Nintex workflows to design secure, user-friendly interfaces for presentation of backend SQL database outputs to government and contractor stakeholders.

  • Support data governance, compliance, and security audits in coordination with information assurance and system security officers (ISSOs) to maintain alignment with DoD and IC directives.

  • Develop and maintain technical documentation, including Standard Operating Procedures (SOPs), system design documentation, and data lineage tracking.

  • Provide technical expertise during requirements analysis, solution design, and integration testing phases of ongoing modernization efforts.

Required Qualifications
  • Minimum of 4 years of experience performing adaptive maintenance and development of an Enterprise Data Warehouse (EDW) in a TS/SCI environment with PII data.

  • At least 4 years of experience with the following tools and technologies:

    • Development Tools: SQL Server Integration Services (SSIS), Visual Studio

    • Programming Languages: Python, PowerShell, T-SQL

  • Demonstrated experience integrating and automating data ingests from PeopleSoft, Momentum, Prism, and Service Plus into a data warehouse.

  • Hands-on experience developing automated data pipelines using AWS services (e.g., Lambda, Glue) in support of secure data ingestion and retention.

  • Experience with SharePoint and Nintex workflows for front-end presentation of SQL-based datasets.

  • Bachelor’s Degree in Computer Science, Information Technology, or related field;

    • In lieu of degree: an additional 8 years of relevant experience.

Desired Qualifications
  • Data Vault 2.0 Certified Practitioner (DV 2.0 Certification).

  • Master’s Degree in Computer Science, Information Technology, or a related discipline.

  • Experience working on DoD or Intelligence Community (IC) data warehouse programs.

  • Familiarity with DoD Cloud Computing Security Requirements Guide (SRG) and NIST 800-53 controls.

Core Competencies
  • Strong understanding of data warehousing principles, data modeling, and ETL automation.

  • Demonstrated expertise with data security, PII protection, and classified system compliance.

  • Excellent problem-solving, debugging, and performance optimization skills.

  • Proven ability to operate effectively in cross-functional government–contractor teams.

  • Clear and concise technical communication and documentation skills.

Position Impact

This role directly contributes to the federal agency’s mission assurance by ensuring the secure, reliable, and automated integration of enterprise data sources within a classified environment. The Data Scientist enables mission stakeholders to leverage accurate, timely, and compliant data for strategic analysis and operational decision-making.

Additional Information

  • All your information will be kept confidential according to EEO guidelines.
  • Compensation is unique to each candidate and relative to the skills and experience they bring to the position. This does not guarantee a specific salary as compensation is based upon multiple factors such as education, experience, certifications, and other requirements, and may fall outside of the above-stated range.
  • Highlights of our benefits include Health/Dental/Vision, 401(k) match, Accrued PTO, STD/LTD/Life Insurance, Referral Bonuses, professional development reimbursement, and more!

D2 Consulting is committed to a merit-based recruitment process and encourages applications from all qualified individuals.  As a Veteran-Owned Small Business, we particularly welcome applications from veterans who have the requisite skills and experience.  Job applicants that are interested in one of our openings and may require a reasonable accommodation to participate in the job application or interview process, should contact us to request an accommodation.


Top Skills

Aws Glue
Aws Lambda
Nintex
Powershell
Python
Sharepoint
Sql Server Integration Services
T-Sql
Visual Studio
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Arlington, Virginia
30 Employees
Year Founded: 2016

What We Do

D2 Consulting provides services to the Federal Government focused in the following three area's

We leverage D2 Consulting engineering, operations and governance best practices to efficiently and effectively deploy, maintain and continuously improve IT services and solutions. This includes not only engineering solutions such as VDI and providing direct support to operations but also deploying the tools to instrument and maintain Enterprise performance and availability (including ITSM and Enterprise Management Tools).

Protect & Secure: This is our cyber security practice, which includes functions like audit and information assurance, as well as the traditional mechanics of securing IT systems and services. We have experience working with the Government to better manage risk to help move the accreditation process along. This is especially true with respect to adapting accreditation controls to a cloud environment.

Cloud Migration and Data Center modernization/consolidation: This area is focused on cloud migration and adoption as well as data center consolidation. We work to ensure that infrastructure requirements are implemented correctly, according to best practices and in a timely manner.

Similar Jobs

Capital One Logo Capital One

Senior Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
2 Locations
55000 Employees
147K-185K Annually

Capital One Logo Capital One

Senior Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
Richmond, VA, USA
55000 Employees
147K-168K Annually

Capital One Logo Capital One

Senior Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
2 Locations
55000 Employees
147K-185K Annually

Capital One Logo Capital One

Senior Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
3 Locations
55000 Employees
147K-185K Annually

Similar Companies Hiring

Scrunch AI Thumbnail
Software • SEO • Marketing Tech • Information Technology • Artificial Intelligence
Salt Lake City, Utah
Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account