Senior Data Engineer

Posted 9 Hours Ago
Fort Bragg, NC, USA
In-Office
168K-228K Annually
Senior level
Aerospace • Information Technology • Professional Services • Security • Software
The Role
Designs, builds, and maintains scalable ETL, batch, and streaming data pipelines using Airflow, Kafka, Python, AWS S3, Trino, OpenSearch, and related technologies. Develops data APIs, optimizes storage and retrieval, supports data governance, and integrates classified data securely. Collaborates with software developers, analysts, and product teams to deliver reliable data solutions for production applications. This hybrid Fort Bragg role requires active TS/SCI clearance, CI Poly eligibility, and U.S. citizenship.
Summary Generated by Built In

Type of Requisition:

Regular

Clearance Level Must Currently Possess:

Top Secret/SCI

Clearance Level Must Be Able to Obtain:

Top Secret/SCI

Public Trust/Other Required:

None

Job Family:

Data Science and Data Engineering

Job Qualifications:

Skills:

Big Data Engineering, Database Engineering, Data Designing, Enterprise Data Engineering

Certifications:

None

Experience:

10 + years of related experience

US Citizenship Required:

Yes

Job Description:

YOUR IMPACT 

Own your opportunity to work with the largest government agency in the nation. Make an impact by advancing the Department of War’s mission to keep our country safe and secure. 


OUR COMPANY 

Iron EagleX (IEX), a wholly owned subsidiary of General Dynamics Information Technology (GDIT), delivers agile IT and Intelligence solutions. Combining small-team flexibility with global scale, IEX leverages emerging technologies to provide innovative, user-focused solutions that empower organizations and end users to operate smarter, faster, and more securely in dynamic environments.

JOB DESCRIPTION 
We are seeking a Data Engineer SME with a strong ETL emphasis to design, build, and maintain data collection, processing, and integration pipelines that centralize and structure data from various web-based applications. You will work closely with software developers, data analysts, and product teams to ensure seamless data flow, high-quality data storage, and efficient retrieval methods. This role is ideal for someone passionate about data-driven decision-making and optimizing data aggregation processes while exploring and identifying right-sized technologies and computing resources. This position focuses on wrangling disparate data sources into unified, consumable data APIs for internal and external stakeholders. This is a hybrid position (3 days on site) in Fort Bragg, NC.

 

Job Duties Include (but not limited to):

·       Design, develop, and implement scalable data pipelines and ETL processes using Apache Airflow.

·       Develop messaging solutions utilizing Kafka to support real-time data streaming and event-driven architectures.

·       Build and maintain high-performance data retrieval solutions using ElasticSearch/OpenSearch.

·       Implement and optimize Python-based data processing solutions.

·       Integrate batch and streaming data processing techniques to enhance data availability and accessibility.

·       Ensure adherence to security and compliance requirements when working with classified data.

·       Work closely with cross-functional teams to define data strategies and develop technical solutions aligned with mission objectives.

·       Design, implement, and maintain robust data engineering solutions serving data to the backend of production user facing applications.

·       Deploy and manage cloud-based infrastructure to support scalable and resilient data solutions, including AWS S3.

·       Optimize data storage, retrieval, and processing efficiency, focusing on big data and the use of Parquet files.

·       Utilize Trino for distributed SQL query processing.

·       Leverage OpenMetaData for data discovery and governance.

·       Implement APIs using FastAPI for streamlined data interaction.

·       Ensure proper implementation of Data Governance requirements and adherence to common PKI security practices to appropriately protect data.

·       Leverage IC repositories of user attributes to provide authorized access to data and ensure proper protections are applied.
Required Skills & Experience:

·       Extensive experience with Apache Airflow for workflow orchestration.

·       Strong programming skills in Python.

·       Experience using SQL compliant database solutions such as Postgres.

·       Familiarity with Trino for enhanced SQL query processing in large datasets.

·       Experience with ElasticSearch/OpenSearch for data indexing and search functionalities.

·       Understanding of vector databases, embedding models, and vector search for AI applications.

·       Expertise in event-driven architecture and microservices development.

·       Hands-on experience with cloud services, particularly AWS S3 and MinIO, including data storage and compute resources.

·       Strong knowledge of Reggo and its application within data environments.

·       Understanding of big data technologies and file formats like Parquet.

·       Expertise in data pipeline orchestration and workflow automation.

·       Working knowledge of Linux environments and database optimization techniques.

·       Strong understanding of version control with Git.

·       Familiarity with OpenMetaData for data management.

·       Experience implementing FastAPI for building scalable APIs.

·     

WHAT YOU’LL NEED TO SUCCEED: 

  • Education & Certifications: Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field (or equivalent experience). Advanced degrees are a plus.
  • Security Clearance: An active TS/SCI security clearance is REQUIRED, and candidates must have or be willing to obtain a CI Poly. Candidates without this clearance will not be considered.
  • Due to US Government Contract Requirements, only US Citizens are eligible for this role  

IEX/GDIT IS YOUR PLACE 
At IEX/GDIT, the mission is our purpose, and our people are at the center of everything we do. 

  • Growth: AI-powered career tool that identifies career steps and learning opportunities 
  • Support: An internal mobility team focused on helping you achieve your career goals 
  • Rewards: Comprehensive benefits and wellness packages, 401K with company match, competitive pay and paid time off 
  • Community: Award-winning culture of innovation and a military-friendly workplace 

 
OWN YOUR OPPORTUNITY 
Explore a career at IEX/GDIT and you’ll find endless opportunities to grow alongside colleagues who share your passion for the mission and delivering results. #iexjobs 


Equal Opportunity Employer / Individuals with Disabilities / Protected Veterans  

The likely salary range for this position is $168,300 - $227,700. This is not, however, a guarantee of compensation or salary. Rather, salary will be set based on experience, geographic location and possibly contractual requirements and could fall outside of this range.

Scheduled Weekly Hours:

40

Travel Required:

Less than 10%

Telecommuting Options:

Hybrid

Work Location:

USA NC Fort Bragg

Additional Work Locations:

Total Rewards at GDIT:

Our benefits package for all US-based employees includes a variety of medical plan options, some with Health Savings Accounts, dental plan options, a vision plan, and a 401(k) plan offering the ability to contribute both pre and post-tax dollars up to the IRS annual limits and receive a company match. To encourage work/life balance, GDIT offers employees full flex work weeks where possible and a variety of paid time off plans, including vacation, sick and personal time, holidays, paid parental, military, bereavement and jury duty leave. To ensure our employees are able to protect their income, other offerings such as short and long-term disability benefits, life, accidental death and dismemberment, personal accident, critical illness and business travel and accident insurance are provided or available. We regularly review our Total Rewards package to ensure our offerings are competitive and reflect what our employees have told us they value most.

 



Our Identity Verification Process:

As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during virtual interviews. We reserve the right to take your picture to verify your identity and prevent fraud. By proceeding, you authorize the collection, processing, and use of your biometric data for identity verification and security purposes.

About Our Work:

We are GDIT. A global technology and professional services company that delivers technology solutions and mission services to every major agency across the U.S. government, defense and intelligence community. Our 26,000 experts extract the power of technology to create immediate value and deliver solutions at the edge of innovation. We operate across 50+ countries worldwide, offering leading mission-ready capabilities in AI, cloud, cyber and software development.

Join our Talent Community to stay up to date on our career opportunities and events at

gdit.com/tc.

Equal Opportunity Employer / Individuals with Disabilities / Protected Veterans

Skills Required

  • 10+ years of related experience in data engineering, big data engineering, database engineering, data design, or enterprise data engineering
  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent experience
  • Active Top Secret/SCI security clearance
  • Must have or be willing to obtain a CI Polygraph
  • U.S. citizenship
  • Extensive experience with Apache Airflow for workflow orchestration
  • Strong Python programming skills
  • Experience with SQL-compliant databases such as PostgreSQL
  • Familiarity with Trino for distributed SQL query processing
  • Experience with Elasticsearch or OpenSearch
  • Understanding of vector databases, embedding models, and vector search
  • Expertise in event-driven architecture and microservices development
  • Hands-on experience with AWS S3 and MinIO
  • Knowledge of Reggo in data environments
  • Understanding of big data technologies and Parquet file formats
  • Working knowledge of Linux and database optimization
  • Strong understanding of Git version control
  • Familiarity with OpenMetadata
  • Experience implementing FastAPI
  • Advanced degree

General Dynamics Information Technology Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about General Dynamics Information Technology and has not been reviewed or approved by General Dynamics Information Technology.

  • Affordable Benefits — Pay and benefits are described as good or okay in multiple places, and the overall package is often portrayed as acceptable even when base pay is not viewed as top-tier.
  • Healthcare Strength — Medical, dental, and vision plan options are presented as comprehensive, with additional protections like disability and life insurance contributing to a well-rounded health and protection offering.
  • Retirement Support — A 401(k) plan with company match is consistently highlighted as part of the total rewards package, supporting longer-term financial planning.

General Dynamics Information Technology Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Falls Church, VA
21,625 Employees

What We Do

We are GDIT. The people supporting some of the most complex government, defense, and intelligence projects across the country. We deliver. Bringing the expertise needed to understand and advance critical missions. We transform. Shifting the ways clients invest in, integrate, and innovate technology solutions. We ensure today is safe and tomorrow is smarter. We are there. On the ground, beside our clients, in the lab, and everywhere in between. Offering the technology transformations, strategy, and mission services needed to get the job done.

Similar Jobs

Lowe’s Logo Lowe’s

Senior Data Engineer

Consumer Web • eCommerce • Information Technology • Retail • Software • Analytics • App development
Hybrid
Charlotte, NC, USA
300000 Employees

Optum Logo Optum

Senior Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
Raleigh, NC, USA
160000 Employees
92K-164K Annually

Jellyfish Logo Jellyfish

Senior Data Engineer

Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Remote or Hybrid
United States
225 Employees
165K-235K Annually

NinjaOne Logo NinjaOne

Senior Data Engineer

Information Technology • Productivity • Software • Infrastructure as a Service (IaaS)
Remote or Hybrid
18 Locations
2000 Employees
110K-200K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account