Databricks Engineer

Posted 2 Hours Ago
2 Locations
In-Office or Remote
140K-190K Annually
Senior level
Aerospace • Information Technology • Professional Services • Security • Software
The Role
Design, develop, and optimize scalable Databricks data pipelines using PySpark, SQL, Spark, and Delta Lake. Build workflows, ingestion and transformation processes, data quality checks, monitoring, and CI/CD automation. Optimize distributed workloads, configure Databricks compute, support cloud governance and access controls, troubleshoot production issues, and collaborate with technical and research stakeholders to deliver secure, reliable analytical datasets.
Summary Generated by Built In

Type of Requisition:

Regular

Clearance Level Must Currently Possess:

None

Clearance Level Must Be Able to Obtain:

None

Public Trust/Other Required:

None

Job Family:

Data Science and Data Engineering

Job Qualifications:

Skills:

Cloud Technology, Databricks Lakeflow, Databricks Platform, Databricks Unity Catalog, Data Lake

Certifications:

None

Experience:

7 + years of related experience

US Citizenship Required:

No

Job Description:

GDIT is seeking a Databricks Engineer to help build and operate modern data solutions supporting the NIA Data Enclave. In this role, you will design, develop, and optimize scalable data pipelines that enable researchers and analysts to securely work with sensitive federal and non-federal datasets.

You will work at the intersection of data engineering, cloud technology, and mission-focused analytics, partnering with data scientists, researchers, software engineers, architects, and platform teams to turn complex data into reliable, governed, and accessible analytical resources.

This is an opportunity to apply your Databricks and Spark expertise to a mission where data quality, security, scalability, and reliability matter.

How You'll Make an Impact

As a Databricks Engineer, you will:

  • Design, build, and optimize scalable ETL/ELT pipelines using Databricks, PySpark, SQL, and Delta Lake.
  • Develop and maintain Databricks notebooks, jobs, and workflows that support high-volume analytical workloads.
  • Build reliable data ingestion, transformation, validation, and integration processes.
  • Help migrate and modernize existing data workloads for improved scalability, performance, and maintainability.
  • Optimize Spark workloads through effective partitioning, caching, joins, file management, and other performance-tuning techniques.
  • Implement automated testing, data quality checks, monitoring, logging, and operational processes.
  • Support CI/CD and infrastructure automation for Databricks workloads using Git and tools such as Azure DevOps or GitHub Actions.
  • Configure and optimize Databricks compute, clusters, runtimes, and job execution.
  • Work within secure, role-based cloud environments and help implement appropriate data governance and access controls.
  • Troubleshoot production issues, perform root-cause analysis, and continuously improve the reliability of data services.
  • Collaborate with data scientists, researchers, analysts, and other engineers to deliver high-quality analytical datasets.

What You'll Need to Succeed

  • Bachelor's degree in computer science, software engineering, data engineering, or a related technical field.
  • 5+ years of data engineering experience, including significant hands-on experience with Databricks.
  • Strong experience with PySpark, SQL, Apache Spark, Delta Lake, and Databricks.
  • Experience developing production-grade data pipelines and workflows.
  • Experience working with cloud-based data platforms and storage such as AWS S3, Azure Data Lake Storage, or Google Cloud Storage.
  • Experience with Git and CI/CD practices for deploying and managing data engineering workloads.
  • Understanding of distributed data processing, data modeling, data quality, and pipeline performance optimization.
  • Experience troubleshooting and supporting production data workloads.
  • Understanding of cloud security concepts such as role-based access control, identity management, least-privilege access, and data protection.
  • Strong communication skills and the ability to collaborate effectively with technical and mission-focused stakeholders.

Preferred Qualifications

  • Experience with Databricks Unity Catalog and enterprise data governance.
  • Experience working in FISMA Moderate/High or other regulated environments.
  • Experience with AWS, Azure, and/or GCP in a multi-cloud environment.
  • Familiarity with CMS, federal, healthcare, biomedical, or other sensitive datasets.
  • Experience with secure data enclaves, restricted-access environments, or federated data platforms.
  • Experience with Terraform or other infrastructure-as-code technologies.
  • Experience with Databricks Lakeflow Declarative Pipelines / Delta Live Tables.
  • Experience implementing data lineage, metadata management, monitoring, and audit-ready logging.
  • Familiarity with Databricks APIs, SDKs, or automation frameworks.

Why GDIT?

At GDIT, you'll have the opportunity to apply modern data engineering technologies to meaningful mission challenges. You'll work with a collaborative team of engineers, architects, researchers, and data professionals while helping build secure and scalable capabilities for an environment where trustworthy data can directly enable better research and decision-making.

If you're a hands-on data engineer who enjoys solving complex data problems and wants to apply your Databricks expertise to an important mission, we'd like to hear from you.

The likely salary range for this position is $140,250 - $189,750. This is not, however, a guarantee of compensation or salary. Rather, salary will be set based on experience, geographic location and possibly contractual requirements and could fall outside of this range.

Scheduled Weekly Hours:

40

Travel Required:

10-25%

Telecommuting Options:

Hybrid

Work Location:

Any Location / Remote

Additional Work Locations:

USA MD Gaithersburg

Total Rewards at GDIT:

Our benefits package for all US-based employees includes a variety of medical plan options, some with Health Savings Accounts, dental plan options, a vision plan, and a 401(k) plan offering the ability to contribute both pre and post-tax dollars up to the IRS annual limits and receive a company match. To encourage work/life balance, GDIT offers employees full flex work weeks where possible and a variety of paid time off plans, including vacation, sick and personal time, holidays, paid parental, military, bereavement and jury duty leave. GDIT typically provides new employees with 15 days of paid leave per calendar year to be used for vacations, personal business, and illness and an additional 10 paid holidays per year. Paid leave and paid holidays are prorated based on the employee’s date of hire. The GDIT Paid Family Leave program provides a total of up to 160 hours of paid leave in a rolling 12 month period for eligible employees. To ensure our employees are able to protect their income, other offerings such as short and long-term disability benefits, life, accidental death and dismemberment, personal accident, critical illness and business travel and accident insurance are provided or available. We regularly review our Total Rewards package to ensure our offerings are competitive and reflect what our employees have told us they value most.

 



Our Identity Verification Process:

As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during virtual interviews. We reserve the right to take your picture to verify your identity and prevent fraud. By proceeding, you authorize the collection, processing, and use of your biometric data for identity verification and security purposes.

About Our Work:

We are GDIT. A global technology and professional services company that delivers technology solutions and mission services to every major agency across the U.S. government, defense and intelligence community. Our 26,000 experts extract the power of technology to create immediate value and deliver solutions at the edge of innovation. We operate across 50+ countries worldwide, offering leading mission-ready capabilities in AI, cloud, cyber and software development.

Join our Talent Community to stay up to date on our career opportunities and events at

gdit.com/tc.

Equal Opportunity Employer / Individuals with Disabilities / Protected Veterans

Skills Required

  • Bachelor's degree in computer science, software engineering, data engineering, or a related technical field.
  • 7+ years of related experience.
  • 5+ years of data engineering experience, including significant hands-on Databricks experience.
  • Strong experience with PySpark, SQL, Apache Spark, Delta Lake, and Databricks.
  • Experience developing production-grade data pipelines and workflows.
  • Experience with cloud-based data platforms and storage such as AWS S3, Azure Data Lake Storage, or Google Cloud Storage.
  • Experience with Git and CI/CD practices for deploying and managing data engineering workloads.
  • Understanding of distributed data processing, data modeling, data quality, and pipeline performance optimization.
  • Experience troubleshooting and supporting production data workloads.
  • Understanding of cloud security concepts, including role-based access control, identity management, least-privilege access, and data protection.
  • Strong communication and collaboration skills.
  • Experience with Databricks Unity Catalog and enterprise data governance.
  • Experience working in FISMA Moderate/High or other regulated environments.
  • Experience with AWS, Azure, and/or GCP in a multi-cloud environment.
  • Familiarity with CMS, federal, healthcare, biomedical, or other sensitive datasets.
  • Experience with secure data enclaves, restricted-access environments, or federated data platforms.
  • Experience with Terraform or other infrastructure-as-code technologies.
  • Experience with Databricks Lakeflow Declarative Pipelines or Delta Live Tables.
  • Experience implementing data lineage, metadata management, monitoring, and audit-ready logging.
  • Familiarity with Databricks APIs, SDKs, or automation frameworks.

General Dynamics Information Technology Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about General Dynamics Information Technology and has not been reviewed or approved by General Dynamics Information Technology.

  • Affordable Benefits Pay and benefits are described as good or okay in multiple places, and the overall package is often portrayed as acceptable even when base pay is not viewed as top-tier.
  • Healthcare Strength Medical, dental, and vision plan options are presented as comprehensive, with additional protections like disability and life insurance contributing to a well-rounded health and protection offering.
  • Retirement Support A 401(k) plan with company match is consistently highlighted as part of the total rewards package, supporting longer-term financial planning.

General Dynamics Information Technology Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Falls Church, VA
21,625 Employees

What We Do

We are GDIT. The people supporting some of the most complex government, defense, and intelligence projects across the country. We deliver. Bringing the expertise needed to understand and advance critical missions. We transform. Shifting the ways clients invest in, integrate, and innovate technology solutions. We ensure today is safe and tomorrow is smarter. We are there. On the ground, beside our clients, in the lab, and everywhere in between. Offering the technology transformations, strategy, and mission services needed to get the job done.

Similar Jobs

Peraton Logo Peraton

Senior Data Engineer

Aerospace • Information Technology • Security • Cybersecurity • Defense
Remote
United States
18000 Employees
112K-179K Annually

Peraton Logo Peraton

Data Engineer

Aerospace • Information Technology • Security • Cybersecurity • Defense
Remote
United States
18000 Employees
112K-179K Annually

AIS (Applied Information Sciences) Logo AIS (Applied Information Sciences)

Azure Data / Databricks Engineer

Cloud • Information Technology • Software • Business Intelligence
Remote
USA
710 Employees
195K-210K Annually

DATAECONOMY Logo DATAECONOMY

Senior Data Engineer

Big Data • Cloud • Analytics • Consulting
Remote
New Jersey, USA
414 Employees

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account