Data Engineer

Posted 4 Days Ago
Hiring Remotely in Arlington, VA, USA
In-Office or Remote
95K-110K Annually
Senior level
Information Technology • Financial Services
The Role
Designs and maintains scalable Azure data pipelines and lakehouse solutions supporting enterprise analytics and AI/ML. Integrates batch, streaming, and event-driven data sources; implements data quality, monitoring, governance, metadata, lineage, and access controls; optimizes performance and cloud costs; supports migration to the VA Summit platform; and documents, troubleshoots, and maintains production data services.
Summary Generated by Built In
Trilogy Federal drives innovative solutions for complex business challenges across financial management, healthcare, and government industries. Our collaborative, client-first service approach, combined with our commitment to the rapid implementation of pragmatic solutions, has earned Trilogy an unparalleled reputation for delivering transformative results.

Trilogy Federal seeks an experienced Data Engineer to support the Department of Veterans Affairs (VA) Summit Advanced Tooling, Lakehouse, and Artificial Intelligence Services (Summit ATLAS) program. The Data Engineer will design, develop, and maintain scalable cloud-based data pipelines and engineering solutions that enable enterprise analytics, reporting, and artificial intelligence and machine learning (AI/ML) capabilities. 

This position will support modernization of VA's enterprise data environment by integrating diverse data sources into the Summit Data Platform, improving data reliability and accessibility, and delivering secure, high-performance data engineering solutions. 

Please note, this position is contingent upon award (anticipated early 2027). This role will also require 1-2 domestic business trips per year. 

Primary Responsibilities:

  • Design, develop, and maintain scalable data ingestion and processing pipelines using Azure Data Factory (ADF), Azure Databricks, Apache Kafka, and related cloud technologies. 
  • Engineer and optimize data lakehouse solutions, including Delta Lake architectures, semantic models, conformed dimensions, and partitioning strategies that support enterprise analytics and AI/ML workloads. 
  • Integrate data from enterprise systems, legacy platforms, and cloud-based sources using batch, streaming, and event-driven ingestion patterns. 
  • Implement automated data validation, reconciliation, and monitoring to ensure data accuracy, completeness, consistency, and freshness. 
  • Support migration of data pipelines and analytical workloads to Summit, validating parity with source systems and ensuring production readiness. 
  • Optimize data processing performance, resource utilization, and cloud costs through workload tuning and efficient data architecture. 
  • Collaborate with data governance specialists to ensure ingested datasets are documented in the Enterprise Data Catalog (EDC), including required metadata, data definitions, and end-to-end lineage. 
  • Implement Government-approved data governance requirements within engineering solutions, including access controls, data quality standards, and dataset publication criteria. 
  • Develop and maintain technical documentation, including pipeline specifications, architecture decisions, operational procedures, and troubleshooting guidance. 
  • Monitor production pipelines, investigate failures and performance issues, and implement corrective actions to maintain reliable data services. 

Minimum Requirements:

  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related technical discipline, or an equivalent combination of education and relevant professional experience. 
  • Seven or more years of professional experience in data engineering, data integration, or enterprise data platform development. 
  • Demonstrated hands-on experience with Azure Data Factory, Azure Databricks, and Apache Kafka. 
  • Strong proficiency in Structured Query Language (SQL) and Python for data processing, transformation, and pipeline development. 
  • Experience designing and maintaining Extract, Transform, and Load (ETL) and Extract, Load, and Transform (ELT) pipelines. 
  • Experience with cloud-based lakehouse architectures, distributed data processing, and data modeling. 
  • Experience implementing automated data quality checks, pipeline monitoring, error handling, and performance optimization. 
  • Experience integrating data governance requirements into engineering workflows, including metadata management, data lineage, and policy-based data access controls. 
  • Familiarity with source control, automated testing, and Continuous Integration and Continuous Delivery (CI/CD) practices. 
  • Strong analytical, troubleshooting, communication, and collaboration skills. 
  • Ability to meet VA personnel vetting, background investigation, and system access requirements.
  •  The ability to travel for 1-2 domestic business trips per year. 

Preferred Qualifications:

  • Experience supporting VA or other federal agency data modernization initiatives. 
  • Experience working within Microsoft Azure Government cloud environments. 
  • Experience with Azure Synapse Analytics, dedicated SQL pools, or comparable enterprise data warehouse technologies. 
  • Familiarity with federated query technologies such as Starburst or Trino. 
  • Experience migrating complex legacy data warehouse workloads to cloud-based platforms. 
  • Experience working with sensitive healthcare data and federal privacy and security requirements. 
  • Microsoft Certified: Azure Data Engineer Associate or comparable cloud data engineering certification.

Benefits (including but not limited to):

  • Health, dental, and vision plans
  • Optional FSA
  • Paid parental leave
  • Safe Harbor 401(k) with employer contributions 100% vested from day 1
  • Paid time off and 11 paid holidays
  • No cost group term life/AD&D plan, and optional supplemental coverage
  • Pet insurance
  • Monthly phone and internet stipend
  • Tuition and training reimbursement

To cut down on falsified applications and to avoid subjecting real candidates to screening by AI assistants, phone interviews at Trilogy require either a landline or a cellphone number backed by a physical SIM. We cannot conduct interviews with candidates who provide VOIP contact numbers (including Google Voice). 
 
Trilogy Federal is an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

Skills Required

  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related technical discipline, or equivalent education and relevant professional experience
  • Seven or more years of professional experience in data engineering, data integration, or enterprise data platform development
  • Hands-on experience with Azure Data Factory, Azure Databricks, and Apache Kafka
  • Strong proficiency in SQL and Python for data processing, transformation, and pipeline development
  • Experience designing and maintaining ETL and ELT pipelines
  • Experience with cloud-based lakehouse architectures, distributed data processing, and data modeling
  • Experience implementing automated data quality checks, pipeline monitoring, error handling, and performance optimization
  • Experience integrating data governance requirements, metadata management, data lineage, and policy-based data access controls
  • Familiarity with source control, automated testing, and CI/CD practices
  • Strong analytical, troubleshooting, communication, and collaboration skills
  • Ability to meet VA personnel vetting, background investigation, and system access requirements
  • Ability to travel for 1-2 domestic business trips per year
  • Experience supporting VA or other federal agency data modernization initiatives
  • Experience working within Microsoft Azure Government cloud environments
  • Experience with Azure Synapse Analytics, dedicated SQL pools, or comparable enterprise data warehouse technologies
  • Familiarity with federated query technologies such as Starburst or Trino
  • Experience migrating complex legacy data warehouse workloads to cloud-based platforms
  • Experience working with sensitive healthcare data and federal privacy and security requirements
  • Microsoft Certified: Azure Data Engineer Associate or comparable cloud data engineering certification
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Arlington, VA
121 Employees
Year Founded: 2009

What We Do

Founded in 2009 and headquartered in the Washington DC metro area, Trilogy Federal is a verified service-disabled, veteran-owned small business (SDVOSB) providing financial management and information technology consulting to the Federal government. Trilogy has an extensive and distinctive history helping Federal clients achieve their financial management goals. Our leadership team has over 60 years of combined experience supporting Federal financial management initiatives. Our professional staff specializes in federal financial management and maintains certifications in several relevant programs. Trilogy strives to provide its clients with a flexible and comprehensive approach to financial management with the ultimate goal of fiscal compliance and audit readiness. The Trilogy approach starts with assessing the financial management solution and determining its effectiveness in capturing functional business requirements and meeting agency reporting requirements. Since our inception, we have assisted our federal partners in migrating to new financial management systems or enhancing existing systems to meet new requirements. Ultimately, success lies in the data, where Trilogy utilizes industry leading Business Intelligence and Business Performance Management tools to assess the overall effectiveness of financial business operations and to produce timely, reliable and value-added financial reporting. We have a proven track record of successful implementations for agencies large and small.

Similar Jobs

Capital One Logo Capital One

Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Remote or Hybrid
McLean, VA, USA
55000 Employees
179K-225K Annually

Applied Systems Logo Applied Systems

Data Engineer

Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Remote or Hybrid
United States
3116 Employees
160K-260K Annually

Shield  Logo Shield

Staff Data Engineer

Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software • Defense Technology
Remote
USA
149K-224K Annually

Shield  Logo Shield

Reliability Engineer

Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software • Defense Technology
Remote
USA
180K-270K Annually

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account