Mid-Level Data Engineer

Posted Yesterday
Falls Church, VA
Mid level
Information Technology
The Role
As a Mid-Level Data Engineer, you will develop and maintain data pipelines, manage data ingestion from various sources, ensure data security, and engage in automation processes. You'll work with Big Data systems and cloud environments to support national security initiatives and deliver innovative solutions.
Summary Generated by Built In

About the Organization

Now is a great time to join Redhorse Corporation. Redhorse specializes in developing and implementing creative strategies and solutions with private, state, and federal customers in the areas of cultural and environmental resources services, climate and energy change, information technology, and intelligence services. We are hiring creative, motivated, and talented people with a passion for doing what's right, what's smart, and what works.


About the Role

Redhorse is seeking a skilled Mid-Level Data Engineer to join our team supporting the Chief Digital and Artificial Intelligence Office (CDAO) within the Department of Defense (DoD). You will play a crucial role in advancing data-driven decision-making by developing and maintaining robust data pipelines, ensuring the secure and efficient flow of information across diverse environments. This is a high-impact position offering significant contributions to national security initiatives.

Key Responsibilities

  • Support the configuration and ingestion of designated structured, unstructured, and semi-structured data repositories into capabilities that satisfy mission partner requirements and support a data analytics and DevOps pipeline to drive rapid delivery of functionality to the client.
  • Maintain all operational aspects of data transfers while accounting for the security posture of the underlying infrastructure and the systems and applications that are supported and monitoring the health of the environment through a variety of health tracking capabilities.
  • Automate configuration management, leverage tools, and stay current on data extract, transfer, and load (ETL) technologies and services.
  • Work under general guidance, demonstrate initiative to develop approaches to solutions independently, review architecture, and identify areas for automation, optimization, right-sizing, and cost reduction to support the overall health of the environment.
  • Apply comprehension of data engineering-specific technologies and services, leverage expertise in databases and a variety of approaches to structuring and retrieving of data, comprehend Cloud architectural constructs, and support the establishment and maintenance of Cloud environments programmatically using vendor consoles.
  • Engage with multiple functional groups to comprehend client challenges, prototype new ideas and new technologies, help to create solutions to drive the next wave of innovation, and design, implement, schedule, test, and deploy full features and components of solutions.
  • Maintain an existing collection of web scraping tools used as the initial step of the ETL process.
  • Identify and implement scalable and efficient coding solutions.

Required Experience/Clearance

  • Bachelor’s degree plus 5-7 years of experience, or a Master’s degree plus 3 years of experience.
  • Experience with Big Data systems, including Apache Spark/Databricks.
  • Experience with ETL processes.
  • Experience with Amazon Web Services (AWS), Microsoft Azure, or MilCloud 2.0.
  • Experience applying DoD Security Technical Implementation Guides (STIGs) and automating that process.
  • Experience with multiple coding languages.
  • Active Top Secret (TS) security clearance with Sensitive Compartmented Information (SCI) eligibility.

Equal Opportunity Employer/Veterans/Disabled 

 

Accommodations:

If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to access job openings or apply for a job on this site as a result of your disability. You can request reasonable accommodations by contacting Talent Acquisition at [email protected]

 

Redhorse Corporation shall, in its discretion, modify or adjust the position to meet Redhorse’s changing needs.

This job description is not a contract and may be adjusted as deemed appropriate in Redhorse’s sole discretion.

Top Skills

Spark
AWS
Databricks
ETL
Azure
The Company
HQ: Arlington, VA
310 Employees
On-site Workplace
Year Founded: 2008

What We Do

We want to improve the way government interacts with and uses data and technology. Redhorse combines top-tier consulting experience with a passion for problem-solving to help clients address mission-critical government problems. We roll up our sleeves and stand shoulder-to-shoulder with our clients to understand their issues and find solutions, using digital transformation and artificial intelligence, partnered with our domain expertise in National Security, Networking Technology and Infrastructure, Energy and the Environment.

Similar Jobs

Capital One Logo Capital One

Senior Data Engineer (Python, Java, AWS)

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
McLean, VA, USA
55000 Employees

Capital One Logo Capital One

Senior Data Engineer (Python, AWS, Spark)

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
Richmond, VA, USA
55000 Employees
165K-189K Annually

Capital One Logo Capital One

Lead Data Engineer (Spark, Scala, SQL)

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
Richmond, VA, USA
55000 Employees
188K-214K Annually

Capital One Logo Capital One

Senior Data Engineer (Python, AWS, Spark)

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
McLean, VA, USA
55000 Employees
165K-189K Annually

Similar Companies Hiring

Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees
InCommodities Thumbnail
Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
Austin, TX
234 Employees
HERE Thumbnail
Software • Logistics • Information Technology
Amsterdam, NL
9000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account