Data Engineer

Reposted 4 Days Ago
2 Locations
In-Office
Senior level
Information Technology • Software
The Role
The Senior Data Engineer will design and implement data pipelines, enhance data operations, and maintain performance standards, focusing on cloud environments.
Summary Generated by Built In

Nightwing provides technically advanced full-spectrum cyber, data operations, systems integration and intelligence mission support services to meet our customers’ most demanding challenges. Our capabilities include cyber space operations, cyber defense and resiliency, vulnerability research, ubiquitous technical surveillance, data intelligence, lifecycle mission enablement, and software modernization. Nightwing brings disruptive technologies, agility, and competitive offerings to customers in the intelligence community, defense, civil, and commercial markets.

Nightwing is supporting a U.S. Government customer on a large mission critical development and sustainment program to design, integrate, build, deliver, and operate a network operations environment including introducing new cyber capabilities to address emerging threats. Nightwing is seeking a Senior Data Engineer working to support the migration of customer applications, services and platforms to a Medallion Model.

Responsibilities:

  •  Data Pipeline Developer: design, develop and implement, end-to-end data ingestion and processing pipelines using various Cloud and Platform Technologies.
  • Transform incoming bronze data (RAW) into silver (clean) and finally projections into gold tier. (Medallion model)
  • Schedule, orchestrate and monitor automated/semi-automated data pipelines.
  • Perform mapping and integration of data assets in support of the execution of multiple mission customers.
  • Develop and maintain the data engineering team process improvement plan.
  • Develop code using various programming and scripting languages to automate data ingestion, pipeline orchestration and improve data management processes.
  • Ingest transparency, leveraging technologies such as AWS CloudWatch to identify places for measuring and gathering performance information on automated data pipelines
    • Ensure Data Engineering Team Standard Operating Procedures are appropriately captured and communicated across the team.
    • Ensure technical correctness, timeliness and quality of delivery for the team.
    • Demonstrate excellent oral and written communication skills to all levels of management and the customer.

Required Skills:

  • Must be a US Citizen
  • Active Secret (S) clearance. Must be able to obtain a TS/SCI clearance
  • Must be able to obtain DHS Suitability
  • 8+ years of software engineering experience.
  • Minimum of 4 years of experience performing data engineering work in a cloud environment.
  • Experience with relational, noSQL and/or file-based storage (e.g. Databricks, Elastic, Postgres, etc.)
  • Experience with DevOps tools such as Jenkins, Docker, Ansible, Puppet, Chef, Splunk, etc.
  • Working knowledge of Databricks, Cloud Relational Database Services and Elasticsearch

Desired Skills:

  • Experience with Databricks workflows, Databricks Unity Catalog, Databricks Autoloader, and Databricks Delta Live Tables and Apache Spark.
  • Basic working knowledge with Apache Niagara Files (NiFi)
  • Experience with collaboration tools including MS Teams, MS Outlook, MS SharePoint, and Confluence
  • Amazon Web Services (AWS) Professional certification or equivalent.

Desired Certifications:

  • DoD 8570.1-M Compliance at IAT Level I (e.g., Certified Information Systems Security Professional (CISSP)) certification highly desired

Required Education:

  • Bachelor’s degree in Software Engineering, Computer Science or a related discipline is required. [Ten (10) years of experience (for a total of eighteen (18) or more years) may be substituted for a degree.] 

Syndeo # - 3482

At Nightwing, we value collaboration and teamwork. You’ll have the opportunity to work alongside talented individuals who are passionate about what they do. Together, we’ll leverage our collective expertise to drive innovation, solve complex problems, and deliver exceptional results for our clients.

Thank you for considering joining us as we embark on this new journey and shape the future of cybersecurity and intelligence together as part of the Nightwing team.

Nightwing is An Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status, age or any other federally protected class.
 

Top Skills

Ansible
Spark
AWS
Chef
Databricks
Docker
Elastic
Jenkins
Nifi
Postgres
Puppet
Splunk
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
952 Employees

What We Do

We are the intelligence services company that continually redefines the edge of the possible to keep advancing our national security interests.

Similar Jobs

Capital One Logo Capital One

Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
2 Locations
55000 Employees
309K-384K Annually

Capital One Logo Capital One

Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
5 Locations
55000 Employees
240K-329K Annually

Capital One Logo Capital One

Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
5 Locations
55000 Employees
281K-384K Annually

Capital One Logo Capital One

Senior Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
Richmond, VA, USA
55000 Employees
144K-165K Annually

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account