The Role
Design, develop, and maintain scalable data pipelines, models, databases, and data infrastructure using ETL and big-data technologies. Cleanse, integrate, and validate large datasets; implement data governance; troubleshoot complex data issues; and collaborate with analysts, scientists, and stakeholders. Develop and enhance software supporting mission requirements, maintain application databases, and coordinate hardware-software integration. The role requires onsite work in Arlington, Virginia, an active Secret clearance, and U.S. citizenship.
Summary Generated by Built In
Data Engineer
We need an experienced Data Engineer at the National Guard Bureau (NGB). The NGB is the link between the Army and Air National Guard and the Department of War (DoW). You will support operations on the Minuteman project team, which manages the NGB's enterprise data environment within the DoW's central analytics platform, and plays a crucial role in designing, developing, and maintaining the Minuteman Community Space's data infrastructure and systems. In this role, you will design and implement end-to-end data pipelines using ETL processes and technologies including Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL, working closely with cross-functional teams to understand data requirements and design optimal data models and architectures that ensure efficient data processing and analysis. This is a full-time opportunity. We can offer a competitive salary, and a comprehensive benefits package.
RESPONSIBILITIES
REQUIRED QUALIFICATIONS
PREFERRED QUALIFICATIONS
EDUCATION
LOCATION
CLEARANCE
CLIENT
WORK HOURS
EMPLOYMENT CLASSIFICATION
COMPENSATION
Other Considerations: applicants will be subject to a background investigation. Individual’s primary workstation is located in an office area. The noise level in this environment is low to moderate. Regularly required to sit for extended periods up to 80% of the time; frequently required to move about to access file cabinets and use office equipment such as PC, copier, fax, telephone, cell phone, etc. Occasionally required to reach overhead, bend, and lift objects of up to 10 lbs. Specific vision abilities required by this job include the use of computer monitor screens up to 80% of the time.
We need an experienced Data Engineer at the National Guard Bureau (NGB). The NGB is the link between the Army and Air National Guard and the Department of War (DoW). You will support operations on the Minuteman project team, which manages the NGB's enterprise data environment within the DoW's central analytics platform, and plays a crucial role in designing, developing, and maintaining the Minuteman Community Space's data infrastructure and systems. In this role, you will design and implement end-to-end data pipelines using ETL processes and technologies including Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL, working closely with cross-functional teams to understand data requirements and design optimal data models and architectures that ensure efficient data processing and analysis. This is a full-time opportunity. We can offer a competitive salary, and a comprehensive benefits package.
RESPONSIBILITIES
- Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL
- Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures
- Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing
- Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets
- Leverage big data technologies to efficiently process and analyze large datasets
- Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes
- Troubleshoot data-related problems and provide innovative solutions to address complex data challenges
- Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices
- Research, design, and develop software and specialized utility programs in support of mission requirements
- Analyze user needs and develop software solutions, applying principles and techniques of computer science, engineering, and mathematical analysis
- Update and enhance existing software capabilities
- Develop specifications and performance requirements, coordinating with engineering counterparts to integrate hardware and software systems as required
- Maintain databases within the application area, working individually or coordinating database development as part of a team
REQUIRED QUALIFICATIONS
- Three (3) to ten (10) years of directly related experience
- Available to work onsite in Arlington, VA 1-2 days per week
- 3+ years of experience as a Data Engineer
- Proficiency in ETL processes and firsthand experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks
- Experience working with large datasets and leveraging big data technologies to process and analyze data efficiently
- Understanding of data modeling/visualization, database design principles, and data governance practices
PREFERRED QUALIFICATIONS
- Experience with the Department of War (DoW) mission and associated datasets
- Previous experience with Advana or the War Data Platform
- Experience with APIs
- Experience with Machine Learning models and/or Generative AI
- Experience building within Palantir Foundry applications, including Workshop, Ontology Manager, and Gaia
EDUCATION
- B.A./B.S. or M.A./M.S. in a related field
LOCATION
- National Capital Region. Onsite in Arlington, VA 1-2 days per week – Required
CLEARANCE
- Active Secret security clearance
- U.S. citizenship is required since this role supports the U.S. Federal government
CLIENT
- OUSD Personnel & Readiness (P&R), Minuteman project team
WORK HOURS
- 40 hours per week. 8 hours per day
EMPLOYMENT CLASSIFICATION
- Employment Classification Eligibility — W2
COMPENSATION
- Salary range: $155,000 - $165,000
- Benefits: Benefits package includes options for health, dental, and vision insurance coverage; 401k contribution options
Other Considerations: applicants will be subject to a background investigation. Individual’s primary workstation is located in an office area. The noise level in this environment is low to moderate. Regularly required to sit for extended periods up to 80% of the time; frequently required to move about to access file cabinets and use office equipment such as PC, copier, fax, telephone, cell phone, etc. Occasionally required to reach overhead, bend, and lift objects of up to 10 lbs. Specific vision abilities required by this job include the use of computer monitor screens up to 80% of the time.
Skills Required
- Three to ten years of directly related experience
- At least three years of experience as a Data Engineer
- Availability to work onsite in Arlington, Virginia, one to two days per week
- Proficiency with ETL processes, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks
- Experience working with large datasets and big-data technologies
- Understanding of data modeling, visualization, database design principles, and data governance practices
- Bachelor's or master's degree in a related field
- Active Secret security clearance
- U.S. citizenship
- Experience with Department of War mission and associated datasets
- Experience with Advana or the War Data Platform
- Experience with APIs
- Experience with machine learning models and/or generative AI
- Experience building Palantir Foundry applications, including Workshop, Ontology Manager, and Gaia
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
West 4th Strategy provides rapid response technology services to civilian, defense, and homeland security customers. We build and mobilize dynamic teams of qualified technologists who embody competence, professionalism, and a commitment to results. We excel at moving fast to find the right people to get the job done. And the best part of our technology teams? They make the government’s mission their mission. Our teams work with a sense of purpose to power the government. West 4th Strategy. Our work defines us.
