Position Detail:
As a Data Engineer/Integrator, your role entails collaborating closely with a team of developers to fulfill data integration requirements. This involves writing and maintaining code using an Extract-Transform-Load (ETL) platform to ensure data is transformed into suitable formats as defined by IC ITE initiatives. You will interface with external teams and systems, employing various protocols including HTML and SFTP to collect data efficiently. Additionally, your responsibilities include enhancing the ETL platform by adding features aimed at shortening timelines for future data integration efforts. Beyond coding tasks, you'll develop and maintain software, ensuring seamless integration into a fully functional system. Collaboration with external teams will be necessary to validate data ingest processes. Finally, you'll be responsible for providing comprehensive documentation covering system architecture, development, and any enhancements made throughout the process.
Education and Experience:
- 5+ years of professional experience with a Bachelor's degree or equivalent
- 3+ years of professional experience with a Master's degree or equivalent
- 10+ years of professional experience
- Additional experience will be considered in lieu of a degree
Required Quals:
- Active TS/SCI with with CI Polygraph
- Specialization using the Databricks platform for building, deploying, and managing data and AI solutions
- Experience building ETL pipelines, managing data pipelines, and working with large datasets using tools like Spark, Python, and SQL
- Experience with technologies like Delta Lake, Delta Live Tables, and Databricks Workflows
Desired Quals:
- Experience collaborating with data scientists
- Familiarity with Advana
- Strong Python programming skills
- Solid SQL knowledge for querying and data manipulation
- Cloud platform experience, such as AWS, Azure, etc
Work Location:
Elkridge, MD
Salary range for this position $98,000-$193,000 #CJ
Top Skills
What We Do
Red Arch Solutions is a premier U.S. small business providing its customers with state-of-the-art tactical and strategic intelligence, systems, and software engineering solutions, solving some of the most pressing and unique intelligence community challenges related to National Security.
Our employees are exceptionally skilled professionals; individuals who are dedicated to collecting, analyzing, creating and engineering the best solutions in support of critical missions. Red Arch Solutions takes pride in the success of our customers. The depth of our engineers’ experience combined with our breadth of exposure across the intelligence community enables us to provide value added, synergistic analytical and engineering support.
Unique to Red Arch Solutions is the focus on its employees. Our guiding principle is “People First.” We offer employees career mobility and stability, work-life balance flexibility, and individualized career paths. The loyalty of highly trained, skilled professionals is our key corporate asset.
Red Arch Solutions is an Equal Opportunity Affirmative Action Employer.
