Senior Data Engineer

Job Type: Full- Time

Workplace Type: Hybrid

Clearance: Active Secret clearance

Must be a U.S. Citizen

Job Summary

Castalia is seeking exceptional Senior Level Data Engineers to join our expanding team. In this role, you will be responsible for ensuring data availability—including the seamless movement, modification, and storage of critical data. Working closely with Software Engineers and Data Scientists, you will ensure the scalability and successful deployment of data pipelines that support high-priority users.

The Mission

Our team develops and deploys cutting-edge AI and Machine Learning applications that directly support national security missions. We empower 19 key Principal Staff members (Senior Executive Service and General Officers) within the Office of the Undersecretary of Defense (OUSD) and the Intelligence Community. Your work will provide these leaders with the critical, data-driven insights necessary for strategic decision-making.

Candidate Profile

The ideal candidate is a motivated technologist who thrives with limited direction and is passionate about continuous learning. We are looking for engineers who can pivot quickly to new languages and technologies to solve complex problems.

Roles and Responsibilities

A qualified candidate will perform the following duties and responsibilities, but are not limited to:

• Design, develop, and maintain scalable data pipelines and ETL processes to ingest, transform, integrate, and deliver mission-critical data from multiple sources.
• Ensure data availability, quality, reliability, and performance by monitoring data workflows, troubleshooting issues, and optimizing data processing and storage solutions.
• Develop and maintain data solutions using Python, Databricks, SQL, relational databases, and other modern data engineering technologies.
• Collaborate with Software Engineers, Data Scientists, and mission stakeholders to support the development and deployment of AI/ML applications and data-driven analytics.
• Design and implement secure data integration and transfer solutions while supporting database architecture, data organization, scalability, and cybersecurity requirements within classified environments.

Required Qualifications

• BS Degree.
• 8+ years of professional experience needed for MOST of our opportunities.
• Python experience with data manipulation, scripting, and more.
• Databricks experience.
• Proficient in designing and implementing Extract Transform Load (ETL) data processes.
• Experience with at least ONE relational database, such as PostgreSQL, MySQL or SQLite.
• Experience with Agile SCRUM methodologies.

Preferred Qualifications

• Familiar with database design, server management, connection protocols, database normalization, and principles of information theory.
• Experience with data cleaning or data organization.
• Familiar with NiFi, SQL, NoSQL and Graph Databases and Data Lakes.
• Familiar with Dashboarding tools similar to Qlik.
• Familiar with Cybersecurity with design and implementation of unique data transfer protocols.

Physical Requirements/Work Environment

• ONSITE 3-5 days per week.
• Normal office environment.

Travel

• As needed

Company Description

Castalia Systems is a proven business partner providing mission critical solutions to the Federal Government. We provide cutting edge solutions from Securing and Managing Data to Systems Engineering and Development. Castalia Systems is a pioneer in Artificial Intelligence Design and Application.

With our vast knowledge of our customers’ needs and relevant technology, our team is able to bring successful solutions to every mission. We are one-upping our competitors by providing premium IT solutions and platforms with cutting-edge technology so it’s so evident when you compare us with anyone.

Compensation

At Castalia Systems, we provide you with opportunities and choices and support your total well-being. Our benefits include: Medical, dental, vision coverage, 401k matching, generous PTO, paid holidays, professional training opportunities, and even pet insurance to ensure your furry friends are cared for too. All regularly scheduled employees working at least 30 hours per week are eligible to participate in Castalia Systems’ benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits.

Salary at Castalia Systems is determined by various factors, including but not limited to location, position knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $150,000.00 to $160,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Castalia Systems’ total compensation package for employees.

Disclaimer

Castalia Systems is an equal employment opportunity and affirmative action employer and strives to comply with all applicable laws prohibiting discrimination based on race, color, creed, sex, sexual orientation, age, national origin, or ancestry, physical or mental disability, veteran status, marital status, HIV-positive status, as well as any other category protected by federal, state, or local laws. All such discrimination is unlawful, and all persons involved in the operations of the company are prohibited from engaging in this type of conduct.