The Role
Designs, builds, and maintains ETL pipelines and data workflows using SQL, Python, and Apache Airflow. Develops data models, datasets, validation queries, DDL, and deployment scripts for cloud data warehouses. The role includes adapting reusable pipelines for clients, monitoring production workflows, troubleshooting failures, supporting platform modernization, and collaborating with analysts and stakeholders to translate business requirements into technical solutions.
Summary Generated by Built In
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
ABOUT THE ROLE
We are looking for a Data Engineer to own ETL pipelines that power institutional analytics for colleges and universities. This person designs and maintains data workflows using SQL, Python, and Apache Airflow, moving data from source systems into a cloud data warehouse. Comfort adapting shared pipelines for individual clients while keeping code clean matters here.
WHAT YOU WILL DO
- Design, build, and maintain ETL pipelines and data workflows across multiple environments (development, staging, and production).
- Implement and extend data models and datasets to support analytical and reporting needs.
- Adapt and customize shared data pipelines for individual clients while maintaining a clean, reusable codebase.
- Monitor and support production data pipelines, investigate failures, and deliver fixes in a timely manner.
- Write and maintain database DDL, data validation queries, and deployment scripts.
- Contribute to platform modernization initiatives, including infrastructure upgrades and adoption of new data technologies.
- Collaborate with client teams, analysts, and stakeholders to gather requirements and deliver solutions.
MUST HAVES
- 3-4 years of experience in data engineering or a closely related software engineering role.
- Strong SQL, including complex joins, window functions, and dimensional / star-schema modeling.
- Strong Python programming skills.
- Hands-on Apache Airflow experience (DAGs, operators, scheduling, and troubleshooting failed jobs).
- Working knowledge of ETL patterns and cloud data warehouse design (Amazon Redshift or similar: Snowflake, BigQuery, Synapse).
- Git and GitLab (or GitHub/Bitbucket) for day-to-day version control.
- Docker / Docker Compose.
- Understanding of data management concepts.
- Ability to translate client and business requirements into SQL, configuration, and DAG changes.
- Upper-intermediate English level.
NICE TO HAVES
- Familiarity with Tableau / Tableau Server REST API and/or PowerBI and associated APIs a plus.
- Familiarity with Spark.
- Familiarity with Amazon Redshift or another columnar warehouse.
PERKS AND BENEFITS
- Growth without limits: build your skills through mentorship, internal TechTalks, challenging projects, and a dedicated annual learning budget
- Competitive compensation: get recognition that reflects your skills and impact, with regular performance and compensation reviews
- Flexibility: work 100% remotely with flexible hours that support focus, autonomy, and a healthy work rhythm
- Meaningful, modern projects: build impactful products using modern technologies alongside global teams and leading brands
- Collaborative culture: join a supportive environment with zero micromanagement where ideas are welcomed and contributions are recognized
- Well-being & support: access local well-being programs and people-focused support tailored to your location
Skills Required
- 3-4 years of experience in data engineering or a closely related software engineering role
- Strong SQL skills, including complex joins, window functions, and dimensional or star-schema modeling
- Strong Python programming skills
- Hands-on Apache Airflow experience with DAGs, operators, scheduling, and troubleshooting failed jobs
- Working knowledge of ETL patterns and cloud data warehouse design, such as Amazon Redshift, Snowflake, BigQuery, or Synapse
- Experience using Git and GitLab, GitHub, or Bitbucket for version control
- Experience with Docker or Docker Compose
- Understanding of data management concepts
- Ability to translate client and business requirements into SQL, configuration, and DAG changes
- Upper-intermediate English proficiency
- Familiarity with Tableau, Tableau Server REST API, Power BI, and associated APIs
- Familiarity with Spark
- Familiarity with Amazon Redshift or another columnar warehouse
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
AgileEngine is a privately held company established in 2010 that builds dedicated teams of designers and developers. We turn good ideas into awesome software that people actually want to use. Some of the biggest names and the hottest startups around the world chose us to build their tech.
