Solutions Engineer - Data Engineering

Posted 3 Days Ago
Be an Early Applicant
Hyderabad, Telangana, IND
Hybrid
Mid level
Artificial Intelligence • Big Data • Cloud • Software • Analytics • Infrastructure as a Service (IaaS) • Big Data Analytics
Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life.
The Role
Deliver and architect Apache Airflow implementations on the Astronomer platform for customers. Advise on Airflow best practices, refactor DAGs, optimize workflows and system configuration, prototype solutions, and feed product feedback from client engagements.
Summary Generated by Built In

Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than 800 of the world's leading enterprises, Astronomer lets businesses do more with their data. To learn more, visit www.astronomer.io.

About this role:

As a Solutions Engineer - Data Engineering, you will be part of the Global Services Delivery Team and will be involved in the delivery of the various use cases in which Airflow is implemented across our customers. These organizations range from seed-stage startups to Fortune 500 enterprises. Although these organizations are in different phases of their data journey, they all can benefit from your expertise as a Solutions Engineer to implement Apache Airflow in a manner that follows best practices and allows continued growth.

In this role, you will come to have a deep understanding of both Apache Airflow and Astronomer Products.

Every Solutions Engineer will grow to become an Airflow expert and a trusted advisor to organizations looking to put their data in motion.

Hybrid Work Model: For this role, you will embrace a flexible hybrid work model, working at least 3 days per week at our Office in Hyderabad while delivering a seamless experience that is digitally and physically connected.

What You Get To Do

You'll be able to speak to and deliver solutions around Apache Airflow and the Astronomer platform. You'll interact with customers and partners to ensure successful Airflow implementation post-sales. You'll be a trusted advisor and help architect data pipelines across all types of environments and use cases. Last but not least, you'll have the opportunity to engage with the Apache Airflow project, a thriving open-source community with thousands of contributors.

 
  • Maintain and continuously improve your technical expertise. You will become a trusted expert in both Airflow and Astronomer’s managed Airflow Platform. You stay up to date with the latest releases and features while focusing on those that have a greater impact on customers.

  • Work with customers to educate and guide them regarding Airflow best practices. Perform Airflow code refactoring assessments as a trusted expert for new and existing customers.

  • Architect and implement scalable data engineering frameworks and solutions using Apache Airflow for Astronomer customers.

  • Familiarity with AI-assisted development practices to accelerate coding, testing, documentation, troubleshooting, and solution prototyping while maintaining engineering quality, security, and human oversight.

  • Act as a liaison by collecting feedback and identifying Airflow/Astronomer improvements through client interactions and relaying these recommendations back to the Product.

  • Review and optimize customer data workflows and Airflow system configurations for improved performance.

What You Bring To The Role

  • 3-5 years of data-engineering experience, ideally working with Apache Airflow in production environments

  • Experience creating DAGs, writing Python, and building Airflow custom operators and hooks

  • Excitement about implementing ETL/ELT pipelines, knowledge of applying Data transformations, optimizing and monitoring data pipelines

  • Experience with related market products such as Cloudera, Databricks, Snowflake, DBT, AWS, Azure, Google Cloud, ETL Technologies or other analytics solutions

  • Empathetic, driven and team-oriented

  • Great prioritization skills and ability to execute on customer-facing activities

  • A strong verbal and written communicator interacting with assigned customers over a variety of mediums (slack, email, knowledge transfer, and pair programming sessions).

  • Highly data-driven and intrigued by the challenge of delivering an awesome Astronomer experience to hundreds of customers

Bonus points if you have:

  • Experienced with Production implementation of ETL/ELT processes using Modern Data Stack.

  • Experience building and maintaining CI/CD pipelines

  • Experience working on short and long-term Customer engagements

  • Experience with infrastructure tools like Docker and Kubernetes

#LI-Fulltime

#LI-Hybrid

At Astronomer, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Skills Required

  • 3-5 years of data engineering experience, ideally with Apache Airflow in production
  • Experience creating DAGs, writing Python, and building Airflow custom operators and hooks
  • Experience implementing ETL/ELT pipelines, data transformations, and monitoring/optimizing data pipelines
  • Experience with related technologies: Cloudera, Databricks, Snowflake, dbt, AWS, Azure, Google Cloud, or other analytics solutions
  • Strong verbal and written communication, customer-facing skills, prioritization and collaboration
  • Experience with production ETL/ELT using Modern Data Stack
  • Experience building and maintaining CI/CD pipelines
  • Experience with Docker and Kubernetes
  • Experience working on short and long-term customer engagements
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, New York
344 Employees
Year Founded: 2018

What We Do

Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than 800 of the world's leading enterprises, Astronomer lets businesses do more with their data. To learn more, visit www.astronomer.io. Apache® and Apache Airflow® are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. No endorsement by the Apache Software Foundation is implied by the use of these marks. All other trademarks are the property of their respective owners.

Similar Jobs

Hybrid
Hyderabad, Telangana, IND
289097 Employees
Hybrid
2 Locations
289097 Employees

The Aerospace Corporation Logo The Aerospace Corporation

Software Engr I

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
Hyderabad, Telangana, IND
4600 Employees
Hybrid
Hyderabad, Telangana, IND
289097 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account