The Role
Build and manage data pipelines, ETL workflows, and DAGs using dbt, Apache Airflow, Python, SQL, and Snowflake. Develop custom Airflow operators and hooks, perform data modeling and source-to-target mapping, and implement data quality and cleansing processes. Use cloud platforms, CI/CD, version control, and Snowflake utilities including Snowpipe, Tasks, Streams, stored procedures, and data sharing. Collaborate across teams, communicate insights, solve complex problems, and participate in on-call escalation.
Summary Generated by Built In
This is a remote position.
8+ years of hands-on experience in software development, with a bachelor’s degree in a relevant field of study
● Experience creating DAGs, building Airflow custom operators and hooks.
● Strong knowledge of cloud technologies and distributed computing, specifically with Azure or Google Cloud Platform (GCP) or AWS
● Solid background and hands-on experience in Business Intelligence (BI), Data Warehousing, and ETL projects
● In-depth experience with Python and SQL, foundational technologies essential for data processing and manipulation
● Experience using version control, CI/CD, and automation tools
● Experience with data quality and data cleansing
Strong verbal and written communication abilities, capable of conveying technical concepts to both technical teams and non-technical stakeholders. Ability to summarise complex analyses into actionable business insights
● A proactive, curious mindset with a creative approach to problem-solving and a willingness to participate in an on-call escalation rotation as needed
● Excellent collaboration skills with a focus on building strong, effective relationships across teams ● Strong on DBT with Snowflake SQL. ● Snowflake SQL Writing SQL queries against Snowflake Developing scripts, Python, etc. to do Extract, Load, and Transform data. ● Hands-on experience with Snowflake utilities such as Snow SQL, Snow Pipe, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures. ● Complex problem-solving capability. ● Hands-on experience with Apache Airflow for orchestrating complex data workflows. ● Must be analytic, creative and self-motivated. ● ETL tool DBT, Advanced SQL along with good Python scripting skill Data Modelling and source to target mapping skills. ● Excellent SQL coding skills.
Skills Required
- 8+ years of hands-on software development experience
- Bachelor's degree in a relevant field of study
- Experience creating DAGs and building Apache Airflow custom operators and hooks
- Strong knowledge of cloud technologies and distributed computing with Azure, Google Cloud Platform, or AWS
- Hands-on experience with Business Intelligence, data warehousing, and ETL projects
- In-depth experience with Python and SQL
- Experience using version control, CI/CD, and automation tools
- Experience with data quality and data cleansing
- Strong dbt experience with Snowflake SQL
- Hands-on experience with Snowflake utilities, including SnowSQL, Snowpipe, Tasks, Streams, Time Travel, Optimizer, Metadata Manager, data sharing, and stored procedures
- Advanced SQL and strong SQL coding skills
- Good Python scripting skills for extracting, loading, and transforming data
- Data modeling and source-to-target mapping skills
- Strong verbal and written communication skills
- Ability to communicate technical concepts to technical and non-technical stakeholders
- Ability to summarize complex analyses into actionable business insights
- Excellent collaboration and relationship-building skills
- Willingness to participate in an on-call escalation rotation
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Blackbuck Insights is a global data and AI consultancy providing data engineering services, cloud modernization, AI activation, and platform operations. The company helps enterprises modernize legacy environments, migrate and scale data platforms, build AI-enabled business applications, and establish trusted data foundations for analytics and intelligent decision-making. Its services support organizations seeking reliable, performant, and scalable technology solutions.
.jpg){kind=logo}
