Senior Data Engineer

Posted 3 Hours Ago
Be an Early Applicant
Hyderabad, Telangana, IND
In-Office
Senior level
Information Technology • Consulting • Cybersecurity
The Role
Designs and maintains scalable Snowflake ETL/ELT pipelines, SnapLogic integrations, and dbt transformation models. Responsibilities include dimensional and medallion architecture, performance and cost optimization, data quality, governance, CI/CD, documentation, and responsible use of AI-assisted development tools. Partners with analytics teams, mentors junior engineers, and helps establish reusable AI workflows and engineering standards.
Summary Generated by Built In
ABOUT THE ROLE

Data Engineering team is looking for a Senior Data Engineer who combines strong data engineering fundamentals with a genuine curiosity for using AI tools to work smarter, not just harder. You will design and build scalable data pipelines and models on Snowflake, orchestrate integrations through SnapLogic, and use dbt to bring rigor and testability to our transformation layer — while also actively exploring how AI copilots and agentic tools can speed up development, debugging, documentation, and data quality work.

This is not an “AI engineer” role — it is a data engineering role for someone who is already fluent with tools like Cortex, GitHub Copilot, Claude, or ChatGPT in their daily workflow and sees them as a natural extension of good engineering practice, not a gimmick.

WHAT YOU'LL DO

  • Design, build, and maintain robust ETL/ELT pipelines feeding a Snowflake-based data platform
  • Build and manage integrations using SnapLogic to connect source systems, APIs, and downstream consumers
  • Develop and maintain data models and transformations in dbt, including tests, documentation, and CI/CD-based deployment
  • Design dimensional and/or medallion-style (Bronze/Silver/Gold) data architectures that balance performance, cost, and usability
  • Use AI-assisted tools to accelerate development — generating boilerplate code, drafting SQL/dbt models, writing documentation, debugging pipeline failures, and summarising data quality issues
  • Partner with data quality, governance, and analytics teams to ensure data is well-modelled, well-documented, and trustworthy
  • Optimise Snowflake warehouse performance and cost (query tuning, clustering, resource monitors)
  • Write clean, tested, version-controlled code and contribute to CI/CD pipelines
  • Mentor junior engineers, including on how to use AI tools responsibly and effectively (e.g., reviewing AI-generated code, not blindly trusting output)
  • Contribute to internal standards for prompt patterns, reusable AI workflows, or tooling that make the whole team faster

CORE SKILLS

  • Snowflake — strong hands-on experience with data modelling, performance tuning, security/access, and cost management
  • SnapLogic — building and maintaining integration pipelines and connecting heterogeneous source systems
  • dbt — writing modular, tested transformations; managing dependencies, macros, and documentation
  • Data Modelling — dimensional modelling, medallion/layered architectures, normalisation vs. denormalisation trade-offs
  • Strong SQL and at least one scripting language (Python preferred)
  • Familiarity with orchestration tools (Airflow, ADF, or similar)
  • Working knowledge of git-based CI/CD workflows

AI-AUGMENTED WORKING STYLE (WHAT WE'RE LOOKING FOR)

  • Regularly uses AI coding assistants (Copilot, Claude Code, Cursor, ChatGPT, etc.) as part of the daily workflow — not just for one-off snippets
  • Comfortable prompting AI tools for tasks like generating dbt models, writing test cases, summarising data quality issues, or drafting documentation
  • Applies good judgement about when AI output needs review vs. can be trusted — treats AI as a fast first draft, not a final answer
  • Curious about applying AI to structural problems: pipeline debugging, anomaly detection, metadata generation, code review support
  • Comfortable working in an environment where AI-usage practices are still evolving, and contributes ideas to shape them

NICE TO HAVE

  • Experience with data quality tooling (SODA, Collibra, or similar)
  • Exposure to cloud platforms (Azure, AWS, or GCP)
  • Experience in a regulated or enterprise-scale data environment
  • Prior experience mentoring or leading a small pod of engineers

EXPERIENCE

  • 8+ years in data engineering, with at least 4+ years focused on Snowflake and modern ELT tooling (dbt)
  • Track record of delivering production-grade pipelines at scale

Skills Required

  • 8+ years of experience in data engineering
  • At least 4 years of experience with Snowflake and modern ELT tooling, including dbt
  • Production-grade pipeline delivery experience at scale
  • Strong hands-on Snowflake experience in data modeling, performance tuning, security and access, and cost management
  • Experience building and maintaining SnapLogic integration pipelines
  • Experience developing modular, tested dbt transformations with dependencies, macros, and documentation
  • Experience with dimensional modeling and medallion or layered data architectures
  • Strong SQL skills
  • At least one scripting language; Python preferred
  • Familiarity with orchestration tools such as Airflow or Azure Data Factory
  • Working knowledge of Git-based CI/CD workflows
  • Experience with data quality tooling such as SODA or Collibra
  • Exposure to Azure, AWS, or GCP
  • Experience in a regulated or enterprise-scale data environment
  • Prior experience mentoring or leading a small engineering pod
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dallas, TX
167 Employees
Year Founded: 1998

What We Do

For over 24 years Prudent Technologies & Consulting has been helping customers secure the technical and functional resources needed to deliver mission-critical IT & Business initiatives. What started as an IT Consulting company providing premium IT staffing services on a contract, contract-to-hire, and direct hire basis in the US, has grown to include full service IT Consulting specialty practices in three key technology verticals: Data Sciences, Cybersecurity, and Enterprise CRM. Prudent’s specialty practices are built on strong partnerships with best of breed technology firms, including Salesforce, Splunk, Cylance, McAfee, Symantec, and Databricks. At Prudent we pride ourselves on our ability to tailor the best solution to meet our customer’s needs. From augmenting an IT team with a qualified consultant, to delivering an end to end software solution, our goal is always to help our customers execute critical business and IT initiatives. We are always on the lookout for innovators! We strive to hire the best people to work on our exciting projects and teams. We offer our staff a great compensation package, work-life balance, benefits, 401K, holidays, PTO, career paths, teamwork, awards & recognition and much more. WINNER: Dallas Business Journal’s - 2015 Best Place to Work! Come join the Prudent family and let’s have fun creating innovative solutions for our clients!

Similar Jobs

Mastercard Logo Mastercard

Senior Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Hyderabad, Telangana, IND
38800 Employees
In-Office
Hyderabad, Telangana, IND
951 Employees

Ciklum Logo Ciklum

Senior Data Engineer

Information Technology • Consulting
Remote or Hybrid
India
2995 Employees

Mastercard Logo Mastercard

Senior Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Hyderabad, Telangana, IND
38800 Employees

Similar Companies Hiring

NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account