Senior Data Engineer - DBT

Posted Yesterday
Be an Early Applicant
3 Locations
In-Office
Senior level
Artificial Intelligence • Big Data • Machine Learning
The Role
Build and optimize large-scale AWS data engineering solutions, including batch and streaming pipelines, Lakehouse architectures, and Redshift analytics. Develop with DBT, SQL, Python, and Spark/PySpark; optimize Apache Iceberg and Aurora PostgreSQL. Implement data modeling, monitoring, observability, quality controls, CI/CD, and production support while collaborating with stakeholders. Preferred experience includes AWS certification, Terraform, Kafka, ClickHouse, GenAI coding assistants, Docker, Kubernetes, and telecom domains.
Summary Generated by Built In

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

JOB ROLE : Senior Data Engineer

Experience : 4-7 Years

Location : Mumbai/Bangalore

Must have Primary skills:

  • 3+ years of hands-on experience building large-scale AWS data engineering solutions.

  • Strong hands-on experience with DBT(Cloud+Core).(highly recommended skill)

  • Hands-on expertise into Redshift warehouse and Analytics.

  • Strong hands-on expertise in SQL (analytical queries, window functions, stored procedures), Spark/PySpark, Python.

  • Hands-on experience designing and implementing Lakehouse solutions using Apache Iceberg.

  • Strong knowledge of AWS services including SMUS, EC2, DynamoDB, API Gateway, MWAA, EMR, S3, Athena, Glue Catalog, Aurora PostgreSQL, Lambda, CloudWatch, SQS, SNS, EventBridge, Secrets Manager, CloudWatch and IAM.

  • Experience building scalable batch and streaming data pipelines on AWS.

  • Strong experience in Spark/PySpark performance tuning and optimization.

  • Hands-on experience optimizing Apache Iceberg and Aurora PostgreSQL for performance and scalability.

  • Strong understanding of data modeling, partitioning, file formats, and Lakehouse/Data Lake architectures.

  • Experience implementing monitoring, logging, alerting, and observability for production data pipelines.

  • Strong knowledge of data quality, troubleshooting, debugging, and production support.

  • Experience with CI/CD, Git, and data engineering best practices.

  • Strong communication, problem-solving, and stakeholder management skills.

  • AWS Data Engineer Associate or equivalent AWS Certification is preferred.

Good to have skills : 

  • Experience with AWS Step Functions.

  • Experience with Terraform or Infrastructure as Code.

  • Exposure to Kafka, Hive, HDFS or other Big Data technologies.

  • Hands-on experience using GenAI-assisted development tools such as Kiro, Copilot,Cursor, or similar AI coding assistants to improve engineering productivity. 

  • Experience with ClickHouse Database

  • Telecom/Mobile Network domain knowledge is preferred.

  • Experience and knowledge of Atscale design and development.

  • knowledge of Docker and Kubernetes.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Skills Required

  • 3+ years of hands-on experience building large-scale AWS data engineering solutions
  • Strong hands-on experience with DBT Cloud and DBT Core
  • Hands-on expertise with Redshift data warehousing and analytics
  • Strong expertise in SQL, Spark/PySpark, and Python
  • Experience designing and implementing Lakehouse solutions using Apache Iceberg
  • Strong knowledge of AWS services including SMUS, EC2, DynamoDB, API Gateway, MWAA, EMR, S3, Athena, Glue Catalog, Aurora PostgreSQL, Lambda, CloudWatch, SQS, SNS, EventBridge, Secrets Manager, and IAM
  • Experience building scalable batch and streaming data pipelines on AWS
  • Strong experience in Spark/PySpark performance tuning and optimization
  • Experience optimizing Apache Iceberg and Aurora PostgreSQL for performance and scalability
  • Strong understanding of data modeling, partitioning, file formats, and Lakehouse/Data Lake architectures
  • Experience implementing monitoring, logging, alerting, and observability for production data pipelines
  • Strong knowledge of data quality, troubleshooting, debugging, and production support
  • Experience with CI/CD, Git, and data engineering best practices
  • Strong communication, problem-solving, and stakeholder management skills
  • AWS Data Engineer Associate or equivalent AWS Certification
  • Experience with AWS Step Functions
  • Experience with Terraform or Infrastructure as Code
  • Exposure to Kafka, Hive, HDFS, or other Big Data technologies
  • Hands-on experience using GenAI-assisted development tools such as Kiro, Copilot, Cursor, or similar AI coding assistants
  • Experience with ClickHouse Database
  • Telecom or mobile network domain knowledge
  • Experience and knowledge of Atscale design and development
  • Knowledge of Docker and Kubernetes

Quantiphi Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Quantiphi and has not been reviewed or approved by Quantiphi.

  • Wellbeing & Lifestyle Benefits Wellbeing initiatives such as monthly meeting-free AMA-Zen Days, health check-ups, and wellness counseling are designed to reduce burnout and support day-to-day balance. Broader wellness programs reinforce both physical and mental health.
  • Flexible Benefits Remote/hybrid options with flexible working hours provide meaningful autonomy over where and when work gets done. Flexible leave constructs, including sabbaticals and special day leaves, add practical adaptability to the package.
  • Parental & Family Support Paid parental leave in the U.S., alongside maternity and childcare support, signals solid backing for families. These family-oriented policies integrate with a wider health and wellness focus.

Quantiphi Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Marlborough, MA
3,494 Employees
Year Founded: 2013

What We Do

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business. Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve quantifiable business impact at unprecedented speed.

Similar Jobs

Hybrid
2 Locations
289097 Employees
Hybrid
Mumbai, Maharashtra, IND
289097 Employees

BlackRock Logo BlackRock

Associate, Private Markets and Alternative Operations

Fintech • Information Technology • Financial Services
In-Office
Mumbai, Maharashtra, IND
25000 Employees

Capco Logo Capco

Data Engineer

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Hybrid
Pune, Maharashtra, IND
6000 Employees

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account