Senior Data Engineer

Posted 3 Days Ago
Be an Early Applicant
3 Locations
In-Office
Senior level
Artificial Intelligence • Big Data • Machine Learning
The Role
Designs and builds Azure-based data pipelines, streams, hybrid data solutions, and terabyte-scale ingestion systems. Develops production-quality code for distributed ML workflows, troubleshoots complex systems, optimizes SQL, and supports data solution modernization. Responsibilities include technical documentation, deployment, post-production support, testing, migration coordination, and collaboration with architects, analysts, engineers, vendors, and business teams.
Summary Generated by Built In

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Job Description:


Role: Senior Data Engineer - Azure 

Experience Level: 4 to 7 Years 

Work location: Mumbai, Bangalore & Trivandrum 

Notice Period:0-15 days(Only candidate serving NP)


Role & Responsibilities: 


● Support the planning and implementation of data flow design, provide sizing and configuration assistance.

 ● Assisting the Solution Architects on programs for transformations and modernizations of data solutions using Azure cloud data technologies. 

● Write production quality code to deploy ML workflows in a distributed environment. 

● Design and Build Azure Data Pipelines and Data StreamsDesign and build a hybrid data solution using a combination of on-premise and in-cloud services. 

● Diagnose and troubleshoot complex distributed systems problems and develop solutions with a significant impact on our massive scale. 

● Build tools to ingest and process terabyte-scale data on a daily basis. 

● Communicate with a wide set of teams, including product owners, business analysts, data and enterprise architects, platform engineers, and cloud vendors, etc. 

● Compilation of detailed design documents, technical specification documents, and test plans as required.

● Independently manage development tasks as per technical specification documents, prod deployment, post-prod support, etc 

● Managing support to Unit Testing, SIT & UAT. 

● Coordinate with business and support teams on testing and migration activities.


Skills expectation: 


● A strong hands-on knowledge of Spark/Pyspark. 

● Expertise in writing SQL queries and performance optimization. 

● Strong hands-on experience with a programming language like Python(preferred), java, or scala.

● Prior experience with working on cloud platforms like Azure(preferred) , AWS or GCP

● Prior experience of ADF is a plus. 

● DataBricks experience is good to have. 

● Data Warehouse: Snowflake or Synapse 

● Design Dimensional Models for Data Warehouse and Data Marts. 

● Knowledge of version control systems and build automation tools like Azure DevOps and/or MLOps

● Experience with operating system internals, file systems, disk/storage technologies, and storage Protocol.


If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Skills Required

  • 4 to 7 years of professional experience
  • Strong hands-on knowledge of Apache Spark and PySpark
  • Expertise writing SQL queries and optimizing query performance
  • Strong hands-on experience with Python, Java, or Scala
  • Prior experience with a cloud platform such as Azure, AWS, or GCP
  • Experience with Azure Data Factory
  • Experience with Databricks
  • Experience with Snowflake or Azure Synapse
  • Ability to design dimensional models for data warehouses and data marts
  • Knowledge of version control and build automation tools such as Azure DevOps or MLOps
  • Experience with operating system internals, file systems, disk and storage technologies, and storage protocols
  • Ability to serve candidates with a 0 to 15 day notice period

Quantiphi Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Quantiphi and has not been reviewed or approved by Quantiphi.

  • Wellbeing & Lifestyle Benefits — Wellbeing initiatives such as monthly meeting-free AMA-Zen Days, health check-ups, and wellness counseling are designed to reduce burnout and support day-to-day balance. Broader wellness programs reinforce both physical and mental health.
  • Flexible Benefits — Remote/hybrid options with flexible working hours provide meaningful autonomy over where and when work gets done. Flexible leave constructs, including sabbaticals and special day leaves, add practical adaptability to the package.
  • Parental & Family Support — Paid parental leave in the U.S., alongside maternity and childcare support, signals solid backing for families. These family-oriented policies integrate with a wider health and wellness focus.

Quantiphi Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Marlborough, MA
3,494 Employees
Year Founded: 2013

What We Do

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business. Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve quantifiable business impact at unprecedented speed.

Similar Jobs

Mastercard Logo Mastercard

Senior Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Maharashtra, IND
38800 Employees

BlackRock Logo BlackRock

Senior Data Engineer

Fintech • Information Technology • Financial Services
In-Office
Mumbai, Maharashtra, IND
25000 Employees

Mastercard Logo Mastercard

Senior Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Maharashtra, IND
38800 Employees

MetLife Logo MetLife

Big Data Engineer

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
Pune, Maharashtra, IND
43000 Employees

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account