Senior Data Engineer - Databricks

Posted 2 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka
3-5 Years Experience
Artificial Intelligence • Big Data • Machine Learning
The Role
Senior Data Engineer role at Quantiphi focusing on delivering big data solutions using Pyspark, SQL, and various AWS services. Must have experience in cloud-based solutions, SQL optimization, and Databricks. Good to have skills include data migration and Redshift optimization.
Summary Generated by Built In

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Must have skills:

  • 3+ years’ of hands-on experience in delivering big data solutions

  • Experience with AWS - EMR, Redshift, Lambda, DynamoDB, S3, RDS, SQS, Glue

  • Experienced in using Airflow or Step Functions for orchestration 

  • Experience using Pyspark APIs and Inbuild functions

  • Experience building and deploying cloud-based solutions at scale

  • Experience in SQL and Query optimisation

Good to have skills : 

  • Prior experience in migrating (on-prem to cloud) and processing large amounts of data

  • Experience in implementing transactional data lake on the cloud using Hudi, Iceberg, or Delta Lake tables

  • Experience in Redshift optimization and implementing the industry's best practices

  • Experience in data loading to Redshift, heavy upserts, and WLM expertise 

  • Experience in Databricks

  • Experience with Snowflake Data Warehouse

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Top Skills

Pyspark
SQL
The Company
HQ: Marlborough, MA
3,494 Employees
On-site Workplace
Year Founded: 2013

What We Do

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business.
Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve quantifiable business impact at unprecedented speed.

Jobs at Similar Companies

MassMutual India Logo MassMutual India

Data Engineer

Big Data • Fintech • Information Technology • Insurance • Financial Services
Hyderabad, Telangana, IND

Smartcat Logo Smartcat

Product Manager, Integrations

Artificial Intelligence • Machine Learning • Natural Language Processing • Conversational AI
Remote
28 Locations
220 Employees

Halter Logo Halter

Experienced Mechanical Engineer

Hardware • Information Technology • Internet of Things • Machine Learning • Software • Business Intelligence • Agriculture
Easy Apply
Hybrid
Auckland, NZL
150 Employees

Similar Companies Hiring

Smartcat Thumbnail
Natural Language Processing • Machine Learning • Conversational AI • Artificial Intelligence
Boston, Massachusetts
220 Employees
Halter Thumbnail
Software • Machine Learning • Internet of Things • Information Technology • Hardware • Business Intelligence • Agriculture
Auckland City, NZ
150 Employees
MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, Telangana

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account