Senior Data Engineer

Reposted 3 Days Ago
Hiring Remotely in USA
Remote
Senior level
Artificial Intelligence • Big Data • Machine Learning
The Role
As a Senior Data Engineer, you will design and maintain scalable data pipelines using PySpark and SQL, optimizing data systems in cloud environments to support analytics and decision-making.
Summary Generated by Built In

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

About Quantiphi:

Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed.

Quantiphi has seen 2.5x growth YoY since its inception in 2013, we don’t just innovate - we lead. Headquartered in Boston, with 4,000+ Quantiphi professionals across the globe. As an Elite/Premier Partner for Google Cloud, AWS, NVIDIA, Snowflake, and others, we’ve been recognized with:

  • 17x Google Cloud Partner of the Year awards in the last 8 years.

  • 3x AWS AI/ML award wins.

  • 3x NVIDIA Partner of the Year titles.

  • 2x Snowflake Partner of the Year awards.

  • We have also garnered top analyst recognitions from Gartner, ISG, and Everest Group.

  • We offer first-in-class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting-edge Generative AI and Agentic AI accelerators.

  • We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.

Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. Your next big opportunity starts here!

For more details, visit: Website or LinkedIn Page.

Experience Level: 8+ years of experience  

Work Location: Atlanta, GA (Preferred)/ Anywhere in USA or Canada

About the Role:

As a Senior Data Engineer, you will play a key role in designing, building, and maintaining scalable data pipelines that power analytics, insights, and business decision-making. You will work across both batch and streaming architectures, leveraging PySpark, SQL, and modern data engineering frameworks to deliver reliable, high-performance data solutions.

What Success Look Like:

  • Design, develop, and maintain scalable batch and streaming data pipelines using PySpark, SQL, and modern data engineering frameworks.

  • Perform deep-dive analysis into complex source systems to define extraction patterns, transformation logic, and integration workflows.

  • Implement data models optimized for analytics, performance, and operational excellence.

  • Build and manage data systems across AWS or GCP cloud environments, ensuring reliability, scalability, and cost efficiency.

  • Lead and participate in design reviews, provide mentorship to junior engineers, and take ownership of code quality and engineering best practices.

  • Collaborate with cross-functional teams including architects, analysts, product, and platform engineers to deliver high-quality data solutions.

  • Troubleshoot performance bottlenecks, optimize data processing workflows, and improve pipeline robustness.

Essential Skills/Qualifications:

  • 8+ years of experience in data engineering or a related field.

  • Strong expertise in PySpark, SQL, and data modeling for high-volume datasets.

  • Hands-on experience building and optimizing data pipelines in AWS or GCP environments.

  • Track record of working with complex source systems and developing accurate extraction and transformation logic.

  • Proven experience in mentoring engineers, performing code reviews, and leading technical design discussions.

  • Solid understanding of distributed computing, data partitioning, and performance tuning.

Nice to haves: 

  • Expert-level knowledge of Azure and Databricks architecture, including Lakehouse patterns and the Medallion Framework.

  • Familiarity with Delta Lake, orchestration tools, or Unity Catalog.

  • Experience with CI/CD for data pipelines and automated testing frameworks.

What We Offer:

  • Join a high-growth, AI-first digital engineering and transformation company

  • Work with Fortune 500 clients and cutting-edge market disruptors

  • Collaborate with a talented, dynamic, and driven team

  • Gain exposure to the latest technologies in AI, ML, cloud, and data engineering

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Top Skills

AWS
Azure
Databricks
Delta Lake
GCP
Pyspark
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Marlborough, MA
3,494 Employees
Year Founded: 2013

What We Do

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business.
Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve quantifiable business impact at unprecedented speed.

Similar Jobs

Applied Systems Logo Applied Systems

Data Engineer

Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Remote or Hybrid
United States
3000 Employees
60K-160K Annually

Unchained Logo Unchained

Senior Data Engineer

Blockchain • Fintech • Financial Services • Cryptocurrency
Remote
United States
145 Employees

Centerfield Logo Centerfield

Senior Data Engineer

Artificial Intelligence • Big Data • Consumer Web • Digital Media • Marketing Tech
Remote or Hybrid
United States
1570 Employees
100K-150K Annually

Milestone Systems Logo Milestone Systems

Artificial Intelligence Engineer

Artificial Intelligence • Other • Security • Software • Analytics • Big Data Analytics
Remote or Hybrid
2 Locations
1500 Employees
175K-195K Annually

Similar Companies Hiring

Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account