Staff Data Engineer (PySpark)

Reposted 13 Days Ago
Hiring Remotely in USA
Remote
208K-235K Annually
Senior level
Artificial Intelligence • eCommerce • Software
The Role
We are looking for a Staff Data Engineer to design data infrastructure, build processing pipelines, and mentor engineers, focusing on high performance and analytics.
Summary Generated by Built In

About Us

Wizard is the top-performing AI Shopping Agent, delivering the best products from across the web with unmatched accuracy, quality, and trust. 

The Role

We are seeking a Staff Data Engineer with deep expertise in PySpark to join our data team. This is a hands-on technical role for someone passionate about building scalable data systems, mentoring engineers and shaping data strategy.  You’ll architect systems that power high performance batch and real time data processing, enable advanced analytics and accelerate our AI initiatives.

Key Responsibilities:

  • Design and evolve scalable, distributed data infrastructure across cloud platforms
  • Build and maintain real time and batch data processing pipelines supporting analytics and AI/ML workloads
  • Develop and manage integrations with third party e-commerce platforms to expand our data ecosystem
  • Ensure data availability, reliability and quality through monitoring and automated auditing
  • Partner with engineering, AI and product teams on data solutions for business critical needs
  • Mentor and support data engineers, establishing best practices and code quality standards 

You

  • 5+ years of software development and data engineering experience with demonstrated ownership of production grade data infrastructure
  • Bachelor's degree in Computer Science or a related field, or equivalent practical experience.
  • Deep expertise scaling Spark in production (Databricks, EMR, etc)
  • Strong understanding of distributed computing and modern data modeling for scalable systems
  • Proficient in Python with experience implementing software engineering best practices
  • Hands-on experience with both relational (MySQL / PostgreSQL) and NoSQL (MongoDB, DynamoDB, Cassandra) databases
  • Strong communicator with experience influencing cross functional stakeholders

Nice to Have:

  • Experience working in early-stage, high-growth environments
  • Familiarity with MLOps pipelines and integrating ML models into data workflows.
  • Passionate about problem-solving with a proactive approach to finding innovative solutions.

The expected salary for this role is $208,000 - $235,000 depending on experience and level

Top Skills

Cassandra
Databricks
DynamoDB
Emr
MongoDB
MySQL
Postgres
Python
Spark
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York City, New York
77 Employees
Year Founded: 2021

What We Do

Wizard AI is powering the future of commerce through conversation. Our full-service B2B solution empowers brands to sell, market, and engage their customers directly via text, resulting in conversion rates 10x higher than ecommerce.

Cofounded by Marc Lore, Wizard is backed by a $50M Series A round led by NEA and Accel, and is on a mission to build the dominant technology in the space. We're hiring the best talent and we'd love for you to join us! We’re proud of our commitment to diversity and inclusivity—and we invest in your career by creating a workplace that values transparency and flexibility, and offers remote/hybrid work options. To learn more about Wizard, review our open roles, or request a demo, visit www.wizard.com. We'd love to hear from you!

Similar Jobs

KPA Logo KPA

Director of Marketing

Automotive • Greentech • HR Tech • Sales • Software
Easy Apply
Remote or Hybrid
Westminster, CO, USA
405 Employees
150K-170K Annually

General Motors Logo General Motors

Software Engineer

Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
United States
165000 Employees

Brigit Logo Brigit

Customer Care Associate (Remote)

Fintech • Mobile • Social Impact • Financial Services
Remote or Hybrid
IN, USA
124 Employees
45K-48K Annually

NBCUniversal Logo NBCUniversal

Director, Cyber Governance and Controls

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Remote or Hybrid
New York, NY, USA
68000 Employees
155K-200K Annually

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account