We are looking for a highly experienced and forward-thinking Data Engineer to join our Enterprise Data Systems team, which drives reporting, analytics, and data science capabilities for numerous teams across the organization. In this key role, you will be responsible for designing and building a state-of-the-art data platform that will serve as the foundation for data processing and analysis for the foreseeable future. The ideal candidate will bring extensive experience in developing large-scale data ingestion and processing frameworks, coupled with a strong command of data engineering best practices, while also providing strategic leadership and mentorship to the team.
Key Responsibilities:
- Lead the design, development, and optimization of scalable, efficient, and reusable data ingestion and processing frameworks using Spark and Spark Streaming.
- Architect, implement, and manage data pipelines using a variety of tools, including Kafka, Kinesis, Airflow, and AWS services such as Glue, EMR, S3, SQS, SNS, and Step Functions.
- Guide and mentor the data engineering team, setting best practices, technical guidelines, and guardrails to ensure high-quality data solutions.
- Collaborate with cross-functional teams, including data science and analytics, to design and build data platforms that support the organization's evolving data needs.
- Ensure data quality, observability, and governance by implementing best-in-class practices for data auditing, validation, and monitoring.
- Hands-on experience working with data warehouse platforms such as Snowflake, Redshift, and relational databases like DynamoDB and PostgreSQL.
- Develop and manage orchestration pipelines using Airflow to optimize job scheduling and improve operational efficiency.
- Drive innovation by evaluating new data tools, technologies, and frameworks to enhance the company's data infrastructure.
- Implement and maintain CI/CD pipelines and infrastructure-as-code using Terraform for fast, efficient deployments.
- Collaborate on cloud architecture decisions and drive the use of AWS services to manage large-scale data processing.
- Partner with stakeholders across the organization to understand their data needs and deliver reliable, high-quality data products.
Qualifications:
- Proven experience as a Lead Data Engineer or Senior Data Engineer in a data-driven environment.
- Highly skilled and hands-on team member to design, and develop data pipelines using Python, Spark, Spark streaming and Kafka for building large-scale data processing frameworks.
- Proficiency in cloud data platforms like AWS Glue, EMR, S3, SQS, SNS, and Step Functions.
- Strong working knowledge of Snowflake, Redshift, DynamoDB, PostgreSQL, and other data warehouses/databases.
- Experience with Airflow for orchestration and automation of data workflows.
- Deep understanding of data quality, governance, and observability principles.
- Knowledge of CI/CD pipelines and terraform for cloud infrastructure management.
- Strong knowledge of data platforms such as AWS Data platform, Databricks, Cloudera.
- Ability to work in a fast-paced, dynamic environment, with excellent problem-solving and leadership skills.
Nice to Have:
- Familiarity with Databricks or Cloudera platforms.
- Experience setting up and deploying data infrastructure using Terraform.
- Previous experience working with CI/CD pipelines to streamline deployment processes.
Why Join Us: You will be a key player in building a data platform that supports a data-driven organization, impacting reporting, analytics, and machine learning. You'll work with cutting-edge tools and lead a high-performing team, helping shape the future of data infrastructure within the company.
Chewy is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, national origin, gender, citizenship, marital status, religion, age, disability, gender identity, results of genetic testing, veteran status, as well as any other legally-protected characteristic. If you have a disability under the Americans with Disabilities Act or similar law, and you need an accommodation during the application process or to perform these job requirements, or if you need a religious accommodation, please contact [email protected].
To access Chewy's Customer Privacy Policy, please click here.
To access Chewy's California CPRA Job Applicant Privacy Policy, please click here.
Top Skills
What the Team is Saying
What We Do
We view pets and pet parents as family and are obsessed with meeting their needs and exceeding customer expectations through every interaction. Behind the scenes, our talented teams are made up of innovators, delighters, big-thinkers and of course, passionate pet people—creating a place where you'll be empowered to build, grow and unleash your fullest potential.
We don’t just stand by our company mission—we’re obsessed with it. We seek to be the most trusted and convenient destination for pet parents and partners, everywhere. And we’re constantly finding new ways to do just that.
At Chewy, we understand pet parenthood is full of joyful highs and anxious lows. That’s why we’re here, standing alongside pet parents, providing everything their pets need for a happy, healthy life. We’re a leading online source for pet products, supplies, and prescriptions. We offer a broad selection of high-quality products and services at competitive prices with an exceptional level of customer care and a personal touch.
Since launching in 2011, we’ve combined the personalized service of your neighborhood pet store with the convenience and speed of e-commerce. We pride ourselves on being the only brand available 24/7/365 to support pet parents throughout their journey.
We have a rich history of being recognized for our deep care and personalization while going above and beyond for our customers and their pets.
We view pets and their people as more than just customers and look forward to meeting their needs and exceeding expectations through every interaction. With Chewy, no one pet-parents alone.
Our culture is for those who thrive on delivering results and becoming your best—no matter your role or location. At Chewy, our Operating Principles serve as a common language, or framework, that connects two of Chewy's most valuable elements—our people and our culture. The Operating Principles guide our character, capabilities, imagination, and methods for execution in support of our company's mission.
Why Work With Us
We're proud to be one of the fastest growing e-commerce companies of all time.
With growth comes the exciting opportunity to be a part of a world-class organization of engineering, product, and design team members, responsible for driving our latest innovations and designing "out-of-the Chewy box" experiences.
Gallery
Chewy Teams
Chewy Offices
Hybrid Workspace
Employees engage in a combination of remote and on-site work.
