Data Engineer, Product Information

Job Summary:
As the Product Data Engineer you will be responsible for designing and implementing tools and processes that streamline the mapping of product data from various suppliers into our preferred data schema. Leveraging ETL (Extract, Transform, Load) processes, you will ensure data consistency, improve data quality, and enhance the speed at which product data moves from supplier to customer presentation on our website.

You will collaborate with internal stakeholders and vendors to develop robust solutions, incorporating automation, human-in-the-loop reviews, and continuous improvements to scale as we grow our assortment.

Duties & Responsibilities:

• Develop Automated/Semi-Automated Data Mapping Solutions: Design and build systems that automate the mapping of product attributes, technical specifications, and other product data from supplier sources to our internal data schemas.
• ETL Process Design: Lead the development of ETL processes to extract, transform, and load data from diverse supplier sources, standardizing it according to our company’s data models.
• Data Schema Management: Build functionality to map supplier-provided data schemas to our preferred internal data formats, ensuring data quality and consistency across millions of SKUs.
• Human-in-the-Loop Integration: Incorporate processes that allow for human validation and review of critical product data where automation is not sufficient, ensuring data accuracy and reliability.
• Collaboration with Suppliers and Stakeholders: Work closely with suppliers, vendors, and internal teams (Product, Engineering, Customer Experience) to ensure seamless data flows from source to customer presentation.
• Tooling and Technology Development: Drive the development of internal tools and functionality to improve data ingestion, mapping, and processing, leveraging both existing platforms and custom solutions.
• Data Quality and Consistency: Ensure product data adheres to our internal standards and supports customer-facing initiatives, enhancing the overall user experience and searchability on our platform.
• Scalability and Performance Optimization: Ensure the solutions developed can scale to meet the growing needs of the business as our assortment increases to 20 million SKUs and beyond.

Minimum Qualifications:

• Experience: 3+ years of experience in data engineering, data architecture, or data management roles, preferably within eCommerce, product information management (PIM), or similar fields.
• Technical Skills: Advanced proficiency in Python, ETL processes, data integration, and transformation technologies. Strong understanding of SQL and data modeling concepts.  
• Automation Expertise: Experience in designing automated or semi-automated data mapping processes, including the use of machine learning or rule-based systems.
• Data Schema Knowledge: Strong knowledge of data schema mapping, including hierarchical data, JSON, XML, and other formats commonly used by suppliers in technical industries.

Preferred Qualifications:

• Problem Solving: Ability to think strategically and creatively to build scalable solutions that address complex data challenges.
• Collaboration Skills: Strong interpersonal skills with the ability to work cross-functionally and communicate complex ideas to both technical and non-technical stakeholders.
• Attention to Detail: A commitment to high-quality data output with a focus on accuracy and consistency in all aspects of data mapping and transformation.