Senior Data Engineer

As a leading industrial distributor with operations primarily in North America, Japan and the United Kingdom, We Keep The World Working® by serving more than 4.5 million customers worldwide with products delivered through innovative technology and deep customer relationships. With 2023 sales of $16.5 billion, we're dedicated to providing value for customers, fostering an engaging culture for team members and driving strong financial results.
Our welcoming workplace enables you to learn, grow and make a difference by keeping businesses running and their people safe. As a 2024 Glassdoor Best Place to Work and a Great Place to Work-Certified™ company, we're looking for passionate people to join our team as we continue leading the industry over our next 100 years.
Position Details:
The search team comprises the e-commerce search platform, backend services, machine learning endpoints, and our search engine, which enables grainger.com customers to findproducts that serve relevant content to online customers, internal support teams, and marketing programs. We are looking for a Senior Data engineer.
You will report to the Mgr, Product Engineering
You will:

• Design and implement technical solutions and processes to ensure data reliability and accuracy.
• Build pipelines that feed embedding models and vector databases while working with platform-oriented teams to ensure database response times meet expectations.
• Develop data models and mappings and build new data assets required by data science teams. Perform exploratory data analysis on existing products and datasets.
• Understand trends and emerging technologies and evaluate the performance and applicability of potential tools for our requirements.
• Enable data discovery and curation for analytical purposes by collaborating with data scientists and providing data integration solutions.
• Collaborate with stakeholders, including team and product managers, to create secure and efficient data products.
• Ensure that data processing pipelines and ETL jobs are designed for scalability, using distributed technologies to handle increasing data volumes efficiently.
• Work within an Agile delivery / DevOps methodology to deliver product increments in iterative sprints.

You Have:

• 3+ years of experience in batch and streaming ETL using Spark, Python, Scala, Snowflake, or Databricks for Data Engineering or Machine Learning workloads. Snowflake and Databricks are a must.
• 3+ years orchestrating and implementing pipelines with workflow tools like Databricks Workflows, Apache Airflow, or Luigi
• 3+ years of experience prepping structured and unstructured data for data science models.
• 3+ years of experience with containerization and orchestration technologies (Docker, Kubernetes) and experience with shell scripting in Bash, Unix, or Windows shell is preferable.
• Experience working in vector databases like Milvus, Pinecone, or Weaviate
• Experience using machine learning in data pipelines to discover, classify, and clean data.
• Implemented CI/CD with automated testing in Jenkins, Github Actions, or Gitlab CI/CD
• Familiarity with AWS Services not limited to Glue, Athena, Lambda, S3, and DynamoDB
• Demonstrated experience implementing data management life cycle, using data quality functions like standardization, transformation, rationalization, linking, and matching .

Rewards and Benefits:
With benefits starting day one, our programs provide choice and flexibility to meet team members' individual needs. Check out the highlights below and review all our benefits at GraingerTotalRewards.com .

• Medical, dental, vision, life, and pet insurance plans and 6 free sessions each year with a licensed therapist to support your emotional wellbeing
• Paid time off (PTO) and 6 company holidays per year
• 6% company contribution to a 401(k) Retirement Savings Plan each pay period, no match required
• Employee discounts, tuition reimbursement, student loan refinancing and free access to financial counseling, education and tools

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal opportunity workplace.
We are committed to fostering an inclusive, accessible environment that includes both providing reasonable accommodations to individuals with disabilities during the application and hiring process as well as throughout the course of one's employment. With this in mind, should you need a reasonable accommodation during the application and selection process, please advise us so that we can provide appropriate assistance.