Data Engineer III

Do you have boundless energy and passion for engineering data used to solve dynamic problems that will shape the future of retail? With the sheer scale of Walmart’s environment comes the biggest of big data sets. As a Walmart Data Platform Engineer, you will dig into our mammoth scale of data to help unleash the power of retail data science by imagining, developing, and maintaining data pipelines that our Data Scientists and Analysts can rely on. You will be responsible for contributing to an orchestration layer of complex data transformations, refining raw data from source into targeted, valuable data assets for consumption in a governed way. You will partner with Data Scientists, Analysts, other engineers and business stakeholders to solve complex and exciting challenges so that we can build out capabilities that evolve the retail business model while making a positive impact on our customers’ lives.  

About Team: 

 
Our team creates and manages world class platform and technologies to help with E2E Supplychain and Fulfillment in Walmart, empowering business and operational teams, while ensuring a seamless experience for both of these stakeholders. We also optimize tariffs and assortment in accordance with Walmart's Everyday Low Cost philosophy. We not only create affordability, but we also deliver customized experiences for customers across all channels - in-store, mobile app, and websites. 

What you'll do:  

• Design, build, test and deploy cutting edge solutions at scale, impacting millions of customers worldwide drive value from data at Walmart Scale 

• Develop high performance and scalable solutions/APIs that extract, transform, and load Storm, Spark, big data. 

• Experience performing root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement. 

• Experience building and optimizing ‘storm/spark/big data’ data pipelines, architectures and data sets involving petabyte and terabyte of data. 

• Interact with Walmart engineering teams across geographies to leverage expertise and contribute to the tech community. 

• Engage with Product Management and Business to drive the agenda, set your priorities and deliver awesome product features to keep platform ahead of market scenarios. 

• Closely interact with Engineers from within Walmart to identify right open-source tools to deliver product features by performing research, POC/Pilot. 

• Engage with Product Management and Business to support and build data solutions and develop expertise w.r.t data thereby being known as the true data analyst. 

• You also get to collaborate with team members to develop best practices and client requirements for the software. 

• You will show your skills in analyzing and testing programs/products before formal launch to ensure flawless performance. 

• Software security is of prime importance and by developing programs that monitor sharing of private information, you will be able to add tremendous credibility to your work. 

• You will also be required to seek ways to improve the software and its effectiveness. 

• You will be called upon to support the coaching and training of other team members to ensure all employees are confident in the use of software applications. 

What you'll bring:  

• 3-4 years of experience in design and development of highly-scalable applications and platform development that deal with large data with realtime latency.  

• Strong computer science fundamentals: data structures, algorithms, design patterns 

• Develop high performance and scalable solutions that extract, transform, and load Spark/big data. 

• Experience in managing Elasticsearch clusters, including indexing, querying, and performance tuning. 

• Working knowledge of SQL /No-SQL and database technologies (Cassandra, Big Query, Data Bricks, Cosmos, Druid, etc) 

• Hands on experience in building Micro-services, ability to build REST services using Java, Spring Boot. 

• Experience on Cloud Architecture, Micro-services Architecture and container technologies (Docker, Kubernetes, etc.) 

• Hands-on experience with event-based system processing such as Kafka 

• Experience in deploying solutions on any of these cloud platforms (Azure, GCP) 

• Work exposure on Agile methodologies and DevOps would be added advantage 

• Well versed with Testing frameworks like JUnits 

• CI/CD Automation experience with tools like Git, Maven, Jenkins & Azure DevOps 

• Strong hands on development skills to prototype technical & innovative solutions 

• Ability to balance the long-term "big picture" and short-term implications of design decisions 

• Exceptional communication and interpersonal skills - including negotiation, facilitation, and consensus building skills; ability to influence and persuade, without direct control 

• Practitioner of Agile (Scrum) methodology.