Senior Data Engineer

Position: Senior Data Engineer

Job Location: 1375 Crossman Avenue, Sunnyvale, CA 94089

Duties: Designs and implements scalable data pipelines and automated reporting solutions to address business problems using analytics and big data technologies. Translates business requirements into analytical data models and actionable insights. Owns end-to-end delivery of data engineering tasks supporting business intelligence and self-service analytics initiatives. Builds and maintains ETL pipelines to transform raw data into analytics-ready datasets. Extracts, cleanses, and transforms structured and unstructured data using appropriate big data processing techniques such as Spark and Hive. Performs data exploration to identify trends, segmentation opportunities, funnel insights, and long-term business patterns. Develops and optimizes SQL queries to support reporting, dashboarding, and analytical use cases. Designs and maintains logical and physical data models for analytical data warehouses and data marts. Defines relational tables, primary and foreign keys, and transformation logic to support scalable reporting structures. Evaluates and enhances data models and data flows to improve accuracy, reliability, and performance. Identifies bottlenecks in data processing pipelines and implements automation and optimization solutions to improve query performance and reporting efficiency. Performs data quality validation checks to ensure integrity and reliability of metrics. Develops reusable scripts and tools using Python and SQL to streamline data processing and reporting workflows. Partners with cross-functional stakeholders to enable self-service BI through structured datasets and dashboard-ready tables. Builds proof-of-concepts to evaluate emerging big data and data visualization technologies. Documents data architecture, data flows, and transformation logic to support analytics scalability and governance best practices. Stays current with big data, cloud analytics, and data visualization technology trends and makes recommendations based on business needs.

Minimum education and experience required: Master's degree or the equivalent in Computer Science, Information Technology, Engineering (any), Statistical Science, or a related field plus 1 year of experience in software engineering or related experience; OR Bachelor’s degree or the equivalent in Computer Science, Information Technology, Engineering (any), Statistical Science, or a related field plus 3 years of experience in software engineering or related experience.

Skills required: Must have experience with: Designing and building scalable data pipelines and ETL workflows to support analytical data warehouses; Developing complex SQL queries, views, stored procedures, and user-defined functions in cloud databases including Google BigQuery; Optimizing long-running queries and improving performance of large-scale analytical datasets; Parsing, cleansing, and transforming structured and unstructured data using Hive, Spark, and PySpark; Developing automation scripts and reusable tools using Python; Designing and implementing data models to support reporting, dashboarding, and self-service BI; Working with cloud platforms, including Google Cloud Platform (preferred), AWS, Azure, and Snowflake at scale; Leveraging cloud data pipeline orchestration tools: Airflow, Dataflow; Building analytical datasets to support Tableau and Looker; Performing data exploration and statistical analysis to uncover business insights and common data pitfalls; Identifying data bottlenecks and implementing optimization strategies to enhance pipeline efficiency and data reliability; Producing technical documentation including data architecture diagrams, source-to-target mappings, and ETL workflow designs. Employer will accept any amount of experience with the required skills.

Salary Range: $144,402/year to $234,000/year. Additional compensation includes annual or quarterly performance incentives. 

Benefits: At Walmart, we offer competitive pay as well as performance-based incentive awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty and voting. Other benefits include short-term and long-term disability, education assistance with 100% company paid college degrees, company discounts, military service pay, adoption expense reimbursement, and more.

Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms. For information about benefits and eligibility, see One.Walmart.com.

Wal-Mart is an Equal Opportunity Employer.

#LI-DNI #LI-DNP