Lead Data Engineer
About the Role & Team
The Disney Decision Science + Integration (DDSI) organization is responsible for supporting clients across The Walt Disney Company including the Disney Parks, Experiences and Products segment which include Parks & Resorts both domestic and international, Consumer Products and Disney Signature Experiences as well as the Disney Entertainment segment including Studios Content (Disney Theatrical Group), General Entertainment Content, and ESPN and Sports Content.
DDSI leverages technology, data analytics, optimization, statistical and econometric modeling to explore opportunities, shape business decisions and drive business value.
The DDSI Data Engineering (DE) team is seeking a Lead Data Engineer to work on a Parks Food & Beverage Revenue Management project supporting multiple theme park locations. This position will work with the Decision Science Products and Science teams to design, develop, enhance, and implement systems.
What You Will Do
The Lead Data Engineer role is an individual contributor who will be primarily responsible for planning and managing the data engineering processes related to a multi-site application supporting the Parks Food & Beverage Revenue Management project. In this position, the candidate will have tasks including interacting with client teams to define data requirements, planning development tasks, coordinating with project teams on task dependencies, participating in weekly project meetings, designing data structures and pipelines, and monitoring the implementation of the development tasks. Additional activities would include assisting the team with code development and resolving issues. Desired candidate is someone who has served in a Technical Lead role and is wanting to pursue a management track as a next step in their career.
Required Qualifications & Skills
- Shown experience in a Technical Lead role
- Prior experience defining solutions to sophisticated data engineering problems
- Prior experience with project and sprint planning
- Experience translating project objectives into data engineering tasks
- Ability to effectively communicate complex technical concepts and solutions to non-technical team members
- Experience designing and building data structures to support requirements
- 7+ years overall experience in a software development capacity using a multi environment (Dev, QA, Prod, etc.) and DEVOP procedures for code deployment/promotion
- Multiple years of experience with ELT/ETL data pipeline development and maintenance
- Multiple years shown experience and expertise using SQL and Python
- 2+ years using, designing and building relational databases (preferably Snowflake, or PostgreSQL)
- 2+ years of experience managing and deploying code using a source control product such as GitLab/GitHub
- 2+ years of experience with job scheduling software like Apache Airflow, Amazon MWAA, GitLab Runners or UC4
- Experience using containerization technologies such as Docker or Kubernetes
- Knowledgeable on cloud architecture and product offerings, preferably AWS
Preferred Qualifications
- Knowledgeable with Disney Parks dining reservations and/or products
- Experience with cloud based technologies, preferably AWS EMR, EC2, and S3
- Experience with various Snowflake offerings such as Snowpark, Data Exchange, Data Marketplace and Snowpipe
Education
- Bachelor's degree (Computer Science, Mathematics, Software Engineering or related field, or equivalent experience)
- Master's degree preferred (Computer Science, Mathematics, Engineering or related field preferred)