Lead Data Engineer
Disney Media & Entertainment Distribution (DMED) Technology creates products, platforms, and innovations for the DMED Segment and the Walt Disney Company by driving the strategic development and use of technology, building scalable systems and products to empower our businesses and engage consumers. The DMED Technology organization enables enterprise-wide consumer technology and data capability to deliver on the promise of more direct consumer relationships, personalized product experiences, and more active engagement with content and advertising. With global scale, local presence, and deep technological excellence, DMED Technology helps DMED and The Walt Disney Company optimize technology platforms and resources, bring creative ideas to life, and create industry-shaping approaches.
Consumer Experiences & Platforms brings together our engineering and product teams to develop, create, enhance, and grow a DMED Technology digital product portfolio that reaches more than 380 million consumers worldwide each month.
The CXP team leads efforts to deliver the most relevant experiences in real time based on the consumer, content, and context wherever they engage. The team also enables rapid A/B testing at scale to expand learnings and fuel data-driven decisions. Driving visibility of experiments, results and insights while providing tools to manage requests for new ideas.
Our team is...
- A group of engineers and data scientists with diverse expertise delivering solutions together.
- Collaborative and dynamic.
- Embracing agile practices.
- Using continuous integration/automated testing.
- Led by startup veterans.
Responsibilities:
- Create and maintain optimal data pipeline architecture
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Design, develop, test, deploy, maintain and improve software
- Participate in the design and implementation of core Platforms and Content Distribution systems
- Collaborate with internal & external teams to define requirements and delivery schedules for projects
- Design and deliver high quality code for small to medium size projects and make critical contributions working with others on larger projects
- Work with the team to iteratively improve development practices and processes
- Build strong relationships with the team while collectively finding opportunities for improvements around quality and automation
Requirements:
- 7+ Years of relevant work experience
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience building and optimizing data pipelines, architectures and data sets.
- Robust programming skills and strong experience with Python
- Experience with the following technologies is a plus: Snowflake, AWS, Kafka, Airflow, Postgresql, Spark
- Exposure to full lifecycle of application development, including practices like continuous integration, unit testing, code reviews, documentation, etc.
- Interest in industry trends on new technologies, best practices and solutions. A passion for innovation and raising the bar in all development aspects.
- Proven ability to work on a diverse scope of software projects requiring strong attention to detail and creative problem solving.
- Passion for software quality and for advancing testing as an engineering discipline
- Required education: Bachelor's degree, with equivalent work experience in MIS, Computer Science or related discipline
#CXPNGS