Data Engineer - Lead & Senior level openings
The Distributed Data Services team has a mission to provide a scalable and accessible data ecosystem for The Walt Disney Company, which includes platform, processes, and tools bringing Disney closer to the consumer, increasing efficiency, and enabling the business to transform data into value. Our team provides both Data platforms as well as Professional Services and consultation in the data management, data integration, and data analysis space for Disney Connected & Advanced Technology and cross-functional teams. We're also responsible for the planning and integration of data platforms in the most efficient, secure, scalable, reliable, and cost-effective manner possible.
You will fill a critical role on our team to support and drive the management of data technology products as well as leading automation and instrumentation efforts for our platforms and services. You will leverage your software development and data management skills to build services and tools for the management of business data assets. We're looking for people with a passion for emerging data technologies in areas such as NoSQL/RDBMS, Graph, Time Series, and application of other problem domains. You'll be expected to collaborate with key Disney partners, as well as leverage vendors and the open-source community for products and services. Your success will be measured on your ability to rapidly develop and document a keen understanding of Disney stakeholders' needs, using the technology platforms, applying various data analysis tools and processes to help get business insights, and interfacing architecture and development teams to adhere to standards while building world-class solutions.
Responsibilities :
The focus of this position will be in Data engineering product support, data integration, and ad-hoc data analysis service of operational and business processes for internet sites and corporate applications for The Walt Disney Company. Key responsibilities include Data technology evaluation(platform and analytical tools), running Proof of concept programs, documenting findings and recommendations, feature engineering, design support, task automation and scripting, best practice and standards development, capacity planning, optimization and tuning, system upgrades and migrations, performance management, monitoring, security, backup and recovery, issue troubleshooting, and documentation.
General responsibilities will include:
Responsible for level 1 data engineering, data analysis, source code management, systems management. Excellent technical expertise in relevant state of the art data technologies, data analysis tools(Python, R), understanding of database integration methodologies, data security, and its design. Carries out assignments with minimal coaching and guidance from others. Develops, enhances, and adheres to engineering standards. Upholds and maintains strong documentation.
Basic Qualifications :
We're looking for candidates with experience in the following areas:
- At least one of the Pubic Cloud providers such as AWS, Google Cloud Services or Azure
- Strong programming skills using Python, Java, and/or R language
- Source control tools such as Git
- Build automation tools such as Jenkins, Chef, Ansible, Cloud formation templates, Terraform. or GitLab runners
- Data processing engines such as Spark, python data analysis libraries such as Tensorflow, Keras, sci-kit-learn, etc,
- Data platforms such as Spark, Solr, Redshift, Snowflake, MongoDB, Cassandra, Redshift, etc.
- Managing Columnar Data Stores such as Snowflake, Teradata
- EKS and containerization
- Solid understanding of database design and architectural principles and methodologies
Preferred Qualifications:
To be considered for a Lead position on the team, you must demonstrate the following:
- Completes tasks independently, with attention to detail, and while under pressure
- Strong judgment, problem resolution, negotiation, and decision-making skills
- Ability to work under continual deadline pressure
- Proactively identifies, analyzes, and drives problems to resolution, handling complex issues simultaneously while effectively communicating across teams
- Builds team relationships across the organization, specifically with leadership and executives
- Effectively communicates technical actions and expectations to the appropriate stakeholders
- Delivers customer service excellence by seeking and understanding customer's business needs, identifying appropriate technical solutions, and meeting/exceeding service expectations
Required Education :
Bachelor's Degree in Computer Science, Engineering or related field
Preferred Education :
Masters of Science in computer science/information systems, engineering or related field preferred.
Additional Information :
DISNEYTECH