Data Engineer (Eng 3)

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. Join us. You’ll do the best work of your career right here at Comcast. (In most cases, Comcast prefers to have employees on-site collaborating unless the team has been designated as virtual due to the nature of their work. If a position is listed with both office locations and virtual offerings, Comcast may be willing to consider candidates who live greater than 100 miles from the office for the remote option.)

Job Summary

As part of the team overseeing the cloud data lake platform, this Engineer 3 is responsible for feature development and platform support.

Job Description

Candidate should have the knowledge to implement the required tasks, test it, deploy it to different environments, and setup observability to view how the API/pipeline is behaving. Qualifications include

• Proficient in Python, with good knowledge of concurrent processing

• Hands on experience in developing complex ETL applications with spark and SQL

• Databricks experience is a must.

• Good to have knowledge of data-engineering systems such as data lake, file-formats, batch & stream processing (Kafka).

• Experience in application development using Docker, Kubernetes, especially at high-scale is a bonus

• Experience with CI/CD tools such as Git, Jenkins, Concourse

• Knowledge of AWS ecosystem - S3, Lambda, EC2, EKS, Cloudwatch, Kinesis, SNS, SQS
   

This Engineer also works with the on prem team, for which the following skills are preferred: SQL, Java, and Python on AWS cloud-based platform; of which three (3) years include using Snowflake or Spark, Datadog or AWS Cloudwatch, Terraform or AWS CloudFormation, Presto, and Jenkins; using Snowflake or Databricks data platform; storing relational data in MySQL to support API and data processing applications;

Core Responsibilities

This is an in-office/hybrid role based in Englewood, CO; Philadelphia; or West Chester, PA.

• The role is part of an on-call pager rotation; you are responsible for covering a 5-day period every 6 weeks.
• Collaborates with project stakeholders to identify product and technical requirements. Conducts analysis to determine integration needs.
• Designs new software and web applications, supports applications under development and customizes current applications. Assists with the software update process for existing applications and roll-outs of software releases.
• Participates in training representatives and operations staff on internally developed software applications.
• Researches, writes and edits documentation and technical requirements, including software designs, evaluation plans, test results, technical manuals and formal recommendations and reports.
• Monitors and evaluates competitive applications and products. Reviews literature, patents and current practices relevant to the solution of assigned projects.
• Provides technical leadership throughout the design process and guidance with regards to practices, procedures and techniques. Serves as a guide and mentor for junior-level Software Development Engineers.
• Works with Quality Assurance team to determine if applications fit specification and technical requirements.
• Displays in-depth knowledge of engineering methodologies, concepts, skills and their application in the area of specified engineering specialty.
• Displays in-depth knowledge of and ability to apply, process design and redesign skills. Presents and defends architectural, design and technical choices to internal audiences.
• Displays knowledge of and ability to apply, project management skills.
• Consistent exercise of independent judgment and discretion in matters of significance.
• Other duties and responsibilities as assigned.

Disclaimer:

• This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Skills

Amazon Web Services (AWS), Databricks Platform, Python (Programming Language)

Compensation

Primary Location Pay Range: $113,052.32 - $169,578.49

Comcast intends to offer the selected candidate base pay dependent on job-related, non-discriminatory factors such as experience. Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality – to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.

The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.

Education

Bachelor's Degree

While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

Certifications (if applicable)

Relative Work Experience

5-7 Years

Comcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.