Lead Data Engineer – Platform

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. Join us. You’ll do the best work of your career right here at Comcast. (In most cases, Comcast prefers to have employees on-site collaborating unless the team has been designated as virtual due to the nature of their work. If a position is listed with both office locations and virtual offerings, Comcast may be willing to consider candidates who live greater than 100 miles from the office for the remote option.)

Job Summary

The Data Engineering Platform, Standards & Enablement team at Comcast is seeking a Lead Data Engineer – Platform to serve as the senior-most technical authority for our enterprise data platform. This Engineer 4 will architect and evolve the next-generation data engineering platform that powers Comcast’s data ecosystem across Databricks, AWS, Kafka, and distributed database environments. As a platform leader, you will define strategy, establish standards, and guide global teams to deliver a secure, scalable, and cost-efficient platform enabling mission-critical analytics and data workloads.

Job Description

Core Responsibilities

Enterprise Platform Strategy & Architecture

• Define and evolve Comcast’s enterprise data platform strategy across Databricks, AWS, Kafka, and database ecosystems.
• Develop architectural patterns, reference implementations, reusable frameworks, and platform guardrails.
• Lead decisions on compute orchestration, storage tiering, data access models, and multi-region resiliency.
• Serve as SME for Databricks architecture, including security model, cluster governance, Unity Catalog, Delta Lake strategy, and optimization frameworks.

Technical Leadership & Engineering Excellence

• Act as the highest-level escalation point for complex platform issues.
• Set engineering standards and coding conventions for all data engineering domains.
• Mentor senior engineers and architects; promote best practices and thought leadership.
• Evaluate emerging technologies to enhance scalability and operational efficiency.

Platform Operations, Governance & Security

• Own platform governance, including workspace lifecycle, cluster policy enforcement, and compliance.
• Drive adoption of monitoring and observability tools (ELK, CloudWatch, Databricks native logging).
• Implement FinOps strategies for cost management and forecasting.
• Ensure platform resilience, disaster recovery readiness, and high availability.

Cross-Functional Leadership & Delivery

• Lead globally distributed platform engineering teams (onshore, offshore, vendor partners).
• Partner with Security, Enterprise Architecture, and CloudOps to align standards and governance.
• Drive quarterly planning, roadmap execution, and platform enhancements.
• Communicate risks, KPIs, and modernization opportunities to executive stakeholders.

Required Experience/Qualifications:

• 8-10+ years of experience in Data Engineering, Platform Engineering, Distributed Systems, or Software Engineering.
• Deep hands-on expertise in Databricks engineering and administration: Cluster policies & cost governance; Workspace architecture; Unity Catalog & data access models; Delta Lake performance tuning; Job orchestration & pipeline optimization
• Advanced AWS experience with: S3 lifecycle tiers, encryption, cross-account architectures; MSK provisioning, tuning, scaling, monitoring; EC2, VPC networking, IAM role design; Lambda for serverless automation
• Strong background in backend/datastore technologies (Oracle, MongoDB).
• Expert-level knowledge of Kafka, Spark, distributed computing, and real-time ingestion frameworks.
• Proficiency in Python, SQL, and Shell scripting.
• Prior leadership experience managing platform teams and offshore delivery models.
• Proven ability to define and enforce platform standards across large organizations.
• Excellent communication and stakeholder influence skills.

Preferred Experience:

• Experience with Databricks Unity Catalog rollout at enterprise scale.
• Experience creating reusable Spark frameworks or platform accelerators.
• Familiarity with Databricks Serverless, DLT, or Photon.
• Knowledge of Kubernetes, container orchestration, and microservices patterns.
• AWS or Databricks professional certifications.
• Telecom or large enterprise digital commerce experience.

Disclaimer:

• This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Skills

Amazon Web Services (AWS), Artificial Intelligence (AI), Collaboration, Databricks Platform, ETL Design

We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That's why we provide an array of options, expert guidance and always-on tools that are personalized to meet the needs of your reality—to help support you physically, financially and emotionally through the big milestones and in your everyday life.

Please visit the benefits summary on our careers site for more details.

Education

Bachelor's Degree

While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

Certifications (if applicable)

Relevant Work Experience

7-10 Years

Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.