Data Ingestion Engineer - Remote

Posted 4 Days Ago
Be an Early Applicant
India
Senior level
Security • Software • Cybersecurity
The Role
The Data Ingestion Engineer will manage and implement data ingestion processes on the Databricks platform, design and optimize ETL/ELT pipelines, ensure compliance with data quality and security standards, and contribute to Agile sprint management, leveraging experience in data engineering and leading teams.
Summary Generated by Built In

Role Overview:

We are seeking a seasoned data professional to join our Enterprise Data Platform team as the Capability Specialist for Data Ingestion, reporting to the Enterprise Data Platform Lead. As a key contributor to McAfee’s enterprise data strategy, you will be responsible for managing and implementing data ingestion processes on the Databricks platform.
This is a Remote position located in India. We are only considering candidates located in India and are not providing relocation at this time.

About the role:

  • This role involves managing data ingestion processes on the Databricks platform, requiring expertise in Data Lake ingestion, ETL/ELT design, and CI/CD practices.
  • You will design, implement and manage data ingestion processes from a variety of source systems, ensuring best practices are followed and tailoring approaches to each system.
  • You will be responsible for developing, maintaining, and optimizing ETL/ELT pipelines while ensuring adherence to security, compliance, and PII management standards.
  • Additionally, this position requires knowledge of system integration tools and effective data pipeline management.
  • You'll implement automated monitoring to maintain pipeline infrastructure reliability.
  • This role also includes contributing to Agile sprints and ensuring adherence to SDLC best practices.
  • The ideal candidate will apply ingestion best practices across diverse source systems, tailoring approaches as needed.

About you:

  • You should have 5 to 8 years of experience in data engineering, ingestion pipelining, and ETL/ELT,
  • You should have proficiency in SQL and programming languages like Python or PySpark, as well as experience with Databricks and cloud platforms such as AWS.
  • Hands-on expertise with Spark/Scala, ETL/ELT development using tools like Apache Airflow, and ingestion tools such as Dell Boomi is required.
  • A solid understanding of data quality guidelines, CI/CD pipelines, and Agile sprint management is also necessary.
  • Familiarity with Git and version control systems is expected.
  • Experience in leading small, high-performing teams of data engineers is essential.
  • Product subscription business model domain is a plus.
  • Knowledge on Kong-API and Kinesis is a plus.

#LI-Remote


Company Overview

McAfee is a leader in personal security for consumers. Focused on protecting people, not just devices, McAfee consumer solutions adapt to users’ needs in an always online world, empowering them to live securely through integrated, intuitive solutions that protects their families and communities with the right security at the right moment.

Company Benefits and Perks:

We work hard to embrace diversity and inclusion and encourage everyone at McAfee to bring their authentic selves to work every day. We offer a variety of social programs, flexible work hours and family-friendly benefits to all of our employees.

  • Bonus Program
  • Pension and Retirement Plans
  • Medical, Dental and Vision Coverage
  • Paid Time Off
  • Paid Parental Leave
  • Support for Community Involvement

We're serious about our commitment to diversity which is why McAfee prohibits discrimination based on race, color, religion, gender, national origin, age, disability, veteran status, marital status, pregnancy, gender expression or identity, sexual orientation or any other legally protected status.

Top Skills

Pyspark
Python
Scala
Spark
SQL
The Company
HQ: Santa Clara, CA
7,996 Employees
On-site Workplace

What We Do

McAfee is a global organization with a 30-year history and a brand known the world over for innovation, collaboration and trust. McAfee’s historical accomplishments are founded upon decades of threat and vulnerability research, product innovation, practical application and a brand which individuals, organizations and governments have come to trust.

Similar Jobs

Celonis Logo Celonis

Lead Value Engineer

Big Data • Productivity • Software • Database • Analytics • Business Intelligence • Consulting
Bangalore, Bengaluru, Karnataka, IND
3000 Employees

Celonis Logo Celonis

Senior Value Engineer

Big Data • Productivity • Software • Database • Analytics • Business Intelligence • Consulting
Bangalore, Bengaluru, Karnataka, IND
3000 Employees

Celonis Logo Celonis

Engineering Director - India

Big Data • Productivity • Software • Database • Analytics • Business Intelligence • Consulting
Bangalore, Bengaluru, Karnataka, IND
3000 Employees

SmartBear Logo SmartBear

Zephyr Enterprise Software Engineer Customer Support

Cloud • Internet of Things • Software • App development • Automation
Easy Apply
Bengaluru, Karnataka, IND
800 Employees

Similar Companies Hiring

RunPod Thumbnail
Software • Infrastructure as a Service (IaaS) • Cloud • Artificial Intelligence
Charlotte, North Carolina
53 Employees
Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees
HERE Thumbnail
Software • Logistics • Information Technology
Amsterdam, NL
9000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account