Big Data Lead

Posted 8 Days Ago
Be an Early Applicant
Hiring Remotely in India
Remote
Mid level
Information Technology • Consulting
The Role
The Big Data Lead will design and develop data pipelines, improve EY.ai Data Marketplace's services, and ensure their robustness while collaborating across teams.
Summary Generated by Built In
Check the JD for details however the primary skills are - Spark expert who have used PDF unstructured data and mapped them into tables, ADB, ADF, strong SQL, Python / Pyspark Job description EYDM is seeking a proactive, dynamic, and adaptable member to join our global, diverse, and inclusive team. Given the continuous growth and evolution of our products, we require candidates who not only embrace change but also possess the experience and capability to hit the ground running. Ideal team members will thrive in ambiguous environments, demonstrating curiosity and proactiveness while effectively contributing from day one. Reporting into the Technical Lead, the new member will play a pivotal role in supporting the Data Ingestion team, Business and Technical Product Owners, to expand and promote our offering throughout EY’s Service Lines, Products, Functions and engagement teams. This role covers a broad area of activity, including technical design and development of near real time data processing, consumer interaction, business documentation and reporting. Your key responsibilities You will be responsible for: Collaboratively identify and ideate opportunities to continuously improve EY.ai Data Marketplace (EYDM) data asset and the services it provides to consumers. Engage in design and development sessions to further EYDM’s data asset creation and ingestion pipelines with a focus on stability, optimisation and traceability. Develop, test and maintain EYDM’s data pipelines & processes. Developing and testing resilient, fault tolerant, modular code, to ensure EYDM’s processes, pipelines and services are robust and highly available. Research, explore and if feasible implement new methods and processes across EYDM to build world class data products and associated services. Actively participate in cross-team collaboration to ensure smooth transition through Ingestion, Consumption and Activation

Top Skills

Adb
Adf
Pyspark
Python
Spark
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Navi Mumbai, Maharashtra
27,000 Employees
Year Founded: 1990

What We Do

At Hexaware, we're not just a global technology and business process services company; we're a community of 27,000 Hexawarians dedicated to one singular purpose: creating smiles through the power of great people and technology. With a presence in 40+ offices across 19 countries, we empower enterprises worldwide to embark on their digital transformation journey with unparalleled scale and speed. As an employer, we're more than just a workplace. We put our people first, foster diversity and inclusivity, and prioritize their growth through robust learning and development programs. Our culture is a canvas for innovation as we work toward our shared vision of becoming the world’s most loved digital transformation partner. Exciting, isn’t it? Visit www.hexaware.com to join us in embracing the magic of technology, as we passionately advocate for its potential to transform lives today and shape a brighter future. Together, we'll make the digital world a better place.

Similar Jobs

MetLife Logo MetLife

Software Engineer

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
India
43000 Employees
120K-155K Annually

Hexaware Technologies Logo Hexaware Technologies

Big Data Lead

Information Technology • Consulting
Remote
India
27000 Employees

DemandMatrix Logo DemandMatrix

Big Data Lead

Information Technology • Consulting
In-Office or Remote
Pune, Mahārāshtra, IND
56 Employees
7-7 Annually

Similar Companies Hiring

Scrunch  Thumbnail
Artificial Intelligence • Information Technology • Marketing Tech • Software • SEO
Salt Lake City, Utah
Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account