Engineer - Big Data

Posted 14 Days Ago
Be an Early Applicant
Gurgaon, Gurugram, Haryana
Mid level
eCommerce • Retail
The Role
The Big Data Engineer will develop software using Python, optimize Spark jobs, manage data in Hadoop, and utilize cloud services to improve customer engagement for retailers.
Summary Generated by Built In

dunnhumby is the global leader in Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy. We always put the Customer First.

 

Our mission: to enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers. With deep heritage and expertise in retail – one of the world’s most competitive markets, with a deluge of multi-dimensional data – dunnhumby today enables businesses all over the world, across industries, to be Customer First.

 

dunnhumby employs nearly 2,500 experts in offices throughout Europe, Asia, Africa, and the Americas working for transformative, iconic brands such as Tesco, Coca-Cola, Meijer, Procter & Gamble and Metro.

We’re looking for a Big Data Engineer to join our dh strategic team of Loyality and Personalisation which builds products the retailer can use to find the optimal customer segments and send personalised offers and digital recommendations to the consumer. These products are strategic assets to retailer to improve the loyality of their consumer. by that these products are very important for retailers and therefore for dunnhumby

What we expect from you:

Must have:

        - 3 to 6 years of experience in software development using Python.
  - Hands on experience in Python OOPS, Design patterns, Dependency Injection, data libraries(Panda), data structures 
  - Exposure to Spark: PySpark, Architecture of Spark, Best practices to optimize jobs
  - Experience in Hadoop ecosystem: HDFS, Hive, or YARN
  - Experience of Orchestration tools: Airflow, Argo workflows, Kubernetes
  - Experience on Cloud native services(GCP/Azure/AWS) preferable GCP
  - Database knowledge of: SQL, NoSQL
  - Hands on expsoure to CI/CD pipelines for data engineering workflows
  - Testing: pytest for unit testing. pytest-spark to create a test Spark Session. Spark UI for Performance tuning & monitoring

Good to have:
  - Scala


What you can expect from us

We won’t just meet your expectations. We’ll defy them. So you’ll enjoy the comprehensive rewards package you’d expect from a leading technology company. But also, a degree of personal flexibility you might not expect.  Plus, thoughtful perks, like flexible working hours and your birthday off.

You’ll also benefit from an investment in cutting-edge technology that reflects our global ambition. But with a nimble, small-business feel that gives you the freedom to play, experiment and learn.

And we don’t just talk about diversity and inclusion. We live it every day – with thriving networks including dh Gender Equality Network, dh Proud, dh Family, dh One and dh Thrive as the living proof.  We want everyone to have the opportunity to shine and perform at your best throughout our recruitment process. Please let us know how we can make this process work best for you. For an informal and confidential chat please contact [email protected] to discuss how we can meet your needs. 

Our approach to Flexible Working

At dunnhumby, we value and respect difference and are committed to building an inclusive culture by creating an environment where you can balance a successful career with your commitments and interests outside of work.

We believe that you will do your best at work if you have a work / life balance. Some roles lend themselves to flexible options more than others, so if this is important to you please raise this with your recruiter, as we are open to discussing agile working opportunities during the hiring process.

For further information about how we collect and use your personal information please see our Privacy Notice which can be found (here)

Top Skills

Airflow
Argo
AWS
Azure
Ci/Cd
GCP
Hadoop
Hdfs
Hive
Kubernetes
NoSQL
Pyspark
Pytest
Pytest-Spark
Python
Spark
SQL
Yarn
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: London
0 Employees
Hybrid Workplace
Year Founded: 1989

What We Do

Dunnhumby is a customer data platform that provides models and insights into how customers engage with retail and e-commerce spaces.

Similar Jobs

Gurgaon, Gurugram, Haryana, IND

McCain Foods Logo McCain Foods

QA Automation Engineer

Food • Retail • Agriculture • Manufacturing
Gurugram, Haryana, IND
20000 Employees

ZS Logo ZS

Senior Lead R&D Technologist

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
3 Locations
13000 Employees

CrowdStrike Logo CrowdStrike

Engineer III - Cloud SDET

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote
Hybrid
18 Locations
10000 Employees

Similar Companies Hiring

Munchkin, Inc. Thumbnail
Manufacturing • Kids + Family • Food • Enterprise Web • eCommerce • Consumer Web • 3D Printing
Milton, Ontario
325 Employees
Optimum Thumbnail
Software • Retail • Mobile • Marketing Tech • Internet of Things • Digital Media • AdTech
Long Island City, NY
9000 Employees
Grocery TV Thumbnail
Software • Retail • Marketing Tech • Hardware • Digital Media • AdTech
Austin, TX
45 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account