Lead Data Engineer - Data Archival - Bangalore

Reposted 25 Days Ago
Be an Early Applicant
Hiring Remotely in India
Remote
Mid level
Agency • Information Technology
The Role
Design, build and maintain cloud-oriented big data solutions for ingestion, processing, cleaning and exposition. Improve data quality, implement ETL and data-warehouse architectures, and collaborate with DDS/Data Foundation teams to ensure platform reliability.
Summary Generated by Built In
Missions
  • Job description:

    Our team Data-as-a-service is expanding, and we need 3 big data experts to join us!

    Today we manage SG Data platform service offers and data tools:

    ·       Data ingestion: to ingest the data from a data source

    ·       Data processing: to process, transform and distribute the data to the target location

    ·       Data exposition : to distribute and expose the data hosted in the data platform

    ·       Data cleaning: to purge the data on the Lake in a secure way

    ·       Data tools: data formatter, data anonymizer

       As a big data engineer, you’ll develop, maintain and create new cloud-oriented features hand-by-hand with DDS/Data Foundation teams to bring forward the data approach across all SG entities and subsidiaries.

Profile
  • Experience: 3-5 Years
  • Skills:

    -       Computer programming: Spark, Scala, Java, Python

    -       Operating system knowledge for Unix, Linux

    -       Databases and SQL

    -       ETL and data warehousing

    -       Hadoop

    -       Apach Spark

    Tasks:

    ·       Maintain an excellent service level of the platform and avoid issues.

    ·       Researching new methods of obtaining valuable data and improving its quality

    ·       Creating and enhancing data solutions using various programming languages and tools

    ·       Creating and enhancing data architectures that meet the requirements of the business

    ·       Communicate inside if the tech league group to find new approaches

Skills Required

  • 3-5 years experience in data engineering
  • Spark / Apache Spark
  • Scala
  • Java
  • Python
  • Unix / Linux operating systems
  • Databases and SQL
  • ETL and data warehousing
  • Hadoop
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: London
5,017 Employees
Year Founded: 2007

What We Do

Photon.com has emerged as one of the world’s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit www.photon.com to learn more about us, how we work, and our customer case studies. Digital Transformation Starts Here.

Similar Jobs

Coursera + Udemy  Logo Coursera + Udemy

Revenue Operations Manager

Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
Remote or Hybrid
India
1500 Employees

Atlassian Logo Atlassian

Data Engineering Manager

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
Bengaluru, Bengaluru Urban, Karnataka, IND
11000 Employees

Atlassian Logo Atlassian

Principal Software Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
Bengaluru, Bengaluru Urban, Karnataka, IND
11000 Employees

Atlassian Logo Atlassian

Principal Data Scientist

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Remote
India
11000 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account