Data Engineer (Python & SQL)

Reposted Yesterday
Be an Early Applicant
Pune, Maharashtra, IND
In-Office
Senior level
Fintech • Consulting
The Role
As a Senior Data Engineer, you'll design and maintain data ingestion platforms, build data pipelines, ensure data quality, and mentor junior engineers.
Summary Generated by Built In

Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds,  and make a meaningful impact, we want to hear from you.

We're looking for a highly skilled and experienced Senior Data Engineer to join our team. You'll be instrumental in designing, building, and maintaining our next-generation Data Ingestion platform and its infrastructure. This role requires a deep understanding of distributed systems and hands-on expertise with cutting-edge big data technologies in a cloud-native environment.

You will be responsible for creating robust, scalable, and fault-tolerant data pipelines that process massive datasets for both real-time and batch-based analytics. Your work will directly enable our data scientists, analysts, and business teams to derive critical insights and make data-driven decisions.

Perform general application development activities, including unit testing, code deployment to development environment and technical documentation.  Works on one or more projects, making contributions to unfamiliar code written by  team members.

What you’ll do

  • Apply the knowledge of data characteristics and data supply pattern, develop rules and tracking process to support data quality model. 

  • Prepare data for analytical use by building data pipelines to gather data from multiple sources and systems.

  • Integrate, consolidate, cleanse and structure data for use by our clients in our solutions.

  • Perform design, creation, and interpretation of large and highly complex datasets.

  • Stay up-to-date with the latest trends and advancements in GCP and related technologies, actively proposing and evaluating new solutions.

  • Understand best practices for data management, maintenance, reporting and security and use that knowledge to implement improvements in our solutions.
    Implement security best practices in pipelines and infrastructure.

  • Develop and implement data quality checks and troubleshoot data anomalies.

  • Provide guidance and mentorship to junior data engineers.

  • Review dataset implementations performed by junior data engineers.

  • Perform general application development activities, including unit testing, code deployment to development environment and technical documentation.

  • Work on one or more projects, making contributions to unfamiliar code written by team members.

What experience you need  

  • BS degree in a STEM major or equivalent discipline; Master’s Degree strongly preferred

  • 3+ years of experience as a data engineer or related role

  • 3+ years of software engineering experience

  • Advanced skills using programming languages such as Python or Java

  • SQL and intermediate level experience with scripting languages

  • 3+ years experience with Cloud technology: GCP, AWS, or Azure

  • 3+ years experience designing and developing cloud-native solutions

  • Experience building and maintaining moderately-complex data pipelines, troubleshooting issues, transforming and entering data into a data pipeline in order for the content to be digested and usable for future projects

  • Demonstrates advanced Git usage and CI/CD integration skills

What could set you apart

  • 3+ years of hands-on experience in data engineering or a related field.

  • Expert-level proficiency in SQL, Python or relevant programming languages

  • Demonstrated experience designing and implementing distributed data processing solutions at scale.

  • In-depth, hands-on experience with BigData tools such as  Apache Spark or Apache Beam.

  • Proven experience with Google Cloud Platform (GCP) services for data engineering, including Dataflow, Dataproc, BigQuery, and Pub/Sub.

  • Experience with workflow orchestration tools like Apache Airflow (or GCP's Cloud Composer).

  • Solid understanding of data modeling, data warehousing, and ETL/ELT best practices.

  • Background of Large Data Analysis and building AI ML Models would be a huge plus.

  • Excellent problem-solving skills and the ability to troubleshoot complex distributed systems.

  • Effective communication and collaboration skills, with the ability to articulate technical concepts to both technical and non-technical stakeholders

We offer a hybrid work setting, comprehensive compensation and healthcare packages, attractive paid time off, and organizational growth potential through our online learning platform with guided career tracks.

Are you ready to power your possible?  Apply today, and get started on a path toward an exciting new career at Equifax, where you can make a difference!

Primary Location:

IND-Pune-Equifax Analytics-PEC

Function:

Function - Tech Dev and Client Services

Schedule:

Full time

Skills Required

  • BS degree in a STEM major or equivalent discipline; Master's Degree strongly preferred
  • 3+ years of experience as a data engineer or related role
  • 3+ years of software engineering experience
  • Advanced skills using Python or Java
  • SQL and intermediate scripting languages
  • 3+ years experience with Cloud technology: GCP, AWS, or Azure
  • 3+ years experience designing and developing cloud-native solutions
  • Experience with building and maintaining data pipelines
  • Demonstrates advanced Git usage and CI/CD integration skills

Equifax Inc. Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Equifax Inc. and has not been reviewed or approved by Equifax Inc..

  • Retirement Support Savings programs include a 401(k) with company matching and, in some contexts, profit-sharing or pension components. These are described as solid parts of the total package.
  • Parental & Family Support Programs include paid parental leave for birth and non-birthing parents and adoption assistance. Company materials highlight these benefits as part of a family-supportive offering.
  • Flexible Benefits Multiple medical plan choices, dental and vision options, FSAs/HSAs, and voluntary supplemental coverages enable customization. The company publishes plan summaries and SPDs to help compare cost and coverage by location and tier.

Equifax Inc. Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Atlanta, GA
16,742 Employees

What We Do

At Equifax (NYSE: EFX), we believe knowledge drives progress. As a global data, analytics, and technology company, we play an essential role in the global economy by helping financial institutions, companies, employers, and government agencies make critical decisions with greater confidence. Our unique blend of differentiated data, analytics, and cloud technology drives insights to power decisions to move people forward. Headquartered in Atlanta and supported by nearly 15,000 employees worldwide, Equifax operates or has investments in 24 countries in North America, Central and South America, Europe, and the Asia Pacific region. For more information, visit Equifax.com.

Similar Jobs

Wolters Kluwer Logo Wolters Kluwer

Senior Data Engineer

Information Technology • Software
In-Office
Pune, Maharashtra, IND
18996 Employees
60K-90K Annually
In-Office
Mumbai, Maharashtra, IND
2115 Employees

Coupa Logo Coupa

Senior Software Engineer

Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
In-Office
Pune, Maharashtra, IND
2500 Employees

CrowdStrike Logo CrowdStrike

Sales Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Hybrid
3 Locations
10000 Employees

Similar Companies Hiring

Rain Thumbnail
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3 • Infrastructure as a Service (IaaS)
New York, NY
100 Employees
Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account