Lead Data Engineer

Posted 10 Days Ago
Washington, VA
7+ Years Experience
Fintech • Consulting
The Role
The Lead Data Engineer will design and implement scalable data pipelines on Google Cloud, ensuring data quality and automation. Responsibilities include mentoring junior engineers, leading security initiatives, and driving data governance best practices while overseeing a transformation to cloud-based solutions.
Summary Generated by Built In

Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you.

Equifax is searching for a Data Engineering Lead to join our world-class Entity Resolution (Keying & Linking) team within the Global Data & Analytics CoE. The successful candidate will lead our transformation of Entity Resolution capabilities to the Google Cloud and establish processes and practices for linking Equifax, partner and customer data to facilitate insights about businesses and the relationships between them. They may lead a small team of data scientists and data engineers who will explore a wide range of data assets using cutting edge analytics and statistics.

This role requires understanding large, diverse data sources and extensive experience developing data matching and entity resolution rules. Experience linking data about consumers and/or businesses will be critical as well.

Equifax has a hybrid work schedule that allows for 2 days of remote work (Monday and Friday), with 3 days onsite (Tuesday, Wednesday, Thursday) every week.

This role will work the required onsite days at our Equifax office in Alpharetta, GA or Reston, VA. 

Sponsorship is not available for this position. This is a direct-hire role and is not open to C2C or vendors.
 

What you will do 

  • Design, architect, and implement scalable and secure data pipelines on GCP, utilizing services like Dataflow, Pub/Sub, and Cloud Storage.

  • Develop and maintain data models, ensuring data quality, consistency, and accessibility for various internal stakeholders.

  • Automate data processes and workflows using scripting languages like Python, leveraging technologies like Spark.

  • Monitor and troubleshoot data pipelines, identifying and resolving performance issues proactively.

  • Stay up-to-date with the latest trends and advancements in GCP and related technologies, actively proposing and evaluating new solutions.

  • Implement data governance best practices, including data security, access control, and lineage tracking.

  • Lead security initiatives, design and implement security architecture.

  • Lead data quality initiatives, design and implement monitoring dashboards.

  • Mentor and guide junior data engineers, sharing knowledge and best practices to foster a high-performing team.

  • Role requires a solid educational foundation and the ability to develop a strategic vision and roadmap for D&A’s transition to the cloud while balancing delivery of near-term results that are aligned with execution.

What experience you will need 

  • BS degree in a STEM major or equivalent discipline; Master’s Degree strongly preferred

  • 7+ years of experience as a data engineer or related role, with experience demonstrating leadership capabilities.

  • A Cloud certification is strongly preferred.

  • Expert level skills using programming languages such as Python or SQL, NoSQL (or related technologies), and advanced level experience with other scripting languages. 

  • Demonstrated proficiency in all Google Cloud Services.

  • Experience building and maintaining complex data pipelines, troubleshooting complex issues, transforming and entering data into a data pipeline in order for the content to be digested and usable for future projects.

  • Experience designing and implementing advanced to complex data models and experience enabling advanced optimization to improve performance.

  • Experience leading a team with Git expertise strongly preferred.

What could set you apart 

  • Masters Degree or PhD in Data/Computer Science, Statistics, Mathematics, Economics or other related disciplines.

  • Knowledge of credit bureau data, and familiarity with the laws like FCRA, GLBA, and GDPR.

  • Experience or advanced degree with focus on Entity Resolution concepts, prototype or hands-on projects related to graph, vector DB, embeddings

  • Experience in Data Visualization and storytelling.

  • Experience leading international engagements and collaborating with international teams.

  • Hands-on code development experience with strong coding ethics.

  • Working knowledge of MLOps, performance tracking, and state-of-the-art tools & frameworks a plus.

#LI-Hybrid

#LI-KD1

We offer comprehensive compensation and healthcare packages, 401k matching, paid time off, and organizational growth potential through our online learning platform with guided career tracks.

Are you ready to power your possible? Apply today, and get started on a path toward an exciting new career at Equifax, where you can make a difference!

Primary Location:

USA Washington-DC (Reston VA)

USA-Atlanta JV White

Function:

Function - Data and Analytics

Schedule:

Full time

Top Skills

Python
SQL
The Company
HQ: Atlanta, GA
16,742 Employees
On-site Workplace

What We Do

At Equifax (NYSE: EFX), we believe knowledge drives progress. As a global data, analytics, and technology company, we play an essential role in the global economy by helping financial institutions, companies, employers, and government agencies make critical decisions with greater confidence. Our unique blend of differentiated data, analytics, and cloud technology drives insights to power decisions to move people forward.

Headquartered in Atlanta and supported by nearly 15,000 employees worldwide, Equifax operates or has investments in 24 countries in North America, Central and South America, Europe, and the Asia Pacific region.

For more information, visit Equifax.com.

Jobs at Similar Companies

MassMutual India Logo MassMutual India

BI Platform Engineer

Big Data • Fintech • Information Technology • Insurance • Financial Services
Hyderabad, Telangana, IND

Eastwall Logo Eastwall

Solution Architect

Artificial Intelligence • Cloud • Information Technology • Software • Consulting • App development • Big Data Analytics
Remote
United States
20 Employees
150K-180K Annually

Energy CX Logo Energy CX

Strategic Account Executive

Greentech • Professional Services • Business Intelligence • Consulting • Energy • Financial Services • Utilities
Easy Apply
Chicago, IL, USA
55 Employees

Similar Companies Hiring

Eastwall Thumbnail
Software • Information Technology • Consulting • Cloud • Big Data Analytics • Artificial Intelligence • App development
Denver, CO
20 Employees
Energy CX Thumbnail
Utilities • Professional Services • Greentech • Financial Services • Energy • Consulting • Business Intelligence
Chicago, IL
55 Employees
MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, IN

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account