Senior Data Engineer

Sorry, this job was removed at 08:12 p.m. (CST) on Thursday, May 29, 2025
Be an Early Applicant
2 Locations
In-Office
Consulting
The Role

Job Family:

Data Science & Analysis (India)


Travel Required:

None


Clearance Required:

None

What You Will Do:
 

  • Design, develop, and maintain robust, scalable, and efficient data pipelines and ETL/ELT processes.
  • Lead and execute data engineering projects from inception to completion, ensuring timely delivery and high quality.
  • Build and optimize data architectures for operational and analytical purposes.
  • Collaborate with cross-functional teams to gather and define data requirements.
  • Implement data quality, data governance, and data security practices.
  • Manage and optimize cloud-based data platforms (Azure\AWS).
  • Develop and maintain Python/PySpark libraries for data ingestion, Processing and integration with both internal and external data sources.
  • Design and optimize scalable data pipelines using Azure data factory and Spark(Databricks)
  • Work with stakeholders, including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Develop frameworks for data ingestion, transformation, and validation.
  • Mentor junior data engineers and guide best practices in data engineering.
  • Evaluate and integrate new technologies and tools to improve data infrastructure.
  • Ensure compliance with data privacy regulations (HIPAA, etc.).
  • Monitor performance and troubleshoot issues across the data ecosystem.
  • Automated deployment of data pipelines using GIT hub actions \ Azure devops

What You Will Need:

  • Bachelors or master’s degree in computer science, Information Systems, Statistics, Math, Engineering, or related discipline.
  • Minimum 5 + years of solid hands-on experience in  data engineering and cloud services.
  • Extensive working experience with advanced SQL and deep understanding of SQL.
  • Good Experience in Azure data factory (ADF), Databricks , Python and PySpark.
  • Good experience in modern data storage concepts data lake, lake house.
  • Experience in other cloud services (AWS) and data processing technologies will be added advantage.
  • Ability to enhance , develop and resolve defects in ETL process using cloud services.
  • Experience handling large volumes (multiple terabytes) of incoming data from clients and 3rd party sources in various formats such as text, csv, EDI X12 files and access database.
  • Experience with software development methodologies (Agile, Waterfall) and version control tools
  • Highly motivated, strong problem solver, self-starter, and fast learner with demonstrated analytic and quantitative skills.
  • Good communication skill.

 
What Would Be Nice To Have:

  • AWS ETL Platform – Glue , S3
  • One or more programming languages such as Java, .Net
  • Experience in US health care domain and insurance claim processing.

What We Offer:

Guidehouse offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefits package that reflects our commitment to creating a diverse and supportive workplace.

About Guidehouse

Guidehouse is an Equal Opportunity Employer–Protected Veterans, Individuals with Disabilities or any other basis protected by law, ordinance, or regulation.

Guidehouse will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law or ordinance including the Fair Chance Ordinance of Los Angeles and San Francisco.

If you have visited our website for information about employment opportunities, or to apply for a position, and you require an accommodation, please contact Guidehouse Recruiting at 1-571-633-1711 or via email at [email protected]. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodation.

All communication regarding recruitment for a Guidehouse position will be sent from Guidehouse email domains including @guidehouse.com or [email protected].  Correspondence received by an applicant from any other domain should be considered unauthorized and will not be honored by Guidehouse.  Note that Guidehouse will never charge a fee or require a money transfer at any stage of the recruitment process and does not collect fees from educational institutions for participation in a recruitment event. Never provide your banking information to a third party purporting to need that information to proceed in the hiring process.

If any person or organization demands money related to a job opportunity with Guidehouse, please report the matter to Guidehouse’s Ethics Hotline. If you want to check the validity of correspondence you have received, please contact [email protected]. Guidehouse is not responsible for losses incurred (monetary or otherwise) from an applicant’s dealings with unauthorized third parties.

Guidehouse does not accept unsolicited resumes through or from search firms or staffing agencies. All unsolicited resumes will be considered the property of Guidehouse and Guidehouse will not be obligated to pay a placement fee.

Similar Jobs

MetLife Logo MetLife

Software Engineer

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
India
43000 Employees
7-7 Annually

Genesys Logo Genesys

Senior Data Engineer

Artificial Intelligence • Big Data • Cloud • Machine Learning • Software
In-Office
Chennai, Tamil Nadu, IND
6774 Employees

ClickUp Logo ClickUp

Senior Data Engineer

Cloud • Digital Media • Enterprise Web • Marketing Tech • Software
Remote or Hybrid
India
1000 Employees

Yassir Logo Yassir

Senior Data Engineer

Information Technology • Mobile • Consulting
Remote or Hybrid
8 Locations
1213 Employees
20K-200K Annually
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Washington, DC
12,000 Employees
Year Founded: 2018

What We Do

Guidehouse is a leading global provider of consulting services to the public sector and commercial markets, with broad capabilities in management, technology, and risk consulting. By combining our public and private sector expertise, we help clients address their most complex challenges and navigate significant regulatory pressures focusing on transformational change, business resiliency, and technology-driven innovation. Across a range of advisory, consulting, outsourcing, and digital services, we create scalable, innovative solutions that help our clients outwit complexity and position them for future growth and success.

The company has more than 12,000 professionals in over 50 locations globally. Guidehouse is a Veritas Capital portfolio company, led by seasoned professionals with proven and diverse expertise in traditional and emerging technologies, markets, and agenda-setting issues driving national and global economies.

Similar Companies Hiring

Energy CX Thumbnail
Utilities • Professional Services • Greentech • Financial Services • Energy • Consulting • Business Intelligence
Chicago, IL
108 Employees
Northslope Technologies Thumbnail
Software • Information Technology • Generative AI • Consulting • Artificial Intelligence • Analytics
Denver, CO
88 Employees
Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account