Senior Data Engineer

Overview & Responsibilities

PURPOSE OF THE JOB

The Senior Data Engineer will build robust and complicated data pipelines required for moving data from various source systems into the Enterprise Data Lakehouse. The Senior Data Engineer will be responsible for architecting, troubleshooting and designing complex workflows and transformations.

BACKGROUND and EXPERIENCE

Education: Master’s in Computer Science, Information Systems, Data Science, Analytics.

Experience: Minimum 10 years hands on experience as an ETL engineer.

Technical Skills: Well versed with using various database systems like Oracle, SQL Server etc. Experience in the cloud preferably AWS, SQL, Data modeling, Informatica, Fivetran or Azure Data Factory. Experience with at least 3 to 5 years on Databricks is required. Deep understanding of extracting data from ODBC sources along with usage of APIs.  Basic Python skills necessary.

Business skills: Should be able to work with various applications and business units, along with the Data analysts, visualization engineer and data scientist. Requires sophisticated skills to

understand, influence, drive, and negotiate with internal customers. Uses initiative and extensive knowledge to resolve complex issues, developing new or novel solutions.

SPECIFIC JOB RESPONSIBILITIES/COMPETENCIES

Review source to target mapping documents.

Design and document ETL pipelines using industry standard ETL tools. Streamline and build robust data pipelines, with clear visibility into lineage of the data.

Responsible for monitoring the flow of the data across various databases, cloud and on premise.

Implement best practices and standardize data integration across all the sources.

Profile and detect data anomalies and provide solutions for improving the quality of the data.

Build and implement Master Data Management processes, while defining algorithms and building code for cleansing the data.

Establish highly robust and efficient data flows with logging and efficient troubleshooting methods.

Be able to work in a fast pace and changing environment.

Consulted by others for their ability to identify, understand and analyze complex business concepts.

Is forward thinking in approach and considers the effect of current action on future company outcomes.

Requires the ability to work independently and to provide consultative advice on specific technical issues.

Develops new and sometimes novel resolution of complex issues and works on all application and data integration issues

Equal Employment Opportunity

Ebara Elliott Energy is an equal employment opportunity/affirmative action employer and does not discriminate on the basis of race, color, religion, sex, national origin, age, marital status, genetic information, disability, veteran status, or any other characteristic protected by the federal, state or local laws of the United States. Applicants and employees are protected under U.S. federal law from discrimination. To learn more, click here.
Pay Transparency Nondiscrimination Provision
Ebara Elliott Energy follows Executive Order 11246, including the Pay Transparency Nondiscrimination Provision. To learn more, click here.

To learn more about our Job Applicant Privacy Notice, please click here.

No agency submissions please. NOTE: Resumes submitted to any Ebara Elliott Energy employee without a current, signed and valid contract in place with the Ebara Elliott Energy recruiting team will become the property of Ebara Elliott Energy and no search fees will be paid.