Data Engineer III
Job Description:
Role/Team Overview :
Corporate Investments Data Warehouse (CIDW) and Transaction Hub (THUB) are data warehouses supported by the Data Horizontal team within Risk & Finance Technology. The Data Horizontal team is in process of modernizing the legacy tech stack of Informatica, Oracle, Autosys by transitioning to Meta Data driven ETL automation, Rules Engine processing, Airflow orchestration, and CI/CD test driven data pipelines.
Responsibilities:
As a data engineer, a candidate will be expected to help the team craft data solutions to meet business and enterprise requirements using SQL, Python, Oracle Exadata and emerging data technologies.
Required Skills and Experience we are Looking For :
- 5+ years Practical working experience with relational databases, preferably Oracle Exadata.
- Experience with Data Warehouse / Data Mart / Business Intelligence concepts.
- Intermediate experience with Python (e.g. Pandas, Data Frames) and use in data processing solutions.
- Strong practical working experience with Unix scripting in at least one of Python, Perl, Shell (either bash or zsh).
- Experience designing and building data warehouses and knowledge of the data flows involved.
- Practical working experience using ETL tools, preferably Informatica.
- Bachelors Degree in Computer Science / Engineering / Math related domain.
Desired Skills :
- Design and development experience in modern technologies such as API management, REST/API integration, Containers, Micro services.
- Banking / Capital Markets / Accounting domain knowledge.
- Implementing ETL with PySpark.
- Experience or familiarity with orchestration tools, such as Airflow.
- Experience with CI/CD processes and tools (e.g. Ansible, Jenkins).
- Willingness to take on problems outside of current skillset and experience.
Shift:
1st shift (United States of America)
Hours Per Week:
40