Senior Data Engineer

Position Description: 

Develops front-end and webservice applications using Angular. Builds sustainable Extract, Transform, Load (ETL) data pipelines and deploys Artificial Intelligence/Machine Learning (AI/ML) models using RESTful Application Programming Interfaces (APIs) to measure deployed model effectiveness. Deploys data movement solutions, applications, and data centric APIs to deliver innovative products and services. Develops ETL workflows in Oracle, Hadoop, and AWS/Snowflake using Informatica or Python to structure data for AI model training and development. Builds data webservice APIs in Java and Python to feed into productionalized models. 

Primary Responsibilities: 

• Delivers high quality data solutions in a multi-developer Agile environment using coding best practices and modern Continuous Integration/Continuous Delivery (CI/CD) pipelines. 

• Designs, develops, and modifies systems using data analysis and models to predict and measure outcomes and consequences of design. 

• Stores, retrieves, and manipulates data for analysis of system capabilities and requirements. 

• Assesses database performance utilizes management software such as Oracle. 

• Modifies software to correct errors, to allow it to adapt to new hardware, or to improve its performance. 

• Analyzes user needs and software requirements to determine feasibility of design within constraints. 

• Develops software system tests and validation procedures, programs, and documentation. 

Education and Experience: 

Bachelor’s degree (or foreign education equivalent) in Business Analytics, Computer Science, Engineering, Information Technology, Information Systems, Mathematics, Physics, or a closely related field and three (3) years of experience as a Senior Data Engineer (or closely related occupation) developing scalable data flows for AI model training in a financial services industry. 

Or, alternatively, Master’s degree (or foreign education equivalent) in Business Analytics, Computer Science, Engineering, Information Technology, Information Systems, Mathematics, Physics, or a closely related field and one (1) year of experience as a Senior Data Engineer (or closely related occupation) developing scalable data flows for AI model training in a financial services industry. 

Skills and Knowledge: 

Candidate must also possess: 

• Demonstrated Expertise (“DE”) developing scalable and advanced Natural Language Programming (NLP) solutions for financial documents using Python and design patterns; performing NLP development and engineering using AWS Textract, AWS Sagemaker, and Cloud Formation; and creating high-quality end-to-end solutions using NLP techniques and frameworks (NLTK). 

• DE developing Cloud technologies, including AWS Lambda, to implement security practices (authentication, authorization, and secrets management) using AWS Vault, CloudWatch, CloudFormation, notification systems (SQS and SNS), and Shell Scripting (in Unix). 

• DE creating UI/UX designs with Angular 10 and PrimeNg library, to develop Single-Page Applications (SPAs) using Angular components; creating visually stunning dashboards and insights for business end users to provide actionable insights, using data visualization tools -- PowerBI, Tableau, and SSIS/SSRS. 

• DE building and maintaining Data Warehouse ETL jobs using Airflow; writing efficient PL/SQL code on RDS and Oracle Databases; and maintaining production and supporting business growth using customized Datadog dashboards to monitor job performance. 

#PE1M2