Job Description We are looking for an ETL Software Engineer to be a key member of the Data Distribution As A Service (DDAS) program team. The DDAS program aims to replace the existing proprietary Ab Initio-based ETL platform with an open-source Java/Spark-based platform. The candidate must be self-motivated with a strong background in the Java/Spark technology domain. Technical and intellectual curiosity is required, along with the ability to pick up concepts and techniques quickly in order to execute this ETL platform modernization project. Technical debugging and problem resolution are important components of the position. As we work with diverse datasets, a deep understanding of data architecture, ETL, and query optimization is required. This job requires the incumbent to work closely with Product Owners, Scrum Masters, and Technical Analysts to ensure that their technology solutions meet our modernization requirements, and help coordinate release deliverables across scrum teams to ensure that a successful, consistent process is followed by all implementation teams.
This person will be responsible for the following key areas:
1. Creation of ETL Data Pipeline processes to validate, transform, enrich, and integrate data
2. Adopt cutting edge technologies such as cloud/containers as a part of application evolution and modernization
3. Understand business requirements and collaborate with the architecture team to translate them into technical design
4. Participate in end-to-end development lifecycle activities of the application, including design, coding, testing, and deployment activities.
5. Produce comprehensive tests for all developed code. Support and participate in the system and integrated testing across sub-systems as the need arises.
6. Provide technical support for the application on a rotational basis, including meeting service level and performance requirements; and diagnosing and evaluating inefficient processes/code.
Required Skills:
a. Bachelor's degree or equivalent in Computer Science, Engineering (any), or related field.
b. 4+ years of experience in the design and delivery of ETL solutions Java (preferred), Spark (intermediate)
c. 1+ years of experience in Cloud deployment (AWS, Kubernetes), Kafka, CI / CD, Automation
d. Extensive Knowledge of application, design patterns, data, and infrastructure architecture disciplines
e. Experience in UNIX and/or AIX operating environment and UNIX shell scripting is required
f. 2+ experience in modifying and writing complex SQL queries
g. Working experience as an Agile developer and a good understanding of SDLC methodologies/guidelines
h. Knowledge of big data technologies like Hadoop/HIVE/Spark/Flink
Ideal candidates should possess:
a. Advanced concepts of data integration architecture
b. An extensive understanding of data modeling concepts
c. A deep grasp of various components of standard ETL Data Pipeline tools
d. In-depth design and development experience with data integration solutions using Java/Spark
e. Prior experience in working with data pipelines in a cloud or Kubernetes environment
f. Demonstrable knowledge of UNIX operating systems and shell scripting
g. Working knowledge of scheduling tools such as Control-Center or Ctrl-M
h. Strong grasp on SDLC concepts including development best practices, code migration procedures, and test automation
i. Ability to work in an Agile development environment against challenging project timelines
j. BS/BA degree or equivalent experience
Additionally, an understanding of at least some of these technologies and practices is beneficial:
a. Knowledge of test automation frameworks such as Cucumber, Selenium, Chef
b. Working knowledge of Kafka as a distributed publish-subscribe system
c. Working knowledge of Python
d. Understanding of modern cyber security practices such as Kerberos authentication
e. Working knowledge of vendor-based ETL platforms and infrastructure like Ab Initio (preferred), Informatica, etc.
About Us JPMorgan Chase & Co., one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. In accordance with applicable law, we make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as any mental health or physical disability needs.
The health and safety of our colleagues, candidates, clients and communities has been a top priority in light of the COVID-19 pandemic. JPMorgan Chase was awarded the "WELL Health-Safety Rating" for all of our 6,200 locations globally based on our operational policies, maintenance protocols, stakeholder engagement and emergency plans to address a post-COVID-19 environment.
As a part of our commitment to health and safety, we have implemented various COVID-related health and safety requirements for our workforce. Employees are expected to follow the Firm's current COVID-19 or other infectious disease health and safety requirements, including local requirements. Requirements include sharing information including your vaccine card in the firm's vaccine record tool, and may include mask wearing. Requirements may change in the future with the evolving public health landscape. JPMorgan Chase will consider accommodation requests as required by applicable law.
Equal Opportunity Employer/Disability/Veterans
About the Team Our Consumer & Community Banking Group depends on innovators like you to serve consumers, small businesses, municipalities and non-profits. You'll support the delivery of award winning tools and services that cover everything from personal and small business banking as well as lending, mortgages, credit cards, payments, auto finance and investment advice. This group is also focused on developing and delivering cutting edged mobile applications, digital experiences and next generation banking technology solutions to better serve our clients and customers.