Job Description:
We are seeking a highly technical and experienced Application ETL SQL Hadoop Developer / Engineer to support the design, architecture and development of Enterprise Information / Data Science Products owned and operated by the Chief Data Scientist Organization (CDSO). This role will support the Enterprise Risk Analytics (ERA) and Global Financial Crimes (GFC) project efforts for the CDSO systems engineering / application development team with development on enterprise Teradata/SASGRID/Hadoop/Spark platforms. Qualified candidates must be well-versed in building ETL/analytical products and applications using SQL (Teradata) and Hadoop (Hive/Spark/PySpark) based programs
Responsibilities:
• Typically 7-10 years of experience.
• Develops, enhances, debugs, supports, maintains and tests data applications that support business units or supporting functions. These application program solutions may involve diverse data development platforms, software, hardware, technologies and tools.
• Supports end-to-end data-warehouse application architecture and development including requirements gathering, design, coding, testing and implementation of complex ETL workloads - SQL(Teradata) and Hadoop (Hive/Spark)-based applications
• Work directly with product owners to understand requirements, and align to platform technology stack and design and document solutions / methods for data sourcing and provisioning
• As a Developer, take accountability / ownership of the coding, testing and deployment framework for end-to-end application development using agile methodology and SDM tools on the enterprise data platform(s)
• Supports systems through maintenance, modification, problem resolution to support ongoing delivery of application ETL services and/or operations on the big data platform
• Serves as a fully seasoned/proficient technical resource - should be ready to get into the weeds of the code, analyze and research data and optimization problems, discuss technical details with the development/support team.
• Provides tech knowledge and capabilities as team member and individual contributor, but also responsible for instructing, directing, and checking the quality and timeliness of other systems professionals, including offshore resources.
• May lead multiple projects with competing deadlines.
• Works under minimal supervision, with general guidance from manager.
Primary Skill
Teradata
Secondary Skill
Hadoop
Tertiary Skill
Python
Required Skills
Required Skills
• Computer Science/Software Engineering (or related) degree
• 7+ years' experience with end-to-end application development on Teradata / Hadoop data-warehouse and analytical platforms
• Extensive experience developing complex Teradata SQL-based ETL and analytic workflows using native utilities (bteq, tpt, fastexport)
• Experience working with Big Data Technologies, programs and toolsets like Hadoop, Hive, Sqoop, Impala, Kafka, and Python/Spark/PySpark workloads
• Very good knowledge of Unix/Linux shell Scripting and scheduling (like Autosys)
• Good knowledge of Business Intelligence and reporting tools like Tableau
• Knowledge and experience working with CI / CD based development and deployment - JIRA, BitBucket
• Excellent written, communication and diagramming skills
• Strong analytical and problem solving abilities
• Speaking / presentation skills in a professional setting
• Excellent interpersonal skills and a team player to work all along with Global teams and business partners
• Positive attitude and flexible
• Willingness to learn new skills and adapt to changes
Desired Skills
Desired Skills • Industry certifications in Teradata and Big Data Technologies like Hadoop (cloudera), Hive, Sqoop, Impala, Kafka, MapReduce.
Shift:
1st shift (United States of America)
Hours Per Week:
40