Sr Staff Data Engineer

Job Description SummaryResponsible for expanding and optimizing overall data architecture and data engineering solutions. Will be supporting data analysts, solution architects, data scientists and product managers to deliver data analytical and reporting solutions. Accountable for managing multiple data domains and delivering wing to wing data solutions that include establishing data pipelines, data flows, standardizing data models and setting up complex data transformation rules. Will be responsible for managing the solutions released to production through stabilization period.

Job Description

Roles and Responsibilities

• Handle multiple projects across multiple data domains in the Cost as a Technology team
• Provide thought leadership on data architecture and design, data modeling principles & Big Data strategy in the product cost data space.
• Develop and maintain an integrated data architecture spanning the relational and non-relational data landscape.
• Manage Extract, Transform & Load (ETL) framework and maintaining the quality and timeliness of the data Ingestion and transformation jobs.
• Drive reusability and ensure extensibility of overall data architecture
• Manage technical data dictionaries and support business glossaries
• Lead data profiling and data analysis for source systems, manually maintained data, machine or sensor generated data and target data repositories
• Design & validate both logical and physical data models for both Online Transaction Processing (OLTP) and Online Analytical Processing (OLAP) solutions
• Standardize automated Extract, Transform & Load (ETL) jobs based on data mapping specifications
• Define metadata structures needed for building reusable Extract, Transform & Load (ETL) components.
• Design common data structures for handling reference datasets and Master Data Management (MDM) datasets.
• Streamline data feeds to downstream systems/products and recommend alternatives to minimize the impact.
• Lead the efforts to build Data Quality (DQ) rules.

Education Qualification

• Bachelor’s degree from accredited university or college with minimum of 5 years of professional experience OR Associates degree with minimum of 8 years of professional experience OR High School Diploma with minimum of 10 years of professional experience
• Minimum 5 years of professional experience in data engineering.
• Note: Military experience is equivalent to professional experience

Eligibility Requirement:

• Legal authorization to work in the U.S. is required.  We will not sponsor individuals for employment visas, now or in the future, for this job.

Desired Characteristics

Technical Expertise:

• Experience in Massively Parallel Processing (MPP) databases, In-memory data processing engines, Big Data eco system tools and technologies
• Familiarity with cloud platform technologies like CloudFoundry
• Strong expertise in data modeling tools (e.g., ERWin, ER Studio, etc.).
• Strong expertise in Extract, Transform & Load (ETL) tools like Informatica or Talend
• Expertise in data catalog, automated data discovery and data lineage tools (e.g., Alation, Collibra, TAMR, etc., )
• Hands-on experience in programming languages like Java, Python or Scala
• Hands-on experience in writing SQL scripts for Oracle, MySQL, PostgreSQL or HiveQL
• Experience with Big Data / Hadoop / Spark / Hive / NoSQL database engines (i.e. Cassandra or HBase)
• Exposure to unstructured datasets and ability to handle XML, JSON file formats
• Conducts exploratory, descriptive, predictive data analysis and generate visual summaries of data. Identify data quality issues proactively.

Domain Expertise:

• Exposure to handling machine or sensor datasets from industrial businesses
• Knowledge of for industrial applications in a commercial/finance/industrial/manufacturing settings.
• Exposure to finance and accounting data domains

Leadership Skills:

• Strong influencing and executive communication skills
• Demonstrates ability to lead and work in a matrix organization structure
• Highly self-motivated, able to work independently and accommodate multiple time zones

This role requires access to U.S. export-controlled information. Therefore, for applicants who are not asylees, refugees, lawful permanent residents or U.S. Citizens (i.e., not a protected individual under the Immigration and Naturalization Act, 8 U.S.C. 1324b(a)(3), otherwise known as a U.S. Person), final offers will be contingent on the ability to obtain authorization for access to U.S. export-controlled information from the U.S. Government.

Additional Information