ETL Data Engineer (ONSITE)

Posted 23 Days Ago
Washington, DC
3-5 Years Experience
Information Technology
The Role
The ETL Data Engineer will analyze, design, and develop ETL processes, manage complex data workflows using Azure tools, and ensure data integrity and governance. Responsibilities include creating end-to-end pipelines, automating workflows, and collaborating with teams to enhance data systems.
Summary Generated by Built In

Job Title: ETL Data Engineer (ONSITE)
Location: Washington, DC
Duration: 12 Months+
Job Description:
The Enterprise Data team at client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.
The ETL data engineer will support the client Enterprise Data team for data curation, processing, and transformation tasks. Specifically, the ETL data engineer will be responsible for the following tasks:
Responsibilities:

  • Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.
  • Interfaces with other agencies, consult with and inform user departments on system requirements, advise on environment constraints and operating difficulties for the current state and advise and resolve problems using cloud solutions and develop and replicate future enhancements to District’s data systems.
  • Strong knowledge of Extraction, Transformation and Loading (ETL) processes using frameworks like Azure Data Factory, Synapse, Databricks, Informatica by gathering requirements from the stake holders or analyzing the existing code and perform enhancements or new development.
  • Establishing the cloud and on-premise connectivity in different systems like ADLS, ADF, Synapse, Databricks
  • Hands on experience in Azure cloud services like Azure Data Factory or Azure Synapse, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, Python etc.
  • Worked on creating end to end pipelines to load data by reading it from multiple sources or source systems and load to landing layer or SQL tables.
  • Familiarity/experience with data integration and data pipeline tools (e.g., Informatica, Synapse, Apache NiFi, Apache Airflow)
  • Familiarity/experience with various data formats including database specific (Oracle, SQL Server, DB2, Quickbase), text formats(CSV, XML) and Binary(Parquet, AVRO)
  • Develops, standardizes and optimizes existing data workflow/pipelines adhering to best practices.
  • Adhere and contribute to enterprise data governance standards by ensuring data accuracy, consistency, security, and reliability.
  • Automates, monitors, alerts, and manages data pipelines and workflows.
  • Analyzes and evaluates system changes to determine feasibility, provides alternative solutions, back-up, and rollback procedures.
  • Works on the development of new systems, upgrades and enhancements to existing systems and ensure systems follow approved standards and consistency after the changes.
  • Develops complex programs and reports in database query language.
  • Familiarity/experience with data visualization tools.
  • Familiarity/experience handling and securing sensitive data based on the level of the sensitivity


Responsibilities:

  • Demonstrates expertise in conveying technical and functional concepts for a specific technical specialty.
  • Identifies improvements to project standards to achieve high quality services/ products. This is a professional position which may require subject matter expertise consistent with demanding and rare technological skills.
  • May require coordination of programming activities being conducted by the application development team
  • Confers with other business and technical personnel to resolve problems of intent, inaccuracy, or feasibility of computer processing and project design.
  • Works with necessary personnel to determine if modifications are necessary with interested personnel to determine necessity for modifications or enhancements.
  • Leverages excellent written and verbal communication skills to develop new business process and programming solutions as directed by business and technical stakeholders.
  • May coordinate activities of application developers.11-
  • Able to identify best practices and standards for the use of the product.
  • Proven track record of hands-on technical design and code work within large complex systems.
  • Proven hands-on technical work with a variety of technologies.
  • Demonstrated technical expertise integrating a variety of diverse technical environments and cross-platform technologies.
  • Delivers support and design for industry specific applications that require integration with statewide systems or applications.
  • Interacts with executive level business users or technical experts.
  • Advanced experience in the required technical subject matter.
  • May function as a niche technical SME (Subject Matter Expert).
  • Has proven experience across large and complex implementations and systems.


Minimum Education/Certification Requirements:

  • Bachelor’s degree in Information Technology or related field or equivalent experience


Skills:
 

Skills Required / Desired Amount of Experience Strong knowledge for development of Extract-Transform-Load (ETL) processes, including end-to-end pipelines with data loading from multiple sources Required 15 Years Ability to gather and document requirements for data extraction, transformation and load processes Required 15 Years Understanding of data warehousing, data lake, business intelligence and information management concepts and standards. Required 15 Years Ability to advise internal and external customers on appropriate tools and systems for complex data processing challenges. Required 15 Years Knowledge and use of SQL for relational databases Required 11 Years Experience with various data formats including database specific (Oracle, SQL, Postgres, DB2), text formats (CSV, XML) and Binary (Parquet, AVRO) Required 11 Years Contribute to enterprise data governance standards by ensuring accuracy, consistency, security and reliability Required 7 Years Strong experience with Microsoft Azure tools such as Azure Data Factory, Synapse, SQL Database, Data Lake Storage Gen2, Blob Storage Required 5 Years Experience with data integration and data pipeline tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow and FME Required 5 Years Experience with visualization and reporting software such as MicroStrategy, Tableau, and Esri ArcGIS Highly desired 3 Years Strong communication skills, both oral and written Required 3 Years Ability to provide excellent customer service to external partners Required 3 Years Ability to work independently or as part of a larger team Required 3 Years Experience performing data functions with Databricks Highly desired 3 Years

Top Skills

Python
The Company
HQ: Baltimore, MD
146 Employees
On-site Workplace

What We Do

Serigor provides IT Services and IT staffing to Government and Commercial enterprises of all sizes. Serigor has twelve years of proven track record in IT Services, Government Solutions, and Staffing Solutions.

● MBE/WBE/WBENC/WOSB company, headquartered in Baltimore, MD.

● Multiple, multi-year contracts with Government Agencies at State, County, City, and Federal.

● Commercial clients include Fortune 1000 and Start-Ups all over the US.

● Onshore and offshore IT delivery centers.

● IT solutions encompass contracts that are Fixed Price, T&M, Product Development in all technologies.

● Workforce and staffing solutions encompass contract, contract-to-hire, permanent placement and statement of work job assignments.

Jobs at Similar Companies

Jobba Trade Technologies, Inc. Logo Jobba Trade Technologies, Inc.

Customer Success Specialist

Cloud • Information Technology • Productivity • Professional Services • Software
Remote
Hybrid
Chicago, IL, USA
45 Employees

Silverfort Logo Silverfort

Marketing Analyst

Information Technology • Sales • Security • Cybersecurity • Automation
Remote
United States
357 Employees

InCommodities Logo InCommodities

Senior Software Developer - NA

Information Technology • Machine Learning • Analytics • Energy • Automation • Renewable Energy
Hybrid
Austin, TX, USA
234 Employees

Similar Companies Hiring

Silverfort Thumbnail
Security • Sales • Information Technology • Cybersecurity • Automation
GB
357 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees
InCommodities Thumbnail
Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
Austin, TX
234 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account