ETL Data Engineer

Job Title: ETL Data Engineer 

Dhaka Technologies Limited Company (DTLC) is hiring an ETL Data Engineer on behalf of the District of Columbia Office of the Chief Technology Officer (OCTO). The Enterprise Data team at OCTO requires an ETL data engineer to support data operations for its Cloud Data Exchange. The engineer uses native Azure tools to perform ETL, data loading, and data transformation tasks, and supports the Enterprise Data team with data curation, processing, and transformation. This is a senior technical position that requires subject matter expertise, a proven track record of hands-on design and code work within large and complex systems, and the ability to convey technical and functional concepts to executive-level business users and technical experts.

ETL and Pipeline Development

• Analyze, design, develop, implement, replicate, and support complex enterprise data projects.
  
• Develop ETL processes using frameworks such as Azure Data Factory, Synapse, Databricks, and Informatica, gathering requirements from stakeholders or analyzing existing code to perform enhancements and new development.
  
• Create end-to-end pipelines that read data from multiple sources or source systems and load it into landing layers or SQL tables.
  
• Establish cloud and on-premises connectivity across systems such as ADLS, Azure Data Factory, Synapse, and Databricks.
  
• Develop, standardize, and optimize existing data workflows and pipelines in line with best practices.
  
• Automate, monitor, alert on, and manage data pipelines and workflows.
  
• Develop complex programs and reports in database query language.
  

Data Governance and Quality

• Adhere to and contribute to enterprise data governance standards by ensuring data accuracy, consistency, security, and reliability.
  
• Handle and secure sensitive data according to its level of sensitivity.
  
• Work with various data formats, including database specific formats (Oracle, SQL Server, DB2, Quickbase), text formats (CSV, XML), and binary formats (Parquet, AVRO).
  

Systems Analysis and Support

• Analyze and evaluate system changes to determine feasibility, and provide alternative solutions, backup, and rollback procedures.
  
• Support the development of new systems and the upgrade and enhancement of existing systems, ensuring that systems follow approved standards and remain consistent after changes.
  
• Advise on environment constraints and operating difficulties, resolve problems using cloud solutions, and develop and replicate future enhancements to District data systems.
  
• Identify improvements to project standards and best practices for the use of the product.
  

Collaboration and Consultation

• Interface with other agencies and consult with and inform user departments on system requirements.
  
• Confer with business and technical personnel to resolve problems of intent, accuracy, or feasibility of computer processing and project design.
  
• Interact with executive-level business users and technical experts, and serve as a niche technical subject matter expert as needed.
  
• Coordinate programming activities conducted by the application development team as needed.
  

• 15+ years developing extract, transform, and load (ETL) processes, including end-to-end pipelines with data loading from multiple sources
  
• 15+ years gathering and documenting requirements for data extraction, transformation, and load processes
  
• 15+ years of understanding of data warehousing, data lake, business intelligence, and information management concepts and standards
  
• 15+ years advising internal and external customers on appropriate tools and systems for complex data processing challenges
  
• 11+ years of knowledge and use of SQL for relational databases
  
• 11+ years with various data formats, including database specific (Oracle, SQL, Postgres, DB2), text formats (CSV, XML), and binary formats (Parquet, AVRO)
  
• 7+ years contributing to enterprise data governance standards by ensuring accuracy, consistency, security, and reliability
  
• 5+ years with Microsoft Azure tools such as Azure Data Factory, Synapse, SQL Database, Data Lake Storage Gen2, and Blob Storage
  
• 5+ years with data integration and data pipeline tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow, and FME
  
• 3+ years of strong oral and written communication skills
  
• 3+ years providing excellent customer service to external partners
  
• 3+ years working independently or as part of a larger team
  

• 3+ years with visualization and reporting software such as MicroStrategy, Tableau, and Esri ArcGIS
  
• 3+ years performing data functions with Databricks
  

• Bachelor's degree in Information Technology or a related field, or equivalent experience
  

• This contract is open to W2 or 1099 candidates only. Corp-to-Corp (C2C) candidates will not be considered.
  
• The final interview will be conducted in person.
  

Qualified candidates should email their resume to [email protected] with "ETL Data Engineer (810212)" in the subject line.