We are seeking a highly experienced Senior Data Engineer with strong Python development skills to support a large-scale data migration initiative. This individual will build and maintain data ingestion pipelines that extract data from legacy and enterprise systems, transform it, and load it into SQL databases for downstream reporting and analytics.
The ideal candidate is a self-sufficient engineer who is comfortable working across APIs, databases, and ETL pipelines, with the ability to independently deliver high-quality solutions in a fast-paced environment.
- Design, develop, and maintain Python-based data ingestion and ETL pipelines.
- Extract data from legacy/homegrown securities platforms, REST APIs, MySQL, PostgreSQL, Microsoft System Center, MDM tools, and similar enterprise systems.
- Develop Python scripts to transform, validate, and load data into MySQL and PostgreSQL databases.
- Support migration of existing data feeds into a new environment while ensuring data quality and reliability.
- Monitor, troubleshoot, and optimize data pipelines.
- Collaborate with engineering and business stakeholders to implement scalable data solutions.
- Document data flows, processes, and technical solutions.
- 7+ years of Data Engineering and Python development experience.
- Expert-level Python programming.
Experience working with Fabric. - Strong ETL/data ingestion pipeline experience.
- Experience with APIs, MySQL, and PostgreSQL.
- Strong SQL skills.
- Experience using Git/GitHub.
- Securities and vulnerability type of data analysis/management experience
- Ability to work independently with minimal oversight.
- Strong analytical and troubleshooting skills.
Skills Required
- 7+ years of data engineering and Python development experience
- Expert-level Python programming
- Experience working with Fabric
- Strong ETL and data ingestion pipeline experience
- Experience with APIs
- Experience with MySQL and PostgreSQL
- Strong SQL skills
- Experience using Git and GitHub
- Securities and vulnerability data analysis or management experience
- Ability to work independently with minimal oversight
- Strong analytical and troubleshooting skills
Similar Jobs
What We Do
Established in 2011, Cleartelligence delivers enterprise-grade cloud analytics using a modern, agile approach. We help our clients envision, design, and implement solutions that solve complex, data-centric business problems. We're a diverse team of functional and technical experts enabling enterprises and empowering individuals to identify business insights using the modern data stack.
Why Work With Us
We're lifelong learners - movers and shakers, thinkers and doers. We love trivia and coffee, and diving into a a good book. We love puzzles, and coffee, and watching Encanto for the hundredth time with the kids. And of course, we are data lovers.
Gallery
.jpg)
