Important Information
Location: Colombia
Work Mode: Hybrid
Job Summary
As a Senior Data Engineer (20103), you will be responsible for designing, developing, and maintaining high-quality software solutions. You will collaborate with cross-functional teams to understand business requirements and translate them into scalable and efficient software applications. Your role will involve leading technical projects, mentoring junior engineers, and continuously improving software development practices to ensure the delivery of robust and reliable software systems.
Responsibilities and Duties
- Design and build scalable data pipelines to ingest, process and transform high volume drilling data using Azure Data Factory and Azure Synapse.
- Implement complex logic to convert time based drilling sensor data into depth based datasets for geological and operational alignment.
- Develop ingestion frameworks to process diverse drilling data formats such as LAS, DLIS and WITSML from multiple vendors.
- Ensure data quality, availability and consistency by implementing automated validation checks and optimizing data pipelines for performance.
Qualifications and Skills
- Strong experience designing and implementing data pipelines using Azure Data Factory and Azure Synapse Analytics.
- Advanced proficiency in SQL and experience working with large scale data processing.
- Strong programming skills in Python with experience using PySpark or Pandas for data processing.
- Experience working with big data technologies such as Spark for distributed data processing.
- Experience managing and organizing data in Azure Data Lake Storage Gen2.
- Knowledge of common data formats such as JSON, Parquet, Delta Lake and XML based formats.
- Understanding of ETL and ELT patterns and modern data engineering best practices.
- Experience processing time series or real time streaming data.
- Strong problem solving and analytical skills to handle complex data transformation logic.
- Experience optimizing data pipelines, Spark jobs or SQL queries for performance and scalability.
- Familiarity with data security practices such as access management and data governance in cloud environments.
- Microsoft Certified Azure Data Engineer Associate (DP 203) certification is a plus.
About Encora
Encora is a global company that offers Software and Digital Engineering solutions. Our practices include Cloud Services, Product Engineering & Application Modernization, Data & Analytics, Digital Experience & Design Services, DevSecOps, Cybersecurity, Quality Engineering, AI & LLM Engineering, among others.
At Encora, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
Top Skills
What We Do
Headquartered in Santa Clara, California, and backed by renowned private equity firms Advent International and Warburg Pincus, Encora is the preferred technology modernization and innovation partner to some of the world’s leading enterprise companies. It provides award-winning digital engineering services including Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering. Encora's deep cluster vertical capabilities extend across diverse industries, including HiTech, Healthcare & Life Sciences, Retail & CPG, Energy & Utilities, Banking Financial Services & Insurance, Travel, Hospitality & Logistics, Telecom & Media, Automotive, and other specialized industries. With over 9,000 associates in 47+ offices and delivery centers across the U.S., Canada, Latin America, Europe, India, and Southeast Asia, Encora delivers nearshore agility to clients anywhere in the world, coupled with expertise at scale in India. Encora’s Cloud-first, Data-first, AI-first approach enables clients to create differentiated enterprise value through technology
