Important Information
Location: Latin America
Work Mode: Remote
Job Summary
As a Senior Data Engineer (12374), you will be responsible for designing, developing, and maintaining high-quality software solutions. You will collaborate with cross-functional teams to understand business requirements and translate them into scalable and efficient software applications. Your role will involve leading technical projects, mentoring junior engineers, and continuously improving software development practices to ensure the delivery of robust and reliable software systems.
Responsibilities and Duties
- Data Pipeline Development & Management: Create and maintain automated data pipelines to process large volumes of data using Python and Apache (e.g., Spark, Kafka), integrated with cloud services like AWS (S3, Redshift) and GCP (BigQuery).
- Cloud Infrastructure & Data Storage Optimization: Manage scalable cloud storage solutions with AWS (S3, Redshift) and GCP (BigQuery), ensuring efficient data access and processing.
- Data Integration & Processing: Design and implement data integration strategies, connecting various sources and processing data in real-time or batch using tools like Apache Kafka, Spark, and Python
Qualifications and Skills
- Graduates in systems, networks or related fields with +5 years of experience.
- Proven experience with AWS and Google Cloud Platform (GCP), specifically services like AWS S3, Redshift, Lambda and Google BigQuery, Cloud Storage.
- Expertise in Apache Spark and PySpark for data processing at scale.
- Hands-on experience with Databricks for collaborative data engineering and machine learning workflows.
- Proficient in Python for scripting and automation.
- Experience with Apache Airflow for data pipeline orchestration and automation.
- Strong understanding of Delta Lake and Parquet formats for optimized data storage and querying.
- Solid understanding of ETL/ELT processes and data warehousing concepts.
- Excellent problem-solving skills and the ability to work in a fast-paced environment.
About Encora
Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.
At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
Top Skills
What We Do
Headquartered in Santa Clara, California, and backed by renowned private equity firms Advent International and Warburg Pincus, Encora is the preferred technology modernization and innovation partner to some of the world’s leading enterprise companies. It provides award-winning digital engineering services including Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering. Encora's deep cluster vertical capabilities extend across diverse industries, including HiTech, Healthcare & Life Sciences, Retail & CPG, Energy & Utilities, Banking Financial Services & Insurance, Travel, Hospitality & Logistics, Telecom & Media, Automotive, and other specialized industries.
With over 9,000 associates in 47+ offices and delivery centers across the U.S., Canada, Latin America, Europe, India, and Southeast Asia, Encora delivers nearshore agility to clients anywhere in the world, coupled with expertise at scale in India. Encora’s Cloud-first, Data-first, AI-first approach enables clients to create differentiated enterprise value through technology
