Important Information
Experience: +7 years
Job Mode: Full-time
Work Mode: Remote
ID: 19096
Job Summary
As a Senior Data Engineer Databricks, you will be responsible for designing, developing, and maintaining high-quality software solutions. You will collaborate with cross-functional teams to understand business requirements and translate them into scalable and efficient software applications. Your role will involve leading technical projects, mentoring junior engineers, and continuously improving software development practices to ensure the delivery of robust and reliable software systems.
Responsibilities and Duties
- Design, build, and optimize scalable data pipelines and lakehouse architectures in Databricks using the medallion model (bronze, silver, gold)
- Develop and maintain ETL/ELT processes in Python and PySpark, ensuring high data quality, performance, and reliability
- Implement and enforce data governance, security, encryption, and PII protection standards across the platform
- Collaborate with engineering and business teams to translate requirements into dimensional models and support migration from legacy systems to AWS-based Databricks environments
Qualifications and Skills
- Bachelor’s degree in Computer Science, Engineering, or a related technical field; advanced certifications in Data Engineering or Cloud are highly valued
- 5+ years of progressive experience in Data Engineering building scalable, production-grade data platforms
- 3+ years of deep hands-on experience with Databricks and modern Lakehouse architecture in enterprise environments
- Expert-level proficiency in Python and PySpark, designing high-performance distributed data processing pipelines
- Strong expertise designing and implementing dimensional data models (Star Schema, SCDs, fact/dimension load strategies) for analytical workloads
- Proven experience implementing and optimizing medallion architecture (bronze, silver, gold) with strong data quality validation frameworks
- Advanced knowledge of data governance, encryption standards, data lineage, anonymization, and secure handling of highly sensitive PII data (especially in regulated environments)
- Strong experience operating in AWS cloud environments, including performance tuning, cost optimization, and cloud-native data services
- Databricks certification strongly preferred and considered close to mandatory for senior-level candidacy
- Experience leveraging AI-assisted development tools or agentic coding platforms to enhance productivity and data engineering workflows is a strong plus
About Encora
Encora is a global company that offers Software and Digital Engineering solutions. Our practices include Cloud Services, Product Engineering & Application Modernization, Data & Analytics, Digital Experience & Design Services, DevSecOps, Cybersecurity, Quality Engineering, AI & LLM Engineering, among others.
At Encora, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
Top Skills
What We Do
Headquartered in Santa Clara, California, and backed by renowned private equity firms Advent International and Warburg Pincus, Encora is the preferred technology modernization and innovation partner to some of the world’s leading enterprise companies. It provides award-winning digital engineering services including Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering. Encora's deep cluster vertical capabilities extend across diverse industries, including HiTech, Healthcare & Life Sciences, Retail & CPG, Energy & Utilities, Banking Financial Services & Insurance, Travel, Hospitality & Logistics, Telecom & Media, Automotive, and other specialized industries.
With over 9,000 associates in 47+ offices and delivery centers across the U.S., Canada, Latin America, Europe, India, and Southeast Asia, Encora delivers nearshore agility to clients anywhere in the world, coupled with expertise at scale in India. Encora’s Cloud-first, Data-first, AI-first approach enables clients to create differentiated enterprise value through technology
