Job Summary
We are seeking a highly skilled Senior Data Engineer with strong expertise in Databricks, Snowflake, and modern data engineering practices. The ideal candidate should have hands-on experience in building scalable batch and streaming data pipelines, optimizing Spark jobs, and working with large-scale distributed data systems.
Requirements
Key Responsibilities
- Design, develop, and maintain scalable data pipelines (batch & streaming)
- Build and optimize data processing workflows using PySpark and SQL
- Work with Databricks for data processing, cluster management, and job orchestration
- Implement and manage data pipelines using Delta Lake architecture
- Integrate data from multiple sources including Kafka and cloud storage systems
- Ensure data quality, governance, and reliability across pipelines
- Collaborate with cross-functional teams for data platform enhancements
- Troubleshoot and debug Spark jobs for performance optimization
Required Skills
- Strong experience in Databricks and Snowflake
- Proficiency in Python, PySpark, and SQL
- Experience with Apache Airflow for workflow orchestration
- Hands-on experience with Kafka (real-time streaming pipelines)
- Experience with GitHub-based CI/CD deployments
- Strong understanding of Spark internals, optimization techniques, and debugging
- Experience in Databricks cluster (DBX) management
- Hands-on experience with Delta Lake pipelines
- Knowledge of Databricks Asset Bundles (DAB)
Good to Have
- Experience with cloud platforms (AWS / Azure / GCP)
- Knowledge of data lake architectures and medallion architecture
- Experience in handling large-scale data (TB/PB level)
Soft Skills
- Strong communication and collaboration skills
- Ability to work in a fast-paced environment
- Problem-solving mindset
Qualifications
- Bachelor’s degree in Computer Science, Engineering, or related field
Notes
- Candidate should be comfortable working on both batch and streaming data pipelines
- Strong focus on performance tuning, scalability, and reliability is expected
BenefitsWhat We Offer
- Opportunity to work on modern cloud data platforms
- Challenging, high-impact data projects
- Collaborative and engineering-driven culture We Offer
- Flexible working hours (self-managed)
- Competitive salary
- Annual bonus, subject to company performance
- Access to Udemy online training and opportunities to learn and grow within the role
At Mindera we use technology to build products we are proud of, with people we love.
Software Engineering Applications, including Web and Mobile, are at the core of what we do at Mindera.
We partner with our clients, to understand their product and deliver high performance, resilient and scalable software systems that create an impact in their users and businesses across the world.
You get to work with a bunch of great people, where the whole team owns the project together.
Our culture reflects our lean and self-organisation attitude. We encourage our colleagues to take risks, make decisions, work in a collaborative way and talk to everyone to enhance communication.
We are proud of our work and we love to learn all and everything while navigating through an Agile, Lean and collaborative environment.
Follow our Linkedln page - https://tinyurl.com/minderaindia
Check ot our Blog: http://mindera.com/ and our Handbook: http://bit.ly/MinderaHandbook
Our offices are located: Aveiro, Portugal | Porto, Portugal | Leicester, UK | San Diego, USA | San Francisco, USA | Chennai, India | Bengaluru, India
Skills Required
- Strong experience in Databricks and Snowflake
- Proficiency in Python, PySpark, and SQL
- Experience with Apache Airflow
- Hands-on experience with Kafka
- Experience with GitHub-based CI/CD deployments
- Strong understanding of Spark internals and optimization techniques
- Experience in Databricks cluster management
- Hands-on experience with Delta Lake pipelines
- Knowledge of Databricks Asset Bundles
- Experience with cloud platforms (AWS / Azure / GCP)
- Knowledge of data lake architectures
- Experience in handling large-scale data
Mindera Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Mindera and has not been reviewed or approved by Mindera.
-
Healthcare Strength — Company materials highlight health insurance, medical assistance, and wellbeing programs across locations, with the UK explicitly offering private medical including mental‑health, optical, and dental coverage. Country pages position healthcare as a core element of the package.
-
Leave & Time Off Breadth — Paid time off, sick leave, and flexible vacation policies are described as standard, with some locales referencing generous or unlimited PTO. Flexible schedules and remote options further support time away when needed.
-
Wellbeing & Lifestyle Benefits — Flexibility, remote/hybrid work, and wellness initiatives (e.g., mental‑health sessions and onsite activities) are emphasized as part of the employee experience. Cultural perks such as team gatherings and trips add lifestyle value.
Mindera Insights
What We Do
At Mindera we craft software with people we love. Software Engineering Applications, including Web and Mobile, are at the core of what we do at Mindera. You get to work with a bunch of great people, where the whole team owns the project together. Our culture reflects our lean and self-organization attitude. We encourage our colleagues to take risks, make decisions, work in a collaborative way and talk to everyone to enhance communication. We partner with our clients, to understand their product and deliver high performance, resilient and scalable software systems that create an impact in their users and businesses across the world Our offices are located in: Portugal | UK | USA | India | Romania | Brazil
