Primary Skills
- ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures
Specialization
- Databricks Engineering: Data Engineer
Job requirements
- Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks and PySpark
- Build and optimize data lakehouse architectures (Bronze–Silver–Gold layers)
- Develop data ingestion frameworks from multiple sources (batch & real-time)
- Implement Delta Lake features including schema evolution, ACID transactions, and optimization
- Create and manage Databricks notebooks, workflows, and jobs for production pipelines
- Ensure data quality, governance, and lineage across pipelines
- Optimize Spark jobs for performance (partitioning, caching, tuning)
- Collaborate with cross-functional teams (Data Scientists, Analysts, Architects)
- Support production deployments, monitoring, and troubleshooting of data pipelines
- Contribute to migration of legacy data platforms to modern cloud-based architecture
- Strong experience in:
- Databricks (Workflows, Notebooks, Jobs)
- PySpark / Spark SQL
- SQL & Data Warehousing concepts
- Hands-on experience with:
- Delta Lake / Lakehouse architecture
- Data pipeline development & orchestration
- Good understanding of:
- Data modeling, ETL/ELT processes, SCD concepts
- Experience in at least one:
- AWS (S3, Glue, EMR) / Azure (ADF, ADLS, Synapse)
- Workflow tools:
- Airflow / Databricks Workflows
- Version control:
- Git / CI-CD pipelines
- Experience with:
- Streaming frameworks (Kafka / Spark Streaming)
- DBT / Snowflake / Redshift / Fabric
- Exposure to:
- Unity Catalog, Autoloader, Delta Live Tables
- 5–10 years of experience in Data Engineering
- Minimum 2–4 years of hands-on Databricks experience
- Proven experience building enterprise-scale data platforms and pipelines
- Strong problem-solving and analytical skills
- Ability to work in a fast-paced, agile environment
- Good communication and stakeholder management
- Work on cutting-edge data & AI programs
- Opportunity to build large-scale data platforms
- Collaborative and innovation-driven culture
Job Description – Data Engineer (Databricks)
Company: Brillio Technologies
Role: Data Engineer – Databricks
Experience: 5–10 Years
Location: India (Hybrid/3 days)
Employment Type: Full-time
About Brillio
Brillio is a leading digital transformation partner delivering innovative solutions across Data, Cloud, AI, and Digital Engineering. We help global enterprises unlock value through cutting-edge technology and data-driven insights.
Role Overview
We are looking for a hands-on Data Engineer with strong Databricks expertise to design, build, and scale modern data platforms. The ideal candidate will have experience in PySpark, Delta Lake, and cloud-native data engineering and will work closely with analytics, product, and business teams to deliver high-performance data pipelines.
Key Responsibilities
Technical Skills (Must-Have)
Cloud & Tools
Good to Have
Experience Required
Soft Skills
Why Join Brillio
Skills Required
- 5-10 years of experience in Data Engineering
- 2-4 years of hands-on Databricks experience
- Databricks (Workflows, Notebooks, Jobs)
- PySpark / Spark SQL
- SQL, PL/SQL, T-SQL, Stored Procedures
- Python
- Delta Lake / Lakehouse architecture
- Data pipeline development & orchestration
- Data modeling, ETL/ELT processes, SCD concepts
- Experience with AWS (S3, Glue, EMR) or Azure (ADF, ADLS, Synapse)
- Version control (Git) and CI/CD pipelines
- Streaming frameworks (Kafka / Spark Streaming)
- DBT / Snowflake / Redshift / Fabric
- Unity Catalog, Autoloader, Delta Live Tables
- Strong problem-solving and stakeholder management
Brillio Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Brillio and has not been reviewed or approved by Brillio.
-
Healthcare Strength — Healthcare is considered comprehensive, including medical coverage for employees and dependents alongside life, disability, and accidental death protections. Feedback suggests these protections are a core strength of the package.
-
Leave & Time Off Breadth — Time-off options include paid leave and parental leave, with flexible or ‘flexible PTO’ approaches cited in some contexts. Feedback suggests this breadth helps support work-life balance when team norms permit usage.
-
Wellbeing & Lifestyle Benefits — Wellbeing offerings span counseling, financial-management sessions, fitness programs, and travel insurance, plus region-specific extras like discounted IT hardware and work-from-home essentials. Feedback suggests these add-ons enhance perceived value beyond core insurance.
Brillio Insights
What We Do
Brillio is the leader in global digital business transformation, applying technology with a human touch. We help businesses define internal and external transformation objectives, and translate those objectives into actionable market strategies using proprietary technologies. With 2600+ experts and 13 offices worldwide, Brillio is the ideal partner for enterprises that want to quickly increase their core business productivity, and achieve a competitive edge, with the latest digital solutions.
