Primary Skills
- CI/CD Pipeline, CSS/SCSS/LESS, PyTest, PostgreSQL / MongoDB / Redis, REST API / GraphQL
Specialization
- Python Fullstack with Microservices: Software Development Lead
Job requirements
We are seeking an experienced Lead Data Engineer to take end-to-end ownership of Enterprise Data Warehouse (EDW) solutions. This role will be responsible for designing, architecting, and optimizing scalable, secure, and high-performance data pipelines using SAP BODS, IBM DataStage, Redwood, SQL, Oracle, and modern data platforms.
The ideal candidate will combine strong hands-on technical expertise with leadership capabilities to drive data engineering best practices and deliver enterprise-grade data solutions aligned with business objectives.
Key Responsibilities
1. EDW Architecture & Data Engineering
- Design and implement scalable data integration and transformation frameworks for the Enterprise Data Warehouse.
- Architect and optimize ETL/ELT pipelines using SAP BODS and IBM DataStage.
- Develop and maintain robust data models (Star/Snowflake schemas, SCD implementation).
- Ensure high availability, reliability, and performance of data pipelines.
- Implement data governance, security, and compliance standards.
- Develop complex data workflows and transformations.
- Perform performance tuning of ETL jobs and SQL queries.
- Optimize batch processing and scheduling using Redwood.
- Implement error handling, logging, and monitoring mechanisms.
- Manage incremental loads and data reconciliation processes.
- Write and optimize complex SQL queries, stored procedures, and functions.
- Work extensively with Oracle databases and related technologies.
- Design and manage indexing strategies and query optimization.
- Support database performance analysis and tuning.
- Lead and mentor a team of data engineers.
- Conduct code reviews and enforce development standards.
- Drive technical best practices and architecture governance.
- Collaborate with cross-functional teams including BI, Analytics, and Application teams.
- Participate in sprint planning, estimation, and technical roadmap discussions.
- Work closely with business stakeholders to gather and translate requirements into technical solutions.
- Provide technical guidance and solution recommendations.
- Ensure alignment between enterprise data strategy and business goals.
- Support production issue resolution and root cause analysis.
- Strong experience with SAP BODS
- Hands-on experience with IBM DataStage
- Experience with Redwood scheduling
- Advanced SQL development
- Strong expertise in Oracle database
- Deep understanding of Enterprise Data Warehouse architecture
- Data modeling (Star/Snowflake schema, SCD Types)
- ETL/ELT best practices
- Data quality frameworks
- Performance tuning and optimization
- Data security and governance standards
- Experience with modern cloud data platforms (Azure, AWS, GCP)
- Knowledge of Snowflake, Databricks, or Synapse
- CI/CD implementation for data pipelines
- Exposure to data cataloging and metadata management tools
- Experience in Agile/Scrum methodologies
- Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.
- 5+ years of experience in Data Engineering.
- 2+ years of experience in leading technical teams.
- Strong architectural and analytical skills
- Leadership and mentoring capability
- Excellent communication and stakeholder management
- Problem-solving mindset
- Ability to drive enterprise-scale data initiatives
2. ETL Development & Optimization
3. Database & SQL Development
4. Leadership & Team Management
5. Stakeholder Collaboration
Required Skills
Technical Expertise
Data Engineering Concepts
Preferred / Good to Have
Qualifications
Key Competencies
- This is L3 support project
- Flexibility to work in rotational shift is mandatory
Skills Required
- Strong experience with SAP BODS
- Hands-on experience with IBM DataStage
- Experience with Redwood scheduling
- Advanced SQL development and performance tuning
- Strong expertise in Oracle databases
- Deep understanding of Enterprise Data Warehouse architecture
- Data modeling (Star/Snowflake schemas, SCD implementation)
- ETL/ELT development and best practices
- Data quality frameworks and reconciliation processes
- Experience with error handling, logging, and monitoring for data pipelines
- Experience with CI/CD pipeline tools (for data pipelines)
- Familiarity with PostgreSQL, MongoDB, and Redis
- Experience with REST API and GraphQL
- Experience with testing frameworks such as PyTest
- Bachelor's or Master's degree in Computer Science, Information Systems, or related field
- 5+ years of experience in Data Engineering
- 2+ years of experience leading technical teams
- Ability to work L3 support and rotational shifts
- Knowledge of data security and governance standards
- Experience with cloud data platforms (Azure, AWS, GCP)
- Knowledge of Snowflake, Databricks, or Synapse
- Exposure to data cataloging and metadata management tools
- Experience in Agile/Scrum methodologies
Brillio Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Brillio and has not been reviewed or approved by Brillio.
-
Healthcare Strength — Healthcare is considered comprehensive, including medical coverage for employees and dependents alongside life, disability, and accidental death protections. Feedback suggests these protections are a core strength of the package.
-
Leave & Time Off Breadth — Time-off options include paid leave and parental leave, with flexible or ‘flexible PTO’ approaches cited in some contexts. Feedback suggests this breadth helps support work-life balance when team norms permit usage.
-
Wellbeing & Lifestyle Benefits — Wellbeing offerings span counseling, financial-management sessions, fitness programs, and travel insurance, plus region-specific extras like discounted IT hardware and work-from-home essentials. Feedback suggests these add-ons enhance perceived value beyond core insurance.
Brillio Insights
What We Do
Brillio is the leader in global digital business transformation, applying technology with a human touch. We help businesses define internal and external transformation objectives, and translate those objectives into actionable market strategies using proprietary technologies. With 2600+ experts and 13 offices worldwide, Brillio is the ideal partner for enterprises that want to quickly increase their core business productivity, and achieve a competitive edge, with the latest digital solutions.
