The Role
Designs and builds end-to-end data foundations and solutions, develops optimized queries and pipelines, and works with cloud, big-data, relational, and NoSQL technologies. The role supports data strategy, governance, quality, modeling, testing, change and incident management, and stakeholder reporting. It also drives implementation efficiency, mentors engineers, contributes to communities of practice, and may lead scrum teams or small groups.
Summary Generated by Built In
QualificationsSenior Data Engineer Job Description
The Role
Professional Qualifications & SkillsEducational Qualification
Nice to have Skills SAP
The Role
The Senior Data Engineer is the one who designs and builds data foundations and end to end solutions for the Shell Business to maximize value from data. The role helps create a data-driven thinking within the organization, not just within IT teams, but also in the wider Business stakeholder community. A Senior Data engineer is expected to be a subject matter expert, who design & build data solutions and mentor junior engineers. They are also the key drivers to convert Vison and Data Strategy for IT solutions and deliver.
Key Characteristics- Technology expert who constantly pursues knowledge enhancement and has inherent curiosity to understand work from multiple dimensions.
- Deep data focus with expertise in technology domain
- A skilled communicator capable of speaking to both technical developers and business managers. Respected and trusted by leaders and staff.
- Actively delivers the roll-out and embedding of Data Foundation initiatives in support of the key business programmers.
- Coordinate the change management process, incident management and problem management process. Ensure traceability of requirements from Data needs and requirements, through testing and scope changes, to training and transition.
- Present reports and findings to key stakeholders and be the subject matter expert on Data Analysis & Design.
- Drive implementation efficiency and effectiveness across the pilots and future projects to minimize cost, increase speed of implementation and maximize value delivery.
- Contributes to community building initiatives like CoE, CoP.
Professional Qualifications & SkillsEducational Qualification
- University degree in any IT discipline
- Minimum 7 years of experience in the IT industry
- Technology champion in working with relational, Data warehouses databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Highly Experienced in building and optimizing complex queries. Good with data manipulation, processing and extracting value from large, disconnected datasets.
- Champion with object-oriented/object function scripting languages: Python, SQL, Scala, Spark-SQL etc. Experienced with big data sets and big data technologies.
- Proven subject matter expertise working with cloud technologies like Azure/AWS
- Deep expertise with technologies such as Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift etc.
- Experience in working with NoSQL databases.
- Excellent communication and interpersonal skills
- A skilled communicator capable of speaking to both technical developers, architects, and stake holders.
- Very Good understanding in data foundation initiatives, like data modelling, data quality, data governance, data maturity assessments and data strategy in support of the key business stake holders.
- Self-motivated, innovative, and very good in taking up new initiatives and driving them to closure.
- Proven experience in working source control technologies (such as GITHUB, Azure DevOps), build and release pipelines.
- Experienced in working with AGILE, KANBAN methodologies and exposure to run team scrum meetings
- Experience in working with scripting languages such as YAML, PowerShell, Terraform etc.
- Experience with big data tools: Hadoop, Spark, Kafka, etc
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Exposure to architecting/designing end to end solutions.
- Experience running a scrum team.
- Managing small teams.
Nice to have Skills SAP
- Experience working with S/4 HANA, BW4 HANA systems
- Experience working with BPC, Planning.
- Exposure to architecting/designing end to end solutions.
- Experience running a scrum team.
- Experience working with Lumira.
- Managing small teams.
Skills Required
- University degree in an IT discipline
- At least 7 years of IT industry experience
- Experience with relational databases, data warehouses, SQL, complex query optimization, and large datasets
- Experience with Python, SQL, Scala, Spark SQL, big-data technologies, and data manipulation
- Experience with Azure or AWS cloud technologies
- Experience with Azure Data Factory, Databricks, SQL Database, Synapse, Stream Analytics, AWS Glue, Airflow, Kinesis, or Redshift
- Experience with NoSQL databases
- Understanding of data modeling, data quality, data governance, data maturity assessments, and data strategy
- Experience with source control and build and release pipelines, such as GitHub or Azure DevOps
- Experience with Agile and Kanban methodologies and scrum meetings
- Experience with YAML, PowerShell, Terraform, Hadoop, Spark, Kafka, or data workflow tools such as Azkaban or Luigi
- Experience architecting end-to-end solutions, running scrum teams, or managing small teams
- Experience with SAP S/4HANA, BW/4HANA, BPC, Planning, or Lumira
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company





