Sr Data Engineer

Reposted 2 Days Ago
Be an Early Applicant
Pune, Maharashtra, IND
In-Office
Senior level
Information Technology • Professional Services • Software • Consulting
The Role
Design, build, maintain, and optimize ETL/ELT data pipelines and data warehouses. Troubleshoot production issues, write and optimize complex SQL, implement data security, monitor storage/processing, support cross-functional teams, and apply data science and AI/ML familiarity to data engineering solutions.
Summary Generated by Built In
  • Development, maintenance, and enhancement of Data Pipelines (ETL/ELT) and processes with thorough knowledge of star/snowflake schemas
  • Hands on experience in PowerCenter Developer/IDMC/IICS Data Integration
  • Experience in DW Production Support / troubleshooting data or pipeline issues
  • Developing complex SQL queries and SQL optimization
  • Development experience must be full Life Cycle experience including business requirements gathering, data sourcing, testing/data reconciliation, and deployment within Business Intelligence/Data Warehousing Architecture.
  • Designing and implementing data security
  • Monitoring and optimizing data storage and data processing
  • Use of Object function/object-oriented scripting languages including Scala, C++, Java and Python
  • Cloud data warehouse and data lake platforms (e.g., Snowflake, Databricks, Redshift, BigQuery, MS Synapse, MS ADLS, Apache Haddop, etc.)
  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
  • Strong project management and organizational skills.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Understanding of data science concepts
  • Familiarity with AI/ML frameworks and libraries


Requirements

•             Developing data services that are fit for purpose, resilient, scalable, and future proof, to meet user needs

•             Advanced SQL knowledge and experience working with relational databases and working familiarity with various databases.

•             Demonstrated understanding and experience using software and tools including ETL, relational SQL and NoSQL databases, big data tools like Kafka, Spark, and Hadoop

•             Experience building and optimizing ‘big data’ data pipelines, architecture, and data sets.

•             Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

•             Strong analytic skills related to working with unstructured datasets.

•             Experience and knowledge of project management best practices and agile software development methodologies

•             A successful history of manipulating, processing, and extracting value from large, disconnected datasets.

•             Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.

•             Strong project management and organizational skills.

•             Experience supporting and working with cross-functional teams in a dynamic environment.

•             Understanding of data science concepts

•             Familiarity with AI/ML frameworks and libraries



Skills Required

  • Development, maintenance, and enhancement of ETL/ELT data pipelines and processes
  • Hands-on experience in PowerCenter Developer, IDMC, or IICS Data Integration
  • Experience in data warehouse production support and troubleshooting pipeline issues
  • Advanced SQL knowledge, complex query development, and SQL optimization
  • Full lifecycle development experience: requirements gathering, data sourcing, testing/reconciliation, deployment
  • Designing and implementing data security
  • Monitoring and optimizing data storage and processing
  • Proficiency with object-oriented and scripting languages: Scala, C++, Java, Python
  • Experience with cloud data warehouses and data lake platforms (Snowflake, Databricks, Redshift, BigQuery, MS Synapse, MS ADLS, Hadoop)
  • Working knowledge of message queuing, stream processing, and scalable big-data stores
  • Experience with big data tools like Kafka, Spark, and Hadoop
  • Experience building and optimizing big-data pipelines, architectures, and data sets
  • Strong analytic skills with unstructured datasets and root cause analysis experience
  • Familiarity with AI/ML frameworks and data science concepts
  • Experience and knowledge of project management best practices and agile software development methodologies
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
275 Employees
Year Founded: 2005

What We Do

Excelencia Consulting is a US-based, ISO 27001:2022-certified technology services provider specializing in Oracle solutions and Digital Engineering. The company provides on-site, offshore, and near-shore software technologies and ERP solutions to small and mid-sized enterprises globally. With a physical presence in the USA, UK, Canada, and India, Excelencia enables smarter operations and future-ready business transformations through its expertise in digital engineering services.

Similar Jobs

Deutsche Bank Logo Deutsche Bank

Senior Data Engineer

Fintech • Financial Services
In-Office
Magarpatta, Hadapsar, Pune, Maharashtra, IND
68787 Employees

Mondelēz International Logo Mondelēz International

Senior Data Engineer

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
Mumbai, Maharashtra, IND
90000 Employees

Quantiphi Logo Quantiphi

Senior Data Engineer

Artificial Intelligence • Big Data • Machine Learning
In-Office
2 Locations
3494 Employees

Barclays Logo Barclays

Senior Data Engineer

Fintech • Financial Services
In-Office
Pune, Maharashtra, IND
83500 Employees

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account