Sr Data Engineer

Reposted 14 Days Ago
Be an Early Applicant
Pune, Maharashtra, IND
In-Office
Senior level
Information Technology • Professional Services • Software • Consulting
The Role
Design, build, maintain, and optimize ETL/ELT data pipelines and data warehouses. Troubleshoot production issues, write and optimize complex SQL, implement data security, monitor storage/processing, support cross-functional teams, and apply data science and AI/ML familiarity to data engineering solutions.
Summary Generated by Built In
  • Development, maintenance, and enhancement of Data Pipelines (ETL/ELT) and processes with thorough knowledge of star/snowflake schemas
  • Hands on experience in PowerCenter Developer/IDMC/IICS Data Integration
  • Experience in DW Production Support / troubleshooting data or pipeline issues
  • Developing complex SQL queries and SQL optimization
  • Development experience must be full Life Cycle experience including business requirements gathering, data sourcing, testing/data reconciliation, and deployment within Business Intelligence/Data Warehousing Architecture.
  • Designing and implementing data security
  • Monitoring and optimizing data storage and data processing
  • Use of Object function/object-oriented scripting languages including Scala, C++, Java and Python
  • Cloud data warehouse and data lake platforms (e.g., Snowflake, Databricks, Redshift, BigQuery, MS Synapse, MS ADLS, Apache Haddop, etc.)
  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
  • Strong project management and organizational skills.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Understanding of data science concepts
  • Familiarity with AI/ML frameworks and libraries


Requirements

•             Developing data services that are fit for purpose, resilient, scalable, and future proof, to meet user needs

•             Advanced SQL knowledge and experience working with relational databases and working familiarity with various databases.

•             Demonstrated understanding and experience using software and tools including ETL, relational SQL and NoSQL databases, big data tools like Kafka, Spark, and Hadoop

•             Experience building and optimizing ‘big data’ data pipelines, architecture, and data sets.

•             Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

•             Strong analytic skills related to working with unstructured datasets.

•             Experience and knowledge of project management best practices and agile software development methodologies

•             A successful history of manipulating, processing, and extracting value from large, disconnected datasets.

•             Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.

•             Strong project management and organizational skills.

•             Experience supporting and working with cross-functional teams in a dynamic environment.

•             Understanding of data science concepts

•             Familiarity with AI/ML frameworks and libraries



Skills Required

  • Development, maintenance, and enhancement of ETL/ELT data pipelines and processes
  • Hands-on experience in PowerCenter Developer, IDMC, or IICS Data Integration
  • Experience in data warehouse production support and troubleshooting pipeline issues
  • Advanced SQL knowledge, complex query development, and SQL optimization
  • Full lifecycle development experience: requirements gathering, data sourcing, testing/reconciliation, deployment
  • Designing and implementing data security
  • Monitoring and optimizing data storage and processing
  • Proficiency with object-oriented and scripting languages: Scala, C++, Java, Python
  • Experience with cloud data warehouses and data lake platforms (Snowflake, Databricks, Redshift, BigQuery, MS Synapse, MS ADLS, Hadoop)
  • Working knowledge of message queuing, stream processing, and scalable big-data stores
  • Experience with big data tools like Kafka, Spark, and Hadoop
  • Experience building and optimizing big-data pipelines, architectures, and data sets
  • Strong analytic skills with unstructured datasets and root cause analysis experience
  • Familiarity with AI/ML frameworks and data science concepts
  • Experience and knowledge of project management best practices and agile software development methodologies
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
275 Employees
Year Founded: 2005

What We Do

Excelencia Consulting is a US-based, ISO 27001:2022-certified technology services provider specializing in Oracle solutions and Digital Engineering. The company provides on-site, offshore, and near-shore software technologies and ERP solutions to small and mid-sized enterprises globally. With a physical presence in the USA, UK, Canada, and India, Excelencia enables smarter operations and future-ready business transformations through its expertise in digital engineering services.

Similar Jobs

Mastercard Logo Mastercard

Senior Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Maharashtra, IND
38800 Employees

HERE Technologies Logo HERE Technologies

Senior Data Engineer

Artificial Intelligence • Automotive • Computer Vision • Information Technology • Internet of Things • Logistics • Software
Hybrid
Mumbai, Maharashtra, IND
6000 Employees

Capco Logo Capco

Senior Data Engineer

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

BlackRock Logo BlackRock

Senior Data Engineer

Fintech • Information Technology • Financial Services
In-Office
Mumbai, Maharashtra, IND
25000 Employees

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account