This is a remote position.
KANINI is seeking a highly skilled Senior Data Engineer with deep expertise in Google Cloud Platform (GCP) and modern data architecture. The ideal candidate will have hands-on experience designing scalable data pipelines, implementing Medallion Architecture, and building robust enterprise-grade data solutions.
This role requires strong technical proficiency in BigQuery, PySpark, Dataflow, and Airflow, along with a solid understanding of cloud data governance, performance optimization, and CI/CD practices.
- Design, develop, and maintain scalable batch and real-time data pipelines on GCP
- Implement and manage Medallion Architecture (Bronze, Silver, Gold layers) for data processing
- Build high-performance data transformations using Python and PySpark
- Develop and optimize complex SQL queries for analytical workloads
- Work extensively with BigQuery for large-scale data processing and performance tuning
- Develop and deploy pipelines using Cloud Dataflow
- Orchestrate workflows using Cloud Composer (Apache Airflow)
- Manage data storage and lifecycle using Google Cloud Storage (GCS)
- Implement version control and CI/CD pipelines using Git-based tools
- Ensure data security, governance, and access control using GCP IAM
- Optimize data solutions for performance, scalability, reliability, and cost-efficiency
- Strong hands-on experience with Google Cloud Platform (GCP)
- Expertise in BigQuery (partitioning, clustering, query optimization)
- Proven experience implementing Medallion Data Architecture
- Strong programming skills in Python and PySpark
- Hands-on exposure on Java
- Advanced proficiency in SQL (complex joins, window functions, performance tuning)
- Hands-on experience with Cloud Dataflow
- Experience with Cloud Composer (Airflow) for orchestration
- Experience working with Google Cloud Storage (GCS)
- Knowledge of version control systems (Git) and CI/CD practices
- Strong understanding of GCP IAM and cloud security best practices
Preferred Qualifications
- Experience working with large-scale enterprise data platforms
- Knowledge of data warehousing and data lake concepts
- Familiarity with real-time streaming frameworks
- Experience in data governance and data quality frameworks
- Exposure to
Skills Required
- Strong hands-on experience with Google Cloud Platform
- Expertise in BigQuery, including partitioning, clustering, and query optimization
- Proven experience implementing Medallion Data Architecture
- Strong programming skills in Python and PySpark
- Hands-on exposure to Java
- Advanced proficiency in SQL, including complex joins, window functions, and performance tuning
- Hands-on experience with Cloud Dataflow
- Experience with Cloud Composer and Apache Airflow for orchestration
- Experience working with Google Cloud Storage
- Knowledge of Git-based version control systems and CI/CD practices
- Strong understanding of GCP IAM and cloud security best practices
- Experience working with large-scale enterprise data platforms
- Knowledge of data warehousing and data lake concepts
- Familiarity with real-time streaming frameworks
- Experience with data governance and data quality frameworks
What We Do
KANINI is a digital transformation enabler, providing cutting-edge software services and solutions that help enterprises drive innovation and business growth. We create impeccable customer experiences through thoughtfully designed digital solutions that help improve our customer’s efficiency, scale, and revenues. We specialize in Product Engineering, Data Analytics & AI, and ServiceNow consultation and implementation. We focus on empowering Banking & Financial Services, Healthcare, Manufacturing, and a few other industries to leverage new-age technologies and solutions by implementing agile development practices and a global delivery framework. We build technology that puts humans first - in line with our core operating principle that technology is for people, not the other way around. The result is happier clients, partners, and employees. We do all this by balancing our customers’ needs with our people’s aspirations, always putting humans first. It means: * We prioritize each individual’s personal goals. * We value relationships more than profits. * We treat our clients as partners. Our people come to work because it makes them happy. They smile more often. They love getting better at what they do. And our offices become a second home. Even as they spend more time away from it. If you think all this is just as important to you, bring us your Energy, Intellect and Integrity. We’ll show you a happier way to work
