Top Data Engineer Jobs in Hyderabad

3 Days AgoSaved
In-Office
2 Locations
Senior level
Senior level
Information Technology • Consulting
Lead data engineering initiatives by designing governed ETL/ELT pipelines, developing Databricks lakehouse solutions, integrating REST APIs and enterprise data, and maintaining data quality. The role requires expertise in Python, PySpark, SQL, Spark, Unity Catalog, Delta Lake, CI/CD, and Git. Preferred experience includes Planisware, agentic AI frameworks, knowledge graphs, RAG, vector search, pipeline monitoring, and project portfolio management datasets.
Top Skills: Agentic AiSparkCi/CdCrewaiDatabricksDatabricks Ai GenieDatabricks Unity CatalogDelta LakeEltETLGitKnowledge GraphsLangchainLanggraphNeo4JPlaniswarePysparkPythonRagRest ApisSemantic KernelSQLVector Search
Senior level
Software
Designs and maintains scalable AWS, Snowflake, and dbt data pipelines and transformation frameworks. Builds ETL/ELT workflows, dimensional models, data quality frameworks, and optimized SQL workloads for structured and semi-structured data. Responsibilities include pipeline orchestration, monitoring, troubleshooting, CI/CD, legacy ETL modernization, documentation, production support, and collaboration with technical teams. The role also contributes to architecture discussions, Agile delivery, code reviews, and mentoring junior engineers.
Top Skills: AirflowAmazon S3SparkAWSAws GlueAws LambdaCi/CdDbtGitIamInformaticaPysparkPythonSnowflakeSQL
20 Days AgoSaved
In-Office or Remote
2 Locations
Senior level
Senior level
Information Technology
Build and maintain governed finance data products on Microsoft Fabric and Databricks. Responsibilities include developing PySpark and Python ingestion pipelines, implementing incremental loading and CDC, optimizing Delta Lake tables, managing Azure Data Factory pipelines and Analysis Services cubes, designing Power BI semantic models, and ensuring version control, testing, monitoring, governance, and data contract compliance. The role also involves stakeholder collaboration, mentoring junior engineers, and applying enterprise data architecture standards.
Top Skills: Adls Gen2SparkAzure Analysis ServicesAzure Data FactoryCi/CdDatabricksDelta LakeMicrosoft FabricMicrosoft PurviewPower BIPysparkPythonSQL ServerT-Sql
22 Days AgoSaved
Remote
India
Senior level
Senior level
Blockchain • Fintech • Financial Services • Cryptocurrency • Quantitative Trading
Build and support large-scale, real-time kdb+ analytics platforms processing billions of daily messages. Develop kdb Insights or KDB-X modules, packages, pipelines, performant q queries, and functions for trading desks. Create SRE tools to detect performance bottlenecks across q, Python, and Java processes running continuously in AWS. Support ingestion stability, Kubernetes deployments, PyKX data processing, and cloud-native analytics infrastructure.
Top Skills: AWSDatabricksDatadogJavaKdb InsightsKdb+Kdb-XKubernetesPykxPythonQ
22 Days AgoSaved
Remote
India
Senior level
Senior level
Blockchain • Fintech • Financial Services • Cryptocurrency • Quantitative Trading
Build and operate production data platforms, tooling, and infrastructure supporting autonomous pipeline delivery. Own monitoring, alerting, DataOps, Kafka, Kubernetes, Terraform, AWS, Databricks/Spark, dbt, and Airflow environments. Improve platform reliability, troubleshoot production issues, and partner with product, analytics, and infrastructure teams. Champion AI adoption and automation while enabling high-throughput, low-latency data processing and strong developer experience.
Top Skills: Apache AirflowSparkAWSCi/CdDatabricksDbtFlinkGenerative AiHelmJavaKafkaKdbKubernetesObservability ToolingPostgresPythonSQL ServerTerraform
23 Days AgoSaved
In-Office or Remote
2 Locations
Mid level
Mid level
Agency • Information Technology
Designs, develops, tests, and maintains scalable ETL pipelines using Azure services and streaming technologies. Collaborates with architects, analysts, scientists, and business stakeholders to ensure data accuracy and integrity. Builds data models and documentation, optimizes workflows, monitors production data flows, troubleshoots issues, implements data-quality controls, and integrates cloud and on-premise storage while supporting governance, security, and privacy standards.
Top Skills: Azure Cloud FunctionsAzure Data FactoryAzure DatabricksCi/CdGitJenkinsOraclePostgresPythonScalaShellSQLSQL Server
10 Days AgoSaved
In-Office or Remote
3 Locations
Senior level
Senior level
Fintech • Food • Payments • Software
Own and operate qlub’s production data platform across ingestion, dbt modeling, BigQuery, Airflow, ClickHouse, GCP infrastructure, data quality, and CI/CD. Build reliable pipelines, optimize performance and cost, troubleshoot production issues, establish engineering standards, and mentor data engineers. Explore practical applications of LLMs and agents for data discovery, monitoring, and troubleshooting while maintaining secure, maintainable systems.
Top Skills: AirbyteApache AirflowApache FlinkAws Ec2Aws RdsAws S3BashCi/CdClickhouseCloud RunCronDatastreamDbtDebeziumDockerFivetranGitGoogle BigqueryGoogle Cloud Platform (Gcp)Google Cloud StorageGreat ExpectationsIamKafkaKubernetesLinuxLlm ApisMonte CarloPostgresPower BIPythonRagSodaSQLSshTableauTerraform
One Month AgoSaved
In-Office
Hyderabad, Telangana, IND
Mid level
Mid level
Cloud • Analytics • Consulting
Designs and maintains scalable ETL/ELT pipelines using SQL, Python, and cloud data platforms. Integrates data from multiple sources, implements quality and monitoring controls, troubleshoots performance issues, supports data modeling for analytics and machine learning, and follows security and governance practices. Collaborates with engineers, data scientists, and stakeholders while documenting pipelines and exploring AI-assisted development tools.
Top Skills: Apache AirflowApache KafkaAPIsAWSAws KinesisClaude CodeDatabricksEtl/EltGithub CopilotGraph DatabasesJavaLlmsMcpPythonRagScalaSnowflakeSQL
One Month AgoSaved
In-Office
Hyderabad, Telangana, IND
Expert/Leader
Expert/Leader
Information Technology • Consulting
Own the end-to-end data platform, including BigQuery warehouse architecture, dbt models, ingestion pipelines, identity resolution, analytics marts, reverse-ETL activation, data quality, governance, orchestration, and CI/CD. Partner with engineering, analytics, product, marketing, and external data teams to deliver accurate, trusted, well-documented data. This is a hands-on Staff Data Engineer role requiring advanced SQL, Python, warehouse design, and operational data platform expertise.
Top Skills: AirbyteAirflowAmplitudeBigQueryCensusCloud FunctionsCloud RunCloud StorageDagsterDbt CloudDbt CoreFivetranGitGitGitlabGoogle Cloud PlatformHeapHightouchIamJinjaKafkaKinesisLookerMetabaseMixpanelModeOmniPolytomicPrefectPub/SubPythonRedshiftSegmentSnowflakeSQLTableau
Reposted 12 Days AgoSaved
Hybrid
Hyderabad, Telangana, IND
Mid level
Mid level
Healthtech
Develop and support AWS cloud-native data lakes and ecosystems, scalable Databricks data pipelines, and enterprise data solutions. Configure and optimize Databricks clusters and jobs, implement production-grade pipelines using PySpark and SQL, and work with services including Glue, Athena, Redshift, and PostgreSQL. Apply data security and privacy practices, provide production support, improve team processes, and collaborate in a global onshore-offshore delivery environment.
Top Skills: Amazon AthenaAmazon RedshiftSparkAWSAws Glue StudioDatabricks LakehouseDatabricks WorkflowsDelta LakeMySQLPostgresPysparkPythonPyTorchSQLUnity Catalog
12 Days AgoSaved
In-Office
Hyderabad, Telangana, IND
Senior level
Senior level
Database • Analytics
Design, develop, and maintain scalable GCP data engineering solutions and ETL/ELT pipelines. Build data processing and transformation workflows with Python and SQL, perform data modeling and validation, optimize performance, monitor production pipelines, resolve issues, and implement data quality, security, and governance practices. Collaborate with business and technical teams, participate in code reviews, and contribute to architecture discussions.
Top Skills: Apache AirflowSparkBigQueryCi/CdCloud ComposerCloud StorageDataflowDataformDataprocGitGoogle Cloud Platform (Gcp)IamPub/SubPysparkPythonSQLTerraform
Reposted One Month AgoSaved
In-Office
Hyderabad, Telangana, IND
Entry level
Entry level
Information Technology • Consulting
Design, develop, and operate production-grade Databricks data pipelines integrating REST APIs and enterprise systems. Build dimensional models, advanced SQL transformations, Python utilities, data quality frameworks, and governed assets in Unity Catalog. Manage orchestration, monitoring, error handling, performance optimization, production troubleshooting, CI/CD, and data governance. Preferred experience includes Azure data services, Medallion Architecture, Delta Live Tables, telemetry ingestion, and DevOps practices.
Top Skills: Azure Data FactoryAzure Data Lake StorageAzure DevopsAzure FunctionsAzure SynapseCi/CdDatabricksDatabricks SqlDatabricks WorkflowsDelta LakeDelta Live TablesDevOpsGitMedallion ArchitecturePythonRest ApisSQLUnity Catalog
New

Track Smarter, Apply Better.

Ditch the spreadsheets. Organize your job search with our freeApplication Tracker.

Use For Free
Application Tracker Preview
One Month AgoSaved
In-Office
Hyderabad, Telangana, IND
Senior level
Senior level
Big Data • Cloud • Analytics • Consulting
Design, develop, optimize, and maintain scalable AWS data processing and ETL/ELT pipelines using Python, PySpark, Apache Spark, and SQL. Responsibilities include data extraction, transformation, validation, performance tuning, integration across databases, APIs, and cloud storage, monitoring, error handling, and data quality management. The role collaborates with engineering, architecture, analytics, and business teams while following Git, Agile, and software development best practices.
Top Skills: AirflowSparkAWSAws GlueAzure Data FactoryCi/CdCsvDatabricksDelta LakeDockerGitJSONKafkaParquetPysparkPythonSpark SqlSQL
One Month AgoSaved
In-Office
2 Locations
Senior level
Senior level
Artificial Intelligence • Information Technology • Software • Consulting
Leads enterprise data engineering strategy and designs scalable cloud and hybrid data architectures. Responsibilities include building high-volume ETL/ELT pipelines, modernizing data platforms, implementing governance and security, supporting streaming analytics and machine learning workloads, and establishing DataOps practices. The role provides technical leadership and mentorship, partners with data science and product teams, translates business requirements into technical solutions, and develops REST APIs and Azure PaaS solutions.
Top Skills: .Net CoreApache AirflowApache KafkaSparkAWSAzure App ServicesAzure Integration ServicesAzure PaasBlazorC#Cloud SecurityDatabricksDelta LakeDevOpsEntity Framework CoreGoogle Cloud PlatformAzurePythonRest ApisSnowflakeSQL
Reposted One Month AgoSaved
In-Office
Hyderabad, Telangana, IND
Senior level
Senior level
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Design and implement scalable data architectures and end-to-end batch and real-time ETL/ELT pipelines across GCP and Snowflake. Develop dimensional models, optimize queries and costs, execute data migrations, integrate diverse data sources, and implement security, governance, monitoring, lineage, and quality controls. Partner with data scientists, analysts, product, and business teams to translate requirements into reliable technical solutions.
Top Skills: AngularSparkBigQueryCloud BuildCloud ComposerCloud FunctionsCloud LoggingCloud MonitoringCloud RunCloud WorkflowsDataprocGoogle Cloud Platform (Gcp)Google Cloud Storage (Gcs)KafkaPub/SubPysparkPythonReactSnowflakeSQLTerraformVertex Ai
One Month AgoSaved
In-Office
2 Locations
Mid level
Mid level
Information Technology
Builds and maintains scalable batch and streaming data pipelines, data models, data flows, API integrations, and data products across on-premises and cloud environments. Translates business analytics requirements into technical solutions, including data cleansing, transformation, governance, validation, reporting support, and AI/ML data preparation. Collaborates with business users, data scientists, reporting specialists, and technology teams while executing moderately complex data projects with limited supervision.
Top Skills: AirflowAPIsAWSCloud ComputingDbtNon-Relational DatabasesPythonRelational DatabasesSnowflakeSQL
Reposted 16 Days AgoSaved
In-Office
Hyderabad, Telangana, IND
Senior level
Senior level
Biotech
Designs, develops, and maintains scalable data ingestion, processing, and production pipelines. Builds reusable data engineering components, data models, schemas, and integrations supporting analytics and reporting. Partners with technical and business stakeholders to gather requirements, ensure data quality, optimize performance, and meet SLAs. Supports testing, deployment, hypercare, knowledge transfer, documentation, and solution adoption across global projects and enhancements.
Top Skills: SparkAWSData ModelingData WarehousingETLGoogle Cloud PlatformHadoopHiveJavaKafkaAzurePythonRelational DatabasesScalaSQL
One Month AgoSaved
In-Office or Remote
Hyderabad, Telangana, IND
Junior
Junior
Enterprise Web • HR Tech • Professional Services • Software
Implement a large-scale data platform modernization initiative by migrating approximately 1,000 datasets to Snowflake, upgrading Airflow pipelines, migrating Hive to Iceberg, adapting data pipelines, and supporting workflow monitoring. The role requires hands-on Python, SQL, Spark, Kafka, AWS S3, Snowflake, testing, debugging, and large-scale data migration experience. This is a remote contract engagement through March 2027 for candidates in eligible EMEA and APAC locations.
Top Skills: Apache AirflowApache HiveApache IcebergApache KafkaSparkAws S3ConfluentParquetPysparkPythonSnowflakeSnowpark ConnectSQL
One Month AgoSaved
Hybrid
Hyderabad, Telangana, IND
Entry level
Entry level
Information Technology • Database • Consulting
Develop and maintain GCP-based ELT pipelines using dbt and BigQuery, migrate SAS transformation logic and datasets to GCP, build SQL data transformations and dimensional models, and perform data validation, reconciliation, and quality testing. The role also involves managing data engineering projects, guiding teams, supporting migration activities, and driving continuous process improvement.
Top Skills: Apache AirflowBigQueryCloud ComposerCloud StorageDataprocDbtGitGitGoogle Cloud Platform (Gcp)Proc SqlPythonSASSQL
One Month AgoSaved
Hybrid
Hyderabad, Telangana, IND
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Own end-to-end batch and real-time data pipeline delivery using Databricks, Spark, Python, PySpark, dbt, and Kafka. Design transformation architecture, CI/CD pipelines, DataOps and observability frameworks, and administer Databricks environments. Lead streaming solutions, deployments, migrations, and upgrades while optimizing performance, access, and cost. Partner with stakeholders on requirements and technical trade-offs, mentor engineers, and lead code and design reviews.
Top Skills: SparkAWSAzureCi/CdDatabricksDatabricks Asset BundlesDataopsDbtGCPGitlabJenkinsKafkaPysparkPythonSpark Structured StreamingSQLTdd
One Month AgoSaved
Hybrid
Hyderabad, Telangana, IND
Expert/Leader
Expert/Leader
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead the design, development, deployment, and support of scalable data pipelines and platforms across on-premises and cloud environments. Build batch and near-real-time processing frameworks, modernize ETL and data warehouse workloads, implement governance and observability capabilities, troubleshoot production issues, and drive lakehouse adoption. Mentor engineers, collaborate with architects and stakeholders, evaluate emerging technologies, and ensure adherence to security, quality, and operational standards.
Top Skills: Amazon DynamodbAmazon EmrAmazon S3Apache AirflowApache HadoopApache NifiSparkAWSAws GlueCassandraData LakesData WarehousesHadoopJavaLakehousesNosql DatabasesObject StorageOracleScalaSQLSQL Server
One Month AgoSaved
Remote
India
Entry level
Entry level
Information Technology • Consulting
Designs and maintains scalable data pipelines and ETL/ELT workflows using Python, SQL, and Azure Databricks. Manages large structured and semi-structured datasets, data models, monitoring, quality controls, troubleshooting, and production support. Integrates LLM and Generative AI capabilities, including APIs, embeddings, prompt engineering, and RAG workflows, into data solutions. Collaborates with engineering, analytics, and business teams while following security, CI/CD, documentation, and maintainability best practices.
Top Skills: Azure Data FactoryAzure Data Lake Storage (Adls)Azure DatabricksAzure DevopsAzure Openai ServiceAzure SqlAzure Synapse AnalyticsCi/CdEmbeddingsEtl/EltGenerative AiGitLarge Language Models (Llms)Llm ApisPrompt EngineeringPythonRest ApisRetrieval-Augmented Generation (Rag)SQLVector DatabasesVector Search
One Month AgoSaved
Remote
India
Expert/Leader
Expert/Leader
Information Technology • Software • Business Intelligence
Design, build, and optimize GCP data ecosystems, including pipelines, data lakes, warehouses, storage architectures, and processing infrastructure. Gather requirements, model data, troubleshoot complex issues, tune performance, monitor systems, and support new functionality. Collaborate directly with clients and cross-functional teams, while mentoring junior data engineers and leading technical improvement discussions.
Top Skills: AlteryxApache AirflowSparkBigQueryConfluenceDatabricksDataformDbtEltETLGitGoogle Cloud FunctionsGoogle Cloud Platform (Gcp)Google Cloud StorageJIRALookerAzureNoSQLPower BIPythonSQLTableauTalend
One Month AgoSaved
Remote
India
Expert/Leader
Expert/Leader
Information Technology • Software • Business Intelligence
Provides technical leadership for Azure data engineering projects, including solution architecture, data modeling, pipelines, data integration, code quality, QA, performance optimization, governance, security, and documentation. Collaborates with stakeholders and project managers to define scope, manage risks, and deliver scalable, efficient solutions. Requires strong Python, SQL, PySpark, Databricks, Azure Data Factory, Delta Lake, Synapse, Spark, data warehousing, governance, and Azure DevOps expertise.
Top Skills: SparkAzureAzure Data FactoryAzure Data LakeAzure DatabricksAzure DevopsAzure SynapseCi/CdData GovernanceData PipelinesData WarehousingDelta LakeETLPysparkPythonSQL
24 Days AgoSaved
In-Office
Hyderabad, Telangana, IND
Senior level
Senior level
Information Technology
Designs, builds, and maintains scalable cloud-native data platforms, ETL/ELT pipelines, batch and near-real-time processing solutions, NoSQL and search systems. The role uses Python, PySpark, AWS, DynamoDB, and OpenSearch to process large datasets, optimize performance, ensure data quality and governance, troubleshoot platforms, and support analytics. Responsibilities also include collaboration with engineering and product teams, code reviews, and mentoring junior engineers.
Top Skills: Amazon AthenaAmazon CloudwatchAmazon EcsAmazon EksAmazon EmrAmazon EventbridgeAmazon KinesisAmazon RedshiftAmazon S3Amazon SnsAmazon SqsApache AirflowApache KafkaAWSAws GlueAws IamAws LambdaAws Step FunctionsCi/CdDatabricksDelta LakeDockerDynamoDBElasticsearchJavaKubernetesOpensearchPysparkPythonSnowflakeSQLTerraform
All Filters
JobType
New Jobs
Job Category
Experience
Industry
Company Name
Company Size

Sign up now Access later

Create Free Account