- Develop, optimize, and maintain data pipelines using Python.
- Work with large datasets and ensure efficient extraction, transformation, and loading (ETL).
- Integrate data from various internal and external sources.
- Build reusable Python modules and automation scripts.
- Work closely with data engineers, analysts, and stakeholders to understand requirements.
- Optimize performance of data processes and troubleshoot issues.
- Ensure data quality, validation, and integrity across systems.
- Deploy and monitor data workflows in production environments.
- Strong hands-on experience in Python (Pandas, NumPy, PySpark preferred).
- Experience with ETL development and building data pipelines.
- Good understanding of SQL, complex queries, and stored procedures.
- Experience with databases (PostgreSQL, MySQL, MongoDB, or similar).
- Exposure to big data frameworks (Spark/Hadoop) is a strong advantage.
- Experience with cloud platforms (AWS/Azure/GCP) for data services.
- Familiarity with API integrations, automation, and scheduling tools (Airflow, Cron).
- Knowledge of version control (Git) and CI/CD practices.
- Advanced experience with Python libraries used in data workflows (Pandas, NumPy, PySpark, FastAPI/Flask for data services).
- Hands-on experience with data warehousing concepts and building scalable data models.
- Practical understanding of ML model pipelines and supporting data science teams with clean, production-ready datasets.
- Experience working with workflow orchestration tools (Airflow, Prefect, Luigi).
- Familiarity with containerization and deployment (Docker/Kubernetes) for data applications.
- Strong understanding of cloud-based data services (AWS Glue, Redshift, Azure Data Factory, BigQuery).
- Bachelor’s degree in Computer Science, Engineering, or a related technical field.
Skills Required
- Strong hands-on experience with Python, including Pandas, NumPy, or PySpark
- Experience developing ETL processes and data pipelines
- Understanding of SQL, complex queries, and stored procedures
- Experience with databases such as PostgreSQL, MySQL, MongoDB, or similar
- Experience with cloud platforms such as AWS, Azure, or GCP for data services
- Familiarity with API integrations, automation, and scheduling tools such as Airflow or Cron
- Knowledge of Git and CI/CD practices
- Exposure to big data frameworks such as Spark or Hadoop
- Advanced experience with Python data workflow libraries, including Pandas, NumPy, PySpark, FastAPI, or Flask
- Experience with data warehousing concepts and scalable data models
- Understanding of machine learning model pipelines and production-ready datasets
- Experience with workflow orchestration tools such as Airflow, Prefect, or Luigi
- Familiarity with Docker or Kubernetes for data application deployment
- Strong understanding of cloud-based data services such as AWS Glue, Redshift, Azure Data Factory, or BigQuery
- Bachelor’s degree in Computer Science, Engineering, or a related technical field
What We Do
CloudThat is the first company in India to offer Cloud Training & Cloud Consultancy services for mid-market & enterprise clients from across the globe. Founded by Bhavesh Goswami, an ex-Amazonian with more than 17 years of experience in the Cloud Computing space, CloudThat has been empowering tech professionals with the best cloud training and cloud consulting services. Our journey in the Cloud space has won us many accolades, such as the prestigious Finalist of Microsoft Learning Partner of the Year Awards 2022 and 2020. CloudThat is also a proud AWS Advanced Consulting Partner, VMware Authorized Training Reseller, Google Cloud Platform Partner, Microsoft Gold Partner and Databricks Partner. Since our inception in 2012, we have trained over 500K IT professionals from fortune 500 companies in different types of cloud computing technologies such as Microsoft Azure, Amazon Web Services, Artificial Intelligence, Machine Learning, Google Cloud Platform, IoT, OpenStack, and OpenShift, DevOps, MongoDB, Big Data and more. We have also delivered over 200 AWS consulting services to top companies in need of cloud solutions. We have a global presence with offices in Bengaluru (India), the UK, and the USA. Our on-site and pre-scheduled public batches are available in different IT-centric cities in India and Overseas.




.jpg)

