We are looking for a skilled Data Engineer with strong hands-on experience in Python, PySpark, and FastAPI. The ideal candidate should be proficient in building scalable data pipelines, working with cloud/data warehousing environments, and collaborating with cross-functional teams to deliver high-quality data solutions.
Design, develop, and maintain scalable data pipelines using Python and PySpark.
Build and manage REST APIs using FastAPI for data integration and consumption.
Work with SQL extensively for querying, data transformation, and performance optimization.
Implement and follow best practices in data warehousing, data modeling, and ETL/ELT processes.
Collaborate using GitHub or similar version control and collaboration tools.
Work with CI/CD pipelines for deploying data workflows and services.
Conduct data profiling and quality checks to ensure accuracy and reliability.
Gather business requirements, perform analysis, and create clear documentation.
Participate in design reviews and contribute to data process improvements and architecture decisions.
RequirementsRequired Skills & Experience
Strong proficiency in Python, PySpark, and SQL.
Hands-on experience building APIs with FastAPI.
Experience with GitHub or similar code collaboration/version control tools.
Good understanding of data warehousing concepts, data modeling, and best practices.
Exposure to CI/CD pipelines and modern DevOps practices.
Experience in data profiling, requirements documentation, and data process design.
Strong analytical and problem-solving abilities.
Excellent communication and documentation skills.
Skills Required
- Strong proficiency in Python
- Strong proficiency in PySpark
- Strong proficiency in SQL
- Hands-on experience building APIs with FastAPI
- Experience with GitHub or similar version control and collaboration tools
- Understanding of data warehousing concepts and data modeling
- Exposure to CI/CD pipelines and modern DevOps practices
- Experience in data profiling, requirements documentation, and data process design
- Strong analytical and problem-solving abilities
- Excellent communication and documentation skills
What We Do
ScatterPie Analytics is a data analytics and business intelligence company that modernizes enterprise decision-making. It brings together open-source technologies and enterprise tools to create powerful, cost-effective, and flexible intelligence solutions. The company delivers end-to-end analytics, including data engineering, cloud data platforms, business intelligence, AI, decision intelligence, and industry-focused analytics solutions, transforming raw data into actionable insights for evidence-based decisions across modern organizations.
