Data Engineer - R01559065

Primary Skills

• Spark - Pyspark, SQL, SQL (Basic + Advanced), Python, Hive, Data Modelling Fundamentals

Specialization

• Data Analysis: Data Engineer

Job requirements

• Job Title: Data Engineer Location: [Insert Location] Department: [Insert Department] Reports To: [Insert Manager Name] ________________________________________ Role Overview We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have experience in data modeling, ETL processes, and working with large datasets to enable analytics and business intelligence. ________________________________________ Key Responsibilities • Design, develop, and maintain data pipelines for ingestion, transformation, and storage. • Implement ETL processes to ensure data quality, consistency, and reliability. • Collaborate with data scientists, analysts, and business teams to understand data requirements. • Optimize data workflows for performance and scalability. • Manage and monitor data infrastructure (cloud/on-premise). • Ensure compliance with data governance, security, and privacy standards. • Troubleshoot and resolve data-related issues promptly. ________________________________________ Required Skills & Qualifications • Bachelor’s/Master’s degree in Computer Science, Engineering, or related field. • Strong proficiency in SQL and experience with relational databases. • Hands-on experience with Python/Scala/Java for data processing. • Familiarity with big data technologies (Hadoop, Spark, Kafka). • Experience with cloud platforms (AWS, Azure, GCP) and data services. • Knowledge of data modeling, warehousing, and architecture principles. • Understanding of CI/CD pipelines and version control (Git). ________________________________________ Preferred Skills • Experience with streaming data and real-time processing. • Knowledge of containerization (Docker, Kubernetes). • Exposure to machine learning pipelines and analytics tools. ________________________________________ Soft Skills • Strong problem-solving and analytical skills. • Excellent communication and collaboration abilities. • Ability to work in a fast-paced, dynamic environment.