The Role
Design, develop, and maintain data pipelines and ETL processes using Python, Hive, Spark, and other technologies while handling Big Data.
Summary Generated by Built In
Senior Data Specialist
Primary Skills
- MapReduce, HDFS, Spark - Pyspark, ETL Fundamentals, SQL, SQL (Basic + Advanced), Spark - Scala, Python, Data Warehousing, Hive, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures, Oozie
Job requirements
- • Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
- • Design, develop, and maintain data pipelines and ETL processes using Python, Hive, Spark, and other relevant technologies.
- • Good Hands on Exp with java
- • Minimum of 6+ years of experience as a Data Engineer, with proven expertise in Python, Hive, and Spark. • Advance SQL experience and working experience with Big data Hadoop .
- • Strong understanding of data engineering concepts, including data modelling, data integration, and data warehousing. • Hands-on experience with tools such as Apache Airflow.
- • Experience with Docker and containerization technologies is a plus.
- • Strong SQL skills and experience with relational databases, such as PostgreSQL, MySQL, or similar.
- • Familiarity with Apache Spark.
- • Knowledge of data processing frameworks such as Apache Beam, Apache Flink, or similar.
- • Strong problem-solving and troubleshooting skills, with attention to detail.
- • Excellent communication and interpersonal skills, with the ability to work collaboratively in a team environment.
Top Skills
Apache Airflow
Data Warehousing
Docker
Etl Fundamentals
Hdfs
Hive
Mapreduce
Oozie
Plsql
Python
Spark - Pyspark
Spark - Scala
SQL
T-Sql
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Brillio is the leader in global digital business transformation, applying technology with a human touch. We help businesses define internal and external transformation objectives, and translate those objectives into actionable market strategies using proprietary technologies. With 2600+ experts and 13 offices worldwide, Brillio is the ideal partner for enterprises that want to quickly increase their core business productivity, and achieve a competitive edge, with the latest digital solutions.
