Senior Big Data Engineer

Posted 10 Days Ago
Be an Early Applicant
İstanbul, Şişli, İstanbul
Senior level
Information Technology • Software
The Role
The Senior Big Data Engineer will develop and optimize ETL pipelines, manage and analyze data using SparkSQL, PySpark, and HiveQL, and present insights to senior leadership. Responsibilities include resolving technical issues, optimizing queries, and collaborating with the global AppGallery team while ensuring continuous improvement processes are in place.
Summary Generated by Built In

Description
  • We are currently looking for Senior Big Data Engineer, Tech Lead to join our team based in our Huawei Turkey R&D Center.
Requirements
  • · Employ big data solutions and build the ETL pipelines that power the lifecycle of AppGallery operation from serving, search, recommendation, discovery and personalization
  • · Develop, optimize and test SparkSQL and HiveQL queries in the Hadoop big data ecosystem and analyze complex data related issues and optimize solution
  • · Using SparkSQL, PySpark to translate data into meaningful insights and share with project members and stakeholders
  • · Design, develop and present executive-level insights and reports to senior leadership to support business decision making
  • · Analyze and resolve technical problems
  • · Identify, design and implement internal process improvements
  • · Code reviews and Feedback
  • · Production issues escalation
  • · Support and collaborate with a global AppGallery team.

Qualifications & Experience 

  • · BSc or MSc degree in Computer Engineering, Computer Science, Software Engineering or a related technical field of study.
  • · Have minimum 3 years of experience in professional
  • · Excellent understanding of ETL cycle
  • · Hands on experience with Python programming languages for data engineering.
  • · Hands on experience on Big Data platforms is must, experience in Hadoop ecosystem including the ability to interact with data through Spark, Hive , Map-Reduce
  • · Hands on experience on writing optimized SparkSQL on large-scale system
  • · Hands-on experience on complex SQL queries and experience working with relational databases
  • · Experience on performing root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement
  • · Hands on experience with a Data Visualization tools such as FineBI, Tableau, PowerBI
  • · Experience on working in Unix/Linux Environments
  • · Experience on team work and continuous development/integration on systems such as Git version control system, including branching and merging strategies
  • · Hands-on experience on optimize complex queries by applying clean coding principles
  • · Experience on performing root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement
  • · Finding better ways for the team to work
  • · Enthusiasm about constantly learning new technologies
  • · Strong analytical thinking, problem solving, communication and presentation skills.
  • · Strong bias for action and ownership
  • · Strong desire for continuous learning and development
  • · Strong multi-tasking abilities and motivation in a fast paced environment.
  • · Passion for sharing what you've learnt and confidence to ask others for help
  • · Fluency in both written and spoken English is a must

Top Skills

Pyspark
Sparksql
The Company
Bellevue, WA
168,766 Employees
On-site Workplace

What We Do

Huawei is a leading global provider of information and communications technology (ICT) infrastructure and smart devices. With integrated solutions across four key domains – telecom networks, IT, smart devices, and cloud services – we are committed to bringing digital to every person, home and organization for a fully connected, intelligent world.

Huawei's end-to-end portfolio of products, solutions and services are both competitive and secure. Through open collaboration with ecosystem partners, we create lasting value for our customers, working to empower people, enrich home life, and inspire innovation in organizations of all shapes and sizes.

At Huawei, innovation focuses on customer needs. We invest heavily in basic research, concentrating on technological breakthroughs that drive the world forward. We have more than 180,000 employees, and we operate in more than 170 countries and regions. Founded in 1987, Huawei is a private company fully owned by its employees.

House Rules
This page is for ICT professionals with an interest in Huawei and our industry to engage in open discussions.
To facilitate dialogue, please follow these rules:
- Huawei holds the right to delete comments that are offensive, misleading, false, unlawful, off-topic and in violation of any regulations.
- Repeated violations of any of the above will be removed and users may be blocked.
- Huawei does not necessarily endorse the information shared by members.
- Please be familiar with and follow LinkedIn's User Agreement.
- By publicly uploading a photograph or comment, you give Huawei permission to feature your content. This will always be credited.

Please visit the below portals for career or customer service queries.
Career page: http://bit.ly/2rdljD7
Customer service: http://bit.ly/2a4mXNY

Thank you for visiting us & we hope you enjoy your time on our page.

Similar Jobs

İstanbul, Şişli, İstanbul, TUR
3410 Employees
2 Locations
800 Employees

Pfizer Logo Pfizer

Data Operations Specialist (Contractor)

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
İstanbul, Şişli, İstanbul, TUR
121990 Employees

Pfizer Logo Pfizer

Medical Affairs Scientist

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
İstanbul, Şişli, İstanbul, TUR
121990 Employees

Similar Companies Hiring

InCommodities Thumbnail
Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
Austin, TX
234 Employees
RunPod Thumbnail
Software • Infrastructure as a Service (IaaS) • Cloud • Artificial Intelligence
Charlotte, North Carolina
53 Employees
Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account