.jpeg){kind=icon}
As a Data Automation Engineer, you will play a crucial role in developing and maintaining automated data processing systems. You will work closely with data analysts, and other stakeholders to design, implement, and optimize data pipelines, ensuring the efficient and accurate flow of data throughout the organization.
What You'll Do:
- Develop and implement automated data pipelines for ingesting, processing, and storing structured and unstructured data.
- Integrate data from various sources in both real-time and batch mechanisms and perform transformations to ensure consistency, accuracy, and reliability.
- Implement data quality checks and monitoring mechanisms to identify and address issues proactively.
- Write code and scripts for automation of data processes using languages such as Python, Java, or Scala.
- Leverage ETL (Extract, Transform, Load) tools and frameworks [Apache spark, AWS Glue] for efficient data processing.
- Collaborate with other intelligent data teams.
- Ensure seamless data flow for machine learning and analytics applications.
- Implement monitoring systems to track data pipeline performance and identify areas for optimization.
- Continuously optimize data processes for efficiency and scalability.
- Document data processes, system architecture, and codebase for knowledge sharing and future reference.
- Keep documentation up-to-date with any changes or enhancements to the data infrastructure.
- Implement and adhere to data security and compliance standards.
- Collaborate with security teams to ensure data protection and privacy.
You're a Perfect Fit If You Have:
- 1+ years of experience in data engineering, automation, or a related field.
- Strong understanding of data pipelines and data lifecycle management.
- Proficiency in scripting languages like Python, Shell, or similar.
- Experience with data automation tools (Airflow, Luigi, etc.) a plus.
- Excellent analytical and problem-solving skills.
- Strong communication and collaboration skills to work effectively across teams.
- Knowledge with cloud platforms (AWS, Azure, GCP) for data processing.
Knowledge of data warehousing and data quality methodologies
Location:EG-Banha, Egypt (EI Corniche Street)Time Type:Full timeJob Category:Information TechnologySkills Required
- 1+ years of experience in data engineering, automation, or a related field
- Strong understanding of data pipelines and data lifecycle management
- Proficiency in scripting languages such as Python or Shell
- Experience writing code in Java or Scala
- Experience with ETL frameworks and big data processing (Apache Spark, AWS Glue)
- Experience or familiarity with data orchestration/automation tools (Airflow, Luigi)
- Knowledge of cloud data processing on AWS, Azure, or GCP
- Knowledge of data warehousing and data quality methodologies
- Strong analytical, problem-solving, communication, and collaboration skills
- Familiarity with data security and compliance standards
Arrow Electronics, Inc. Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Arrow Electronics, Inc. and has not been reviewed or approved by Arrow Electronics, Inc..
-
Affordable Benefits — Medical coverage includes multiple options with income-tiered employer contributions that substantially reduce costs for lower-wage employees (the base plan was heavily subsidized for earners under $55,000). These affordability measures, alongside EAP and telemedicine, help the overall package offset middling base pay in some roles.
-
Parental & Family Support — New parents receive fully paid leave (six weeks at 100% pay in prior materials, with more recent reporting of up to 12 weeks fully paid for the delivering parent in the U.S.). Backup dependent care and related family supports are also provided.
-
Leave & Time Off Breadth — Many salaried roles have unlimited PTO, while hourly staff receive competitive accrual-based PTO, with added flexibility from floating holidays and observance of MLK Day. These options indicate a broad time-off framework across employee groups.
Arrow Electronics, Inc. Insights
What We Do
A Fortune 500 company, ranked #133 in 2024, with over 22,000 employees worldwide, Arrow guides innovation forward for over 220,000 leading technology manufacturers and service providers. With 2023 sales of $33 billion, Arrow develops technology solutions that improve business and daily life. Arrow.com is the easiest place for innovators to create, make and manage technology.
Why Work With Us
Arrow is much more than products and services. We are a team of many backgrounds in a global ecosystem, working toward one common goal: to help customers create a better tomorrow, where innovation improves the quality of life and the benefits of technology are more accessible to all. Join us in building a better tomorrow for many!
Gallery
