Python Data Engineer (All genders)

Posted 13 Days Ago
Be an Early Applicant
3 Locations
In-Office
5-5 Annually
Senior level
Artificial Intelligence • Software
The Role
The Python Data Engineer is responsible for designing and managing data pipelines using cloud technologies, processing large-scale data, and collaborating with Data Scientists. Key responsibilities include ETL/ELT development and data architecture.
Summary Generated by Built In

Join our global team of experts 

At Diconium, we do digital business transformation across various industries. As a team member, you will work on projects that generate value from software, data, and AI by delivering strategies and solutions that challenge conventional industry practices and drive technological progress. Together with over 2,300 fellow experts, you enable Fortune 500 firms, global market leaders, and SMEs to maximize the impact of their digital initiatives and achieve digital excellence. In everything we do, we prioritize people and genuine human connections, ensuring a supportive and inclusive work environment. And we give you maximum flexibility thanks to our hybrid workplace. 

WHAT YOU CAN EXPECT: 

 

  • You will gather and process raw, structured, semi-structured, and unstructured data using batch and real-time data processing frameworks. 

  • You will work on fast paced and innovative projects with the goal to deliver innovative solutions for our customers. 

  • You will design, implement, and manage scalable data pipelines using cloud-native technologies to efficiently process and analyze large volumes of data. 

  • You will evaluate and implement new technologies and tools in the area of data engineering to continuously improve the efficiency and performance of our data processing processes. 

  • You will work closely with Data Scientists and Analysts, identifying potential data sources and evaluating their utility to understand data requirements and develop appropriate solutions. 

  • Additionally you will share your expertise and experience with other team members, contribute to knowledge sharing and development of the team. 

  • Finally you will develop and maintain documentation on data engineering processes, best practices and technologies. 

WHAT YOU BRING ALONG

Must haves:

  • 5+ years of hands-on experience in Data Engineering, working with large-scale data pipelines and cloud platforms. 

  • Strong programming skills in Python and SQL, with experience using distributed data processing frameworks such as PySpark or Spark SQL. 

  • Proficient in building and deploying cloud-native data pipelines on at least one major cloud (Azure or AWS). 

  • Experience with cloud-based data services, such as Azure Data Factory, Azure Databricks, AWS Glue, or similar orchestration and processing tools. 

  • Strong background in data integration, ETL/ELT development, data modeling, and data architecture. 

  • Experience working in Unix/Linux environments, including writing Bash scripts for automation and operations. 

Nice to have: 

  • Familiarity with AWS data and compute services, such as S3, Glue, IAM, Redshift, Lambda, VPC, and DynamoDB. 

  • Exposure to CI/CD practices and Infrastructure-as-Code using Terraform, Azure DevOps, GitHub Actions, or similar tools. 

  • Understanding of streaming technologies, such as Kafka, Azure Event Hubs, or AWS Kinesis. 

  • Experience working within Agile delivery environments.


WHAT WE HAVE TO OFFER


Discover new skills and improve your strengths, adapt your working day to your personal lifestyle, celebrate community, sustainability and diversity. And sweeten your working life with awesome perks and benefits!
Professional & Personal Growth: Develop yourself both professionally and personally through training programs, free language courses, competence centers and an active tech community.
Flexible Work-Life Balance: Benefit from hybrid work, workation, flexible hours, parental support and sabbaticals.
Embrace Diversity & Sustainability: Engage in our Sustainability Hub, diverse communities, Diversity Taskforce and after-work activities.
Comprehensive Benefits: Enjoy public transport tickets, job bikes, health offers, supplementary insurances, a pension plan and various discounts.


WHAT WE VALUE

At Diconium, we value and recognize the unique perspectives and experiences of each individual. With this in mind, we welcome and cherish every single application equally. At the same time, we stand up against any type of discrimination and harassment based on gender, age, skin color, religion, sexual orientation, origin, disability, gender identity and other protected characteristics.
 

If you have any questions, feel free to reach out.
Your contact person is

Elena, [email protected]

Top Skills

Aws Glue
Aws Kinesis
Aws Lambda
Aws Redshift
Aws S3
Azure Data Factory
Azure Databricks
Azure Devops
Azure Event Hubs
Kafka
Pyspark
Python
Spark Sql
SQL
Terraform
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Stuttgart
2,334 Employees
Year Founded: 1995

What We Do

diconium is a digital business transformation partner with a global footprint. We navigate complexity and deliver competitiveness at scale. We are 100% Volkswagen Group company, driving digital excellence in automotive, industrial, and beyond. With 30 years of experience in updating industries, we ensure digital transformation delivers true impact through software, data, and AI. Our clients include multinationals from various industries, including Volkswagen, Stihl, Bechtle, Trumpf, and Zeiss. Present in four of the world's five largest economies across Europe, North America, and Asia, our diverse team of over 2,500 experts brings deep expertise in data & AI, software engineering, integration & testing, cybersecurity, and digital advisory. With our digital business solutions and software-defined products we challenge conventional industry practices and drive technological progress. With everything we do, we strive to update industries and society to build smarter and desirable futures. DI - CON - IUM DIgital | Our heart beats for all things digital. Software, data, and AI are our playground and expertise. eCONomy | We navigate the complexities of today's business environment, transforming technological opportunities into sustainable growth and competitive advantage. IUM | The suffix -ium represents powerful elements in chemistry. We are the binding element between technology and business, strategy and execution, your organization and successful digital transformation. READY TO UPDATE YOUR BUSINESS WITH US? LET'S TALK!

Similar Jobs

RapDev Logo RapDev

Servicenow Engineer

Information Technology • Productivity • Professional Services • Software
Hybrid
28 Locations
130 Employees

CrowdStrike Logo CrowdStrike

Data Scientist

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
România
10000 Employees
5-5 Annually

WeLocalize Logo WeLocalize

Hebrew Linguist

Machine Learning • Natural Language Processing
In-Office or Remote
9 Locations
2331 Employees

LogicMonitor Logo LogicMonitor

Account Executive

Artificial Intelligence • Cloud • Information Technology • Machine Learning • Software
Easy Apply
Hybrid
28 Locations
1100 Employees

Similar Companies Hiring

Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY
Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account