IDC Technologies Inc.
Job DescriptionPlease focus on spark/Pyspark with data experience.
Must Have Skills : Python , Data Engineering
Nice to have : Docker , Kuebernetes
Looking for experienced Python engineers with a background in data engineering. Should be familiar with modern data platforms like Apache Presto or AWS Athena, and workflow tools like Apache Airflow.
Engineers will write data collection scripts, aggregation algorithms, and implement storage technologies that power our internal business intelligence operations.
Candidates are expected to be excellent engineers and will be interviewed by our existing engineering team. Please do not submit candidates who do not have strong knowledge of algorithms and data structures, and a track record of shipping high quality software
QualificationsBachelors
Additional InformationAll your information will be kept confidential according to EEO guidelines.
Skills Required
- Python
- Data Engineering experience
- Apache Spark / PySpark
- Familiarity with Apache Presto or AWS Athena
- Experience with Apache Airflow (workflow tools)
- Strong knowledge of algorithms and data structures
- Bachelor's degree
- Docker
- Kubernetes
What We Do
IDC Technologies is an international technology-services company providing IT staffing, consulting, business-process services, and digital transformation support. It helps organizations recruit talent, modernize workflows, and build disruptive applications using cloud, Agile, DevOps, SRE, and big-data technologies. The company also delivers custom application development, application support, maintenance, managed services, and broader workforce-management solutions for clients across multiple industries in North America and globally.
