Data Engineer
Pune, India
About Us
Coditation Systems was founded by a serial entrepreneur, and a team of young talented technologists, some of who have grown to spearhead the organization. With its inception in 2016, we became a boutique technology services and solutions firm specializing in Machine Learning & AI, Data Engineering, and Cloud. We have a team of ninja architects, data scientists, data engineers, and software engineers having decades of collective experience of applying emerging technologies to build cutting edge software products.
What are we looking for?
We are looking for an experienced Data Engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods. If you are detail-oriented, with excellent organizational skills and experience in this field, we’d like to hear from you.
A Day in the Life
● Building productionized data ingestion and processing pipelines using any of these Java/Spark/Scala/Python/GCP/Cloud or similar.
● Designing and implementing a fully operational production grade large scale data solution on Snowflake and Amazon Redshift Data Warehouse .
● Designing and implementing production grade data warehousing solutions on large scale data technologies such as Teradata/Oracle/DB2.
● Large scale Data Migration from on premise to cloud data warehouses.
● Building data ingestion data pipelines.
What you will need
● Understanding of SQL concepts and experience in the same.
● Excellent SQL skills
● Good to have knowledge of hadoop ecosystem, hive, YARN, EMR, EC2, S3 etc.
● Experience of writing data transforms
● Experience working with Unix, Linux Operating Systems.
● Excellent presentation and communication skills, both written and verbal.
● Ability to problem solve and architect in an environment with unclear requirements.
● Self driven with good probleming solving skills.
● Experience in working with AWS/Azure/Google or similar data services.
● Experience with dev-ops tools and shell scripting knowledge is a plus.
● Bachelor's degree in Computer Science/Engineering or equivalent.
Skills Required
- Strong understanding and experience with SQL concepts
- Excellent SQL skills
- Experience writing data transformations
- Experience working with Unix or Linux operating systems
- Experience with AWS, Azure, Google Cloud, or similar data services
- Strong analytical, problem-solving, and organizational skills
- Excellent written and verbal presentation and communication skills
- Ability to architect solutions in environments with unclear requirements
- Self-driven work style
- Bachelor's degree in Computer Science, Engineering, or equivalent
- Knowledge of the Hadoop ecosystem, Hive, YARN, EMR, EC2, and S3
- Experience with DevOps tools and shell scripting
What We Do
is a boutique technology services and solutions firm specializing in Machine Learning & AI, Data Engineering, and Cloud. It has a team of ninja architects, data scientists, data engineers, and software engineers having a decades of collective experience of applying emerging technologies to build cutting edge software products
