We are looking for Senior ETL Developer to join Data Engineering Team based in Bangalore. The candidate will be tasked with the development and maintenance of end-to-end data pipeline using modern, cutting-edge big data technologies and thereby enable rich content available to Cortellis products.
About You – experience, education, skills, and accomplishments
- Bachelor's degree in engineering or master’s degree (BE, ME, B Tech, M Tech, MCA, MS
- Minimum 3 years of experience in building ETL pipelines and proficiency in PySpark.
- Strong SQL and non-SQL database skills.
- Proficient in Python3 and experience with Apache Spark and/or Databricks.
- Passionate about code and software architecture.
It would be great if you also have experience in . . .
- Docker
- AWS services: EC2, ECS, RDS, EMR, S3
- ElasticSearch, Presto, Snowflake
- Oracle, PostgreSQL
- Trifacta
What will you be doing in this role?
- Providing technical leadership and guidance, evaluating various technologies to balance business needs and cost-effectiveness.
- Collaborating with business and IT teams to design and implement a data lake platform.
- Maintaining the overall solution architecture for the data lake platform.
- Establishing technical best practices for big data management and solutions, from technology selection to architecture and implementation.
- Ensuring all components of the data lake platform meet SLAs.
- Leading technical investigations, POCs, and hands-on coding to make technical recommendations.
- Mentoring and coaching team members to enhance their technical and professional skills.
Product you will be developing
Cortellis
About the Team
The Data Engineering Team, a newly setup team in Life Sciences & Healthcare, aim to build a new end-to-end data pipeline to process data from Content hub to Cortellis products. We are currently a team of 8 and leverage modern, cutting-edge big data technologies to implement the new data pipeline. Our team has expertise in Rational Database Management System (Oracle, PostGres etc.), Python, Spark (PySpark, SparkSQL), Databricks, EMR, Airflow, AWS
Hours of Work
- Fulltime
- 40 h/week( IST Hours)
- Hybrid working model
At Clarivate, we are committed to providing equal employment opportunities for all qualified persons with respect to hiring, compensation, promotion, training, and other terms, conditions, and privileges of employment. We comply with applicable laws and regulations governing non-discrimination in all locations.
Top Skills
What We Do
Clarivate™ is a global leader in providing solutions to accelerate the lifecycle of innovation. Our bold mission is to help customers solve some of the world’s most complex problems by providing actionable information and insights that reduce the time from new ideas to life-changing inventions in the areas of science and intellectual property. We help customers discover, protect and commercialize their inventions using our trusted subscription and technology-based solutions coupled with deep domain expertise. For more information, please visit clarivate.com.
