Senior Software Engineer- Data Engineer

We are looking for Senior ETL Developer to join Data Engineering Team based in Bangalore. The candidate will be tasked with the development and maintenance of end-to-end data pipeline using modern, cutting-edge big data technologies and thereby enable rich content available to Cortellis products.

About You – experience, education, skills, and accomplishments

• Bachelor's degree in engineering or master’s degree (BE, ME, B Tech, M Tech, MCA, MS
• Minimum 3 years of experience in building ETL pipelines and proficiency in PySpark.
• Strong SQL and non-SQL database skills.
• Proficient in Python3 and experience with Apache Spark and/or Databricks.
• Passionate about code and software architecture.

It would be great if you also have experience in . . .

• Docker
• AWS services: EC2, ECS, RDS, EMR, S3
• ElasticSearch, Presto, Snowflake
• Oracle, PostgreSQL
• Trifacta

What will you be doing in this role?

• Providing technical leadership and guidance, evaluating various technologies to balance business needs and cost-effectiveness.
• Collaborating with business and IT teams to design and implement a data lake platform.
• Maintaining the overall solution architecture for the data lake platform.
• Establishing technical best practices for big data management and solutions, from technology selection to architecture and implementation.
• Ensuring all components of the data lake platform meet SLAs.
• Leading technical investigations, POCs, and hands-on coding to make technical recommendations.
• Mentoring and coaching team members to enhance their technical and professional skills.

Product you will be developing

Cortellis

About the Team 

The Data Engineering Team, a newly setup team in Life Sciences & Healthcare, aim to build a new end-to-end data pipeline to process data from Content hub to Cortellis products. We are currently a team of 8 and leverage modern, cutting-edge big data technologies to implement the new data pipeline. Our team has expertise in Rational Database Management System (Oracle, PostGres etc.), Python, Spark (PySpark, SparkSQL), Databricks, EMR, Airflow, AWS

Hours of Work

• Fulltime
• 40 h/week( IST Hours)
• Hybrid working model

At Clarivate, we are committed to providing equal employment opportunities for all qualified persons with respect to hiring, compensation, promotion, training, and other terms, conditions, and privileges of employment. We comply with applicable laws and regulations governing non-discrimination in all locations.