Lead Consultant - ETL Developer with knowledge on AirFlow!

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook.
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.
Inviting applications for Lead Consultant - ETL Developer with knowledge on AirFlow!
Responsibilities
· Design, develop, and deploy data pipelines using Apache Airflow.
· Manage and monitor data workflows, ensuring data quality and integrity.
· Automate tasks and processes using Airflow's DAGs (Directed Acyclic Graphs) and operators.
· Integrate Airflow with various data sources and systems, such as databases, APIs, and cloud storage.
· Troubleshoot issues with Airflow DAGs and tasks, and optimize pipeline performance
· Configuration changes, schedule load stop /start and automate as much as possible.
· Investigate long running jobs, unexpected hung jobs or loads - CPU, network, high volume of data, hung threads etc.
· Migration of any code changes in Dev, QA, and Prod.
· Improve process on file ingestion process - Identifying the data missing, format related incidents, file naming conventions etc.
· Keep track of backup repository for code in Dev, QA and Prod env
Qualifications we seek in you!
Minimum Qualifications
· Education: Bachelor's degree in Computer Science, Software Engineering, or a related field.
· Experience: Minimum of 5-8 years of experience with Apache Airflow, data engineering, and data integration.
· Certifications: Apache Airflow certifications, such as the Apache Airflow Developer Certification, can be advantageous.
Preferred Skills
· Airflow DAG development
· Task management and workflow orchestration
· Python programming
· Data integration with various sources and systems
· Monitoring and troubleshooting Airflow DAGs and tasks
· Experience with Airflow's operators and sensors
Why join Genpact?
· Be a transformation leader – Work at the cutting edge of AI, automation, and digital innovation
· Make an impact – Drive change for global enterprises and solve business challenges that matter
· Accelerate your career – Get hands-on experience, mentorship, and continuous learning opportunities
· Work with the best – Join 140,000+ bold thinkers and problem-solvers who push boundaries every day
· Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
Come join the tech shapers and growth makers at Genpact and take your career in the only direction that matters: Up.
Let’s build tomorrow together.
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.