Lead Data Engineer

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.

A Lead Data Engineer ensures their team's technology stack is fully compliant and managed within Experian security standards and policies. They act as a role model for best practice and high-quality technical output. Their mentoring brings tangible developmental benefit to the engineers they support. They lead and drive measurable technical improvement and innovation within their domain. 

Does this sound like you? Interested in finding out more? You should apply. 

Desirable, but not essential experience:

• Fivetran, Snowplow, or Orchestra for data ingestion and orchestration
• Data Mesh principles with domain-oriented data ownership
• Change Data Capture (CDC) patterns and implementations
• Real-time / streaming architectures (e.g. Kafka, Kinesis)
• MLOps or feature store implementations (e.g. SageMaker, Feast)
• Migration of legacy data warehouses to modern data platforms
• FinOps practices and cloud cost optimisation for data platforms
• Security tooling and compliance experience (e.g. Veracode, AquaSec, Rapid7)

As Lead Data Engineer, you will combine deep technical expertise with leadership capability. You will drive the migration from legacy data systems to our modern stack, establish engineering standards within your pod, and ensure your team delivers high-quality, reliable data products. 

We require a Lead Data Engineer who is highly skilled in: 

• Snowflake expertise (warehouses, clustering, RBAC, performance tuning)
• dbt for modular transformations, testing, and CI/CD-enabled data pipelines
• Python for data engineering (pandas, orchestration, automation, scripting)
• Advanced SQL skills (complex transformations, query optimisation)
• AWS data services experience (S3, Glue, Kinesis, DMS, Redshift)
• Data pipeline design and architecture across batch and streaming workloads
• Data quality frameworks (e.g. dbt tests, Great Expectations, or equivalent)
• Version control and CI/CD practices (Git, GitHub Actions, CodePipeline)
• Line management and technical mentoring of engineers
• Driving technical standards and best practices across teams
• Strong stakeholder partnership, translating data needs into scalable solutions
• Creating onboarding materials, documentation, and self‑service learning resources
• Ability to communicate complex technical concepts to non‑technical audiences

You will lead a pod of Data Engineers in Hyderabad, reporting to the UK-based Senior Data Engineering Manager. You are accountable for the technical output, professional development, and day-to-day management of your team. You will work asynchronously with UK colleagues and ensure your pod operates as true owners of their domain, not as a support function. 

A significant part of your role is enabling other teams to succeed with data. You will build relationships with Marketing, Risk, Analytics, and Data Science teams to understand their challenges and help them navigate the data ecosystem. You will create and maintain onboarding resources, run knowledge-sharing sessions, and ensure teams can self-serve where appropriate. You measure success not just by pipelines delivered, but by the outcomes your customers achieve. 

Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here