Sr Lead Data Engineer - Databricks, Snowflake, Redshift, AWS

Embrace this pivotal role as an essential member of a high performing team dedicated to reaching new heights in data engineering. Your contributions will be instrumental in shaping the future of one of the world’s largest and most influential companies. 

As a Senior Lead Data Engineer at JPMorgan Chase within the Commercial and Investment Bank's Markets Tech Team, you are an integral part of an agile team that works to enhance, build, and deliver data collection, storage, access, and analytics in a secure, stable, and scalable way. Leverage your deep technical expertise and problem solving capabilities to drive significant business impact and tackle a diverse array of challenges that span multiple data pipelines, data architectures, and other data consumers.

Job responsibilities

• Design and build hybrid on-prem and public cloud data platform solutions
• Design and build end-to-end data pipelines for ingestion, transformation, and distribution, supporting both batch and streaming workloads
• Develop and own data products that are reusable, well-documented, and optimized for analytics, BI, and AI/ML consumers
• Implement and manage modern data lake and Lakehouse architectures, including Apache Iceberg table formats
• Implement interoperability across data platforms and tools, including Databricks, Snowflake, Amazon Redshift, AWS Glue, and Lake Formation
• Establish and maintain end-to-end data lineage to support observability, impact analysis, and regulatory requirements
• Implement data quality validation and monitoring using frameworks such as Great Expectations
• Provide recommendations and insight on data management and governance procedures and intricacies applicable to the acquisition, maintenance, validation, and utilization of data, advises junior engineers and technologists.
• Design and deliver trusted data collection, storage, access, and analytics data platform solutions in a secure, stable, and scalable way
• Define database back-up, recovery, and archiving strategy and approves data analysis tools and processes
• Create functional and technical documentation supporting best practices, evaluate and report on access control processes to determine effectiveness of data asset security

Required qualifications, capabilities, and skills

• Formal training or certification on computer science concepts or equivalent and 5+ years applied experience
• Hands-on experience building and operating batch and streaming data pipelines at scale
• Experience with Apache Iceberg and modern table formats in Lakehouse environment
• Strong proficiency with Databricks, Snowflake, Amazon Redshift, and AWS data services such as Glue and Lake Formation
• Experience implementing data lineage, data quality, and data observability frameworks
• Working experience with both relational and NoSQL databases
• Advanced understanding of database back-up, recovery, and archiving strategy
• Experience presenting and delivering visual data

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.