Job Description
Role Overview:We are seeking a seasoned data professional to join our Enterprise Data Platform team as the Capability Specialist for Data Ingestion, reporting to the Enterprise Data Platform Lead. As a key contributor to McAfee’s enterprise data strategy, you will be responsible for managing and implementing data ingestion processes on the Databricks platform.
This is a Remote position located in India. We are only considering candidates located in India and are not providing relocation at this time.
About the role:
- This role involves managing data ingestion processes on the Databricks platform, requiring expertise in Data Lake ingestion, ETL/ELT design, and CI/CD practices.
- You will design, implement and manage data ingestion processes from a variety of source systems, ensuring best practices are followed and tailoring approaches to each system.
- You will be responsible for developing, maintaining, and optimizing ETL/ELT pipelines while ensuring adherence to security, compliance, and PII management standards.
- Additionally, this position requires knowledge of system integration tools and effective data pipeline management.
- You'll implement automated monitoring to maintain pipeline infrastructure reliability.
- This role also includes contributing to Agile sprints and ensuring adherence to SDLC best practices.
- The ideal candidate will apply ingestion best practices across diverse source systems, tailoring approaches as needed.
About you:
- You should have 5 to 8 years of experience in data engineering, ingestion pipelining, and ETL/ELT,
- You should have proficiency in SQL and programming languages like Python or PySpark, as well as experience with Databricks and cloud platforms such as AWS.
- Hands-on expertise with Spark/Scala, ETL/ELT development using tools like Apache Airflow, and ingestion tools such as Dell Boomi is required.
- A solid understanding of data quality guidelines, CI/CD pipelines, and Agile sprint management is also necessary.
- Familiarity with Git and version control systems is expected.
- Experience in leading small, high-performing teams of data engineers is essential.
- Product subscription business model domain is a plus.
- Knowledge on Kong-API and Kinesis is a plus.
#LI-Remote
Company OverviewMcAfee is a leader in personal security for consumers. Focused on protecting people, not just devices, McAfee consumer solutions adapt to users’ needs in an always online world, empowering them to live securely through integrated, intuitive solutions that protects their families and communities with the right security at the right moment.
Company Benefits and Perks:We work hard to embrace diversity and inclusion and encourage everyone at McAfee to bring their authentic selves to work every day. We offer a variety of social programs, flexible work hours and family-friendly benefits to all of our employees.
- Bonus Program
- Pension and Retirement Plans
- Medical, Dental and Vision Coverage
- Paid Time Off
- Paid Parental Leave
- Support for Community Involvement
We're serious about our commitment to diversity which is why McAfee prohibits discrimination based on race, color, religion, gender, national origin, age, disability, veteran status, marital status, pregnancy, gender expression or identity, sexual orientation or any other legally protected status.
