The Sr Data engineer is a core member of the agile teams delivering data pipelines and data governance capabilities within the organization through building and automating data flows across all Analytics and Autonomics domain.
• Both managed and independent research (POCs, white papers, studies) to stay current on the latest data tier capabilities and determining business and technical value for potential injection into the roadmap and to address any issues that can arise while tackling a business problem.
• Build, test, monitor and maintain a highly scalable data management ecosystem.
• Design and build the capability to monitor and report data quality benchmarks.
• Execute architected techniques and solutions for data profiling, collection, management and usage.
• Extreme focus on detail and data quality validation and data governance.
• Design, Build and Develop Automated Reusable Data pipelines and ETL Solutions across the different platforms.
• Ensure code is high quality through automated tests, production monitoring, reviewing creation and monitoring of alerts, and tracking defects and resolutions.
• Collaborate and align cross-functional with Data Scientists, Bi Engineer, etc. ..
• Collaborate with TechOps and Architecture to select data platform technologies that align to the business and technical needs within the constraints of the department and business unit
• Collaborate with TechOps and Architecture to design and implement highly supportable solutions that contains robust instrumentation and tracing. Implement disaster recovery, security and encryption best practices
• Establish and enforce best practice design and coding standards. Provide technical mentoring and assistance to team members and direct/lead other engineers. Provide technology operational support as new systems/platforms are rolled out
• Conduct a strong critical thinking and problem-solving skills paired with a desire to take initiative
• Bachelor's degree in computer science, Engineering or a related subject
• Experience of working on projects that span multi-disciplinary areas of differing size and complexity to meet business expectations and deliver results
• Confident and able to liaise and influence at all levels within Vodafone and/or relevant customer organizations
• Able to communicate effectively across organizational, technical and political boundaries, understanding the context
• Understands business requirements, Drives improvements and process innovation
• 4-6 Overall Years of Experience
• Excellent knowledge in UNIX/Linux administration
• Experience with SQL / Python / Data Structures and Algorithms.
• Very Good Knowledge in Cloud infrastructure Preferable GCP and AWS.
• Very Good knowledge in Big Data and Data Science technologies
• Very Good knowledge in data catalogue tools (e.g., Collibra).
• Very Good knowledge with data movement techniques and best practices to handle large volumes of data.
• Experience with data warehousing architecture and data modelling best practices.
• Hands-on experience in data modelling, data visualization, and pipeline design & development
• Experience with File Systems, server architectures, and distributed systems.
• Good knowledge with DevOps toll stack (e.g., Ansible, GitHub, Chef)