At Acceldata, We are revolutionizing data observability in how enterprises manage and observe data by offering comprehensive solutions tailored to each organization's unique needs. Our platform integrates various technologies, enabling seamless data observability for modern enterprises. About the Role:As a Staff Engineer [Kubernetes Architect], you will play a pivotal role in modernizing our deployment ecosystem by containerizing our open-source stack, starting with key components from Apache Open Source such as Spark, Kafka, and NiFi. This role involves designing and implementing containerized solutions for standalone Apache components. Contributing to the innovation and optimization of internal tasks to streamline build and release cycles. Leveraging your expertise in Kubernetes to set up environments from scratch, including air-gapped installations and cloud-managed Kubernetes integrations. Applying your knowledge of legacy deployment methods, including bare metal orchestration with Ambari, to aid in the transition to containerized solutions. Understanding and managing dependencies between various Apache components to ensure smooth deployment.
You Are a Potential Match for This Role If You Have:
A history of driving modernization projects to transition legacy deployments to containerized and cloud-native solutions.
Expertise in Kubernetes ecosystem tools and technologies like Helm, Kustomize, and CI/CD integration with K8s.
Experience with air-gap installations and securing containerized environments.
Experience managing scalable, fault-tolerant storage solutions using Ceph or similar technologies.
Familiarity with Apache Open Source components and a solid understanding of their deployment and runtime requirements.
Familiarity with security best practices for Kubernetes, including RBAC, pod security policies, and secrets management.
A track record of successfully transitioning from traditional deployment methods to modern containerized solutions.
Strong problem-solving skills and the ability to collaborate with cross-functional teams to drive continuous improvement.
What we look for:
8 years of experience in developing, deploying, and operationalizing applications on Kubernetes (K8s).
Good understanding of legacy deployment approaches, including manual deployment, script based automation and standalone updates on bare-metal with or without Ambari.
Hands-on experience with Kubernetes technologies, Helm including setting up air-gapped installations and integrating with cloud-managed(e.g., GKE, EKS, AKS) Kubernetes solutions.
Solid understanding of networking concepts in containerized environments, including CNI plugins, ingress controllers, network namespaces, and multi-host networking while optimizing the latency and service meshes.
A background in optimizing and automating build and release pipelines.
Proven experience with Apache components such as Hadoop, Spark, Kafka, NiFi, and their dependencies.
A passion for innovation, process improvement, and simplifying complex tasks.
Work closely with the development teams to gather system requirements, new service proposals and large system improvements and develop the infrastructure architecture leading to stable, well-monitored fly, performant and secure systems.
