*Position is bonus eligible*
Prestigious Financial Institution is currently seeking a Lead Kafka Middleware Engineer with deep expertise in Kafka administration, infrastructure as code (IaC), cloud automation, container orchestration and CI/CD pipelines. The ideal candidate will be responsible for designing, implementing, and maintaining robust and scalable Middleware solutions, ensuring high availability, performance, and security. Candidate will play a crucial role in automating infrastructure provisioning, deployments, and operations, enabling our organization to rapidly deliver and scale applications.
Responsibilities:
Design, implement and manage highly available and scalable Kafka clusters. Monitor Kafka performance, troubleshoot issues and optimize configurations. Develop and maintain IaC using Ansible and Terraform for infrastructure provisioning and configuration Management. Create and maintain reusable IaC modules. Design and implement cloud-based infrastructure solutions on AWS and Azure. Automate cloud resource provisioning, scaling and management using cloud-native tools and services. Deploy and Manage containerized applications using Kubernetes and Rancher Troubleshoot container-related issues and optimize container performance. Design, implement and maintain CI/CD pipelines using tools like GitHub, Artifactory, Harness and Jenkins. Automated the build, test and deployment of Middleware components. Integrate IaC and container technologies into CI/CD pipelines. Document all processes and procedures. Work with development teams to ensure smooth deployments.
Qualifications:
Strong proficiency in IaC tools, specifically Ansible, Terraform and bash Scripting. Extensive experience with cloud automation and provisioning on AWS and Azure. Proficiency in CI/CD tools, including GitHub, Artifactory, Harness and Jenkins. Strong Scripting skills in languages like Python and Bash. Excellent troubleshooting and problem-solving skills Understanding of networking principles. Experience with monitoring tools like Splunk, Splunk OTEL, Prometheus and Grafana. Kafka, Ansible, Terraform, Bash, Kubernetes, Rancher, GitHub, Artifactory, Harness, Jenkins, AWS, Azure, CI/CD, IaC, Automated Cloud Provisioning Bachelors degree in Computer Science, Engineering or a related field (or equivalent experience) 10+ years of experience in infrastructure Middleware administration. In-depth expertise in Kafka administration, including cluster management, performance tuning, and security. AWS Solutions Architect, CKAD or CKA certifications preferred.
