Software Engineer (Kafka)

XCELLINK PTE. LTD.

  • Administer enterprise Kafka clusters in Production and UAT.
  • Configure broker-level and topic-level settings (retention, replication, partitions, cleanup policies).
  • Onboard new applications onto Kafka platform following governance standards.
  • Implement SSL/TLS encryption and ACL-based authorization.
  • Automate Kafka deployments using Ansible and CI/CD pipelines (Git, Jenkins, Bitbucket).
  • Perform rolling upgrades, patching, and version migrations with minimal downtime.
  • Executed Disaster Recovery (DR) flip activity to switch Kafka cluster from Active to Passive environment during maintenance and failover testing.
  • Monitor cluster health using Prometheus, Grafana, and Confluent Control Center.
  • Configure alerting for CPU, memory, log size, ISR shrink, and broker health.
  • Optimize cluster performance and ensure high availability.
  • Raise and execute Change Requests (CRs) as per release process.
  • Provide L2/L3 production support and perform RCA.
  • Providing guidance to application teams on best practices for Kafka integration.
  • Participate in DR flip and failover testing.
  • Support Kafka Connect, Schema Registry, and REST Proxy.