Confluent Kafka Developer / Platform Administrator

Description

• Build Kafka Connect pipelines for integrations with systems such as Oracle, Azure, Salesforce, MuleSoft, Apigee, and cloud storage.
• Support and maintain CI/CD pipelines for Kafka using GitHub Actions and Terraform.
• Contribute to Infrastructure as Code (IaC) and self-service automation tooling initiatives.
• Partner with IT Security to ensure compliance with enterprise security standards.
• Maintain audit logs and implement data retention and governance policies.
• Perform capacity planning, performance tuning, and disaster recovery setup.
• Automate provisioning and deployment of Kafka resources.
• Implement schema management and data governance using Confluent Schema Registry and Avro/JSON/Protobuf.
• Collaborate with integration teams to establish best practices for event-driven architecture.
• Manage Kafka brokers, ZooKeeper, Schema Registry, Kafka Connect, ksqlDB, Control Center, and REST Proxy.
• Design and develop Kafka topics, producers, consumers, and stream-processing applications.
• Implement and enhance monitoring, alerting, and logging for Kafka components using tools like Prometheus, Grafana, or Datadog.
• Install, configure, and manage Confluent Kafka clusters (on-premises and/or cloud environments such as Confluent Cloud or Kubernetes).
• Configure RBAC, ACLs, and encryption (TLS/SASL/OAuth) for Kafka components.
• Ensure high availability, scalability, and fault tolerance of Kafka clusters.

Requirements

• Hands-on experience in Kafka cluster administration, operations, and performance tuning.
• Prior experience in a large enterprise or consulting environment.
• Familiarity with container orchestration (Kubernetes / Docker).
• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• Experience integrating Kafka with MuleSoft, APIs, or cloud data pipelines is a plus.
• Excellent communication, problem-solving, and documentation skills.
• Experience with Git, CI/CD pipelines, and monitoring frameworks.
• Exposure to Google BigQuery or other cloud-based data services related to event streaming.
• Strong understanding of event-driven microservices and loosely coupled architectures.
• Strong knowledge of Kafka Connect, KSQL, and Schema Registry.
• 4 years of experience with Apache Kafka (2 years with Confluent Kafka preferred).
• Experience with Apache Flink, Spark Streaming, or Debezium CDC connectors.
• Confluent Certified Administrator / Developer certification.
• Proficiency with Linux, shell scripting, and automation tools.

Benefits

Training + Development

Interview process

Visa Sponsorship

Security clearance