Key Responsibilities:

Developer Responsibilities:

1. Design, develop, and deploy Kafka producers and consumers

2. Implement Kafka Streams and Kafka Connect applications

3. Integrate Kafka with other data systems (e.g., Hadoop, Spark)

4. Ensure high availability, scalability, and performance of Kafka clusters

5. Collaborate with cross-functional teams to identify business requirements

Admin Responsibilities:

1. Install, configure, and manage Kafka brokers and clusters

2. Monitor Kafka performance metrics and logs

3. Troubleshoot Kafka issues and optimize cluster performance

4. Implement Kafka security measures (e.g., SSL/TLS, ACLs)

5. Ensure data integrity and backup/recovery processes

Skills

echnical Skills:

1. 3+ years of experience with Apache Kafka

2. Proficiency in Java or Scala programming languages

3. Experience with Kafka ecosystem tools (Kafka Streams, Kafka Connect)

4. Familiarity with data processing frameworks (Hadoop, Spark)

5. Understanding of distributed systems and messaging protocols

Certifications:

1. Certified Kafka Developer (CKD)

2. Certified Kafka Administrator (CKA)

Nice to Have:

1. Experience with cloud-based Kafka solutions (Confluent Cloud)

2. Knowledge of containerization (Docker)

3. Familiarity with agile development methodologies

4. Experience with monitoring tools (Prometheus, Grafana)

Education:

1. Bachelor's degree in Computer Science, Information Technology, or related field