ZIO Kafka¶

ZIO Kafka provides purely functional Kafka integration using ZIO Streams, wrapping the standard Java client with explicit error handling, composable resource management, and type-safe effect tracking.

Key Facts¶

• ZIO type signature: ZIO[R, E, A] - R = environment, E = error type, A = success type
• ZStream follows same pattern: ZStream[R, E, A]
• Functions never throw exceptions - errors returned as values, handled explicitly
• Effects are lazy: define computation first, execute on demand
• ZLayer for dependency injection - composable modules providing services
• Offset management integrated into the stream pipeline
• Backpressure built-in via ZStream operators

Patterns¶

ZIO Kafka Producer¶

val producerSettings = ProducerSettings(List("localhost:9092"))
val producer = ZLayer.scoped(Producer.make(producerSettings))

val produceEffect = Producer.produce(
  topic = "test-topic",
  key = "key",
  value = "value",
  keySerializer = Serde.string,
  valueSerializer = Serde.string
)

ZIO Kafka Consumer¶

val consumerSettings = ConsumerSettings(List("localhost:9092"))
  .withGroupId("group1")

Consumer
  .subscribeAnd(Subscription.topics("test-topic"))
  .plainStream(Serde.string, Serde.string)
  .tap(record => Console.printLine(record.value))
  .map(_.offset)
  .aggregateAsync(Consumer.offsetBatches)
  .mapZIO(_.commit)
  .runDrain

Comparison: Akka vs Spring vs ZIO¶

See Also¶

• [[alpakka-kafka]] - Akka Streams alternative
• [[spring-kafka]] - Spring Boot alternative
• [[kafka-streams]] - native Kafka stream processing
• ZIO Kafka GitHub