Kafka event

A Kafka event is specified as {datasourceName}.{topic_name}.{group_id} in the Kafka event specification.

Within the Kafka event structure, the content of the message is captured and made accessible as inputs.body, facilitating its integration into the handler workflow for processing.

Example spec for Kafka event

 # event for consume data from Topic
Kafka.publish-producer1.kafka_proj:   # event key
  id: kafka_consumer
  fn: kafka_consume
  body:    
    content:
      application/json:
        schema:
          type: object
          properties:
            message:    # the content of the message is captured here
              type: string
          required: ['message']

Example workflow consuming a Kafka event

 # function for consume data
id: kafka_consumer
summary: consumer
tasks:
  - id: set_consume
    fn: com.gs.return
    args: <% inputs.body %>

• To know about validation_error, refer this

note

• Response_validation_error, authz, authn are not applicable to this protocol since there is no response (thus no error handling for the same). Similarly, Kafka consumers don't require authentication or authorization, and hence, they are not specified here.