Logo

Logo

deno version
license GitHub stars GitHub issues GitHub last commit

deno land deno version

A native Deno client for Apache Kafka

Table of Contents

About the Project

KafkaSaur an Apache Kafka client for deno

Getting Started

https://deno.land/x/kafkasaur@v0.0.2/index.ts

Prerequisites

Deno - https://deno.land/manual/getting_started/installation

Apache Kafka - https://kafka.apache.org/

Docker (for examples) -https://www.docker.com/

Usage

docker-compose up
//producer example
import {Kafkasaur} from "https://deno.land/x/kafkasaur@v0.0.2/index.ts"

const kafka = new Kafkasaur({
  clientId: 'example-producer',
  brokers: ['localhost:9092']
})

const topic = 'topic-test';

const producer = kafka.producer();

const testmessage = {
  key: 'key',
  value: 'hello there',
  headers: {'correlation-id': `${Date.now()}`}
}

const messages: object[] = [];
messages.push(testmessage)

const sendMessage = () => {
  producer.send({
    topic,
    messages
  })
}

const run = async() => {
  await producer.connect();
  sendMessage();
}

run()
//consumer example
import {Kafkasaur} from "https://deno.land/x/kafkasaur@v0.0.2/index.ts"

const kafka = new Kafkasaur({
  clientId: 'example-consumer',
  brokers: ['localhost:9092']
})

const topic = 'topic-test';

const consumer = kafka.consumer({ groupId: 'test-group' })

const run = async () => {
  await consumer.connect()
  await consumer.subscribe({ topic, fromBeginning: true })
  
  await consumer.run({
    eachMessage: async (message: any) => {
      console.log(message.value.toString())
    },
  })
}

run()

Features

  • 🛠 Built with [TypeScript][Deno]

  • 🎬 Producer

  • 🍴 Consumer

  • 🤝 interactive producer with consumer

  • 💂 deno's built in security; No file, network, or environment access, unless explicitly enabled

Want to Contribute?

If you'd like to contribute and help grow the Deno community, just reach out to one of us via LinkedIn or write some code, and make a PR here! We're super excited about getting the conversation started, and working to bring Kafka to Deno!

Developers


Sam Arnold

Wesley Appleget

Adam Blackwell

Stephanie Benitez

Acknowledgements

  • Tommy Brunn - for his guidance and for trailblazing with KafkaJS
  • Ryan Dahl - for building an awesome community with Node.js and then leveling it up even further with Deno
  • Franz Kafka - for making us all remember, we could just be cockroaches.

License

This product is licensed under the MIT License - see the LICENSE.md file for details.

This is an open source product.

This product is accelerated by OS Labs.

Apache Kafka and Kafka are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries. KafkaJS has no affiliation with the Apache Software Foundation.