Concurrent and multi-stage data ingestion and data processing with Elixir
-
Updated
Jul 30, 2024 - Elixir
Concurrent and multi-stage data ingestion and data processing with Elixir
Elixir queue! A simple, in-memory queue with worker pooling and rate limiting in Elixir.
A simple Elixir library for writing decently-performing crawlers with minimum effort.
A blazing fast job processing system backed by GenStage & Redis.
📮 Robust job queue powered by GenStage and Redis
🐘 Postgres event store for event_bus
Elasticsearch Elixir Bulk Processor is a configurable manager for efficiently inserting data into Elasticsearch. This processor uses GenStages (data-exchange steps) for handling backpressure, and various settings to control the bulk payloads being uploaded to Elasticsearch.
GenStage producers for EventStoreDB 20+ with Spear
Galena is a topic producer-consumer library built on top of GenStage for Elixir.
Add a description, image, and links to the genstage topic page so that developers can more easily learn about it.
To associate your repository with the genstage topic, visit your repo's landing page and select "manage topics."