Decoupled Microservices Pipeline

Real-Time Event Processing Engine

Asynchronous message passing via NATS queue groups with persistent PostgreSQL state tracking and HTMX SSE live browser updates.

Gateway

HTTP + SSE Port :8080

NATS Bus

Queue Group jobs.created

Worker

Image & PDF Consumer

PostgreSQL

State Machine Row Locking

Total Ingested

Completed

In Flight

Storage Health

TTL Active

Ingestion Gateway • HTTP 202 Accepted Async Ingestion

Submit Media or Document Task

Upload a file for asynchronous background processing, thumbnailing, and metadata extraction.

Quick Demo:

2 Total SSE Connected

🖼️

ceff7a97 • image/png • 8609.2 KB • 20:50:25

Completed

Generated Artifacts (3) Ready for download

🔍

thumbnail 101.6 KB

📦

resized_medium 114.6 KB

⚡

webp_converted 902.0 KB

📄

ffbdcb64 • application/pdf • 6.5 KB • 20:53:02

Completed

Generated Artifacts (2) Ready for download

📦

extracted_text 0.1 KB

🔍

thumbnail 2.5 KB