We are using promtail to ingest the logs and its a pain to decompress them with promtail. The only option we have is to write a script that decompresses them and puts them in another directory, at which point we might as well just have them written in plain text to begin with. Can we have kumo just write the logs in text format?
Hey there @nice-vole, thanks for posting. Please read the “Troubleshooting” and “How to Ask for Help” buttons below. If you would like a 1:1 support session from the KumoMTA team, details are at the “Book a Support Session” button below.
We intentionally require compression to reduce the IO pressure on the system. Can you use the log hooks to transport the data into the ultimate destination? Publishing Log Events Via Webhooks - KumoMTA Docs
Sounds like you can send json packets in via Loki HTTP API | Grafana Loki documentation
Would webhooks put any backpressure on kumo shoudl our log endpoint be choked up? Would it be safer to just write the compressed files to another dir in plain text and have promtail pick them up from there? That way kumo doesn’t spend any effort on the backlog of logs if there is an issue
they’re queued and subject to shaping rules as well, so you can tune it to work with your endpoint