https://github.com/BrunoBonacci/mulog is excellent for this, the ability to add arbitrary structured data to any logging operation makes logging metrics directly from the call site super simple. I use u/trace for every important operation - the :capture-fn capability helps easily (and asynchronously) grab metrics from the output of that operation. I've gotten pretty far just dumping the edn logs to local disk and reading them back in (often with tablecloth) for any analysis I might need to do. Having a ton of empirical data on performance really helps when thinking about a potential change to a data pipeline.

If you already have a logging stack set up you can also convert to JSON and easily dump the same data to your existing monitoring system.

thanks! I'll check it out.