Hi, is my assumption correct, on the client consumer (i'm just creating a process that simply consumes from a kafka topic, not streaming it to another topic), in client.log/log if I pass in a function for fuse-fn then once that function returns fails, the consumer will stop?

Yep. If the fuse-fn is provided, as soon as it returns false, the fuse is blown.

Cool. Would there be an example of usage? I'm just wondering how to do this, so that (from a separate namespace) I can update the fuse

<shrug>

Maybe use a promise or something? e.g. this isn't in a separate namespace but I assume what you mean is that you want to blow the fuse independently of processing the records....

(let [p (promise)
       records (jdc/log consumer 2000 (fn [_]
                                                                 (not (realized? p)))]
   (future
      (doseq [r records]
         (process r)))

   (Thread/sleep 10000)
   (deliver p :done))

That's very helpful 🙂

I was also thinking of having a go channel, and simply return true until a false gets shoved in 🙂

not sure if that would work, but I'll have a play!

very helpful! 🙂

The test-machine includes some lower-level code that polls in a separate thread so that test result data can be collected into a journal independently of the main thread which checks what has been collected once the test is considered complete. It uses manifold but a prior version used core.async so both approaches can be made to work. https://github.com/FundingCircle/jackdaw/blob/master/src/jackdaw/test/transports/kafka.clj#L91

kewl

@cddr Thanks for merging my PR earlier. As far as getting the code released is concerned, it's presumably a case of waiting for the next release cycle, right? I can see on clojars that the pattern seems to be that PRs automatically get deployed as snapshot releases to clojars but mine didn't because I'm not an FC employee (and hence don't have access to deploy snapshots).

Ah yeah we should probably configure it to publish snapshots for all merged PRs. I thought it would do that but I just checked and it doesn't seem to have done it. I was going to publish a release this evening anyway. There's a few things worth getting out there (yours not least among them). But we'll have to think about ideas to make it easier for contributors to publish a jar with their changes. Might have a chat over in #clojars and see if there's any existing solutions for this type of thing.

@cddr It appears to be working and doing what I needed