Still awesome. I hope i can work that into my demo.

hmm running into a problem following the instructions in the engraver repo

*** System restart required ***
Last login: Wed May  4 01:36:56 2016 from 96.80.237.105
ubuntu@ip-172-0-1-252:~$ docker exec -it kafka /bin/bash
kafka@ip-172-0-1-252:~$ export JMX_PORT=10400
kafka@ip-172-0-1-252:~$ bin/kafka-console-producer.sh --broker-list 127.0.0.1:9092 --topic input-stream
[2016-05-04 01:39:14,379] WARN Property topic is not valid (kafka.utils.VerifiableProperties)
{:message "Hello world"}
[2016-05-04 01:41:17,640] WARN Error while fetching metadata [{TopicMetadata for topic input-stream ->
No partition metadata for topic input-stream due to kafka.common.LeaderNotAvailableException}] for topic [input-stream]: class kafka.common.LeaderNotAvailableException  (kafka.producer.BrokerPartitionInfo)
[2016-05-04 01:41:17,660] WARN Error while fetching metadata [{TopicMetadata for topic input-stream ->
No partition metadata for topic input-stream due to kafka.common.LeaderNotAvailableException}] for topic [input-stream]: class kafka.common.LeaderNotAvailableException  (kafka.producer.BrokerPartitionInfo)
[2016-05-04 01:41:17,661] ERROR Failed to collate messages by topic, partition due to: Failed to fetch topic metadata for topic: input-stream (kafka.producer.async.DefaultEventHandler)

"The embedded server is currently the recommended approach to running BookKeeper along side Onyx. This will be re-evaluated in the beta release of Onyx 0.8.0"

what's the recommended approach here?

@ckarlsen: I still don't think we have enough evidence to say what's best, but I'd generally give guidance that running BookKeeper in its own process would be ideal.

Ill update that bit in the docs. Thanks!

I happen to have an Ansible playbook for installing BookKeeper in standalone mode if it helps: https://github.com/onyx-platform/engraver-bookkeeper/blob/master/tasks/main.yml

It launches inside a Docker container.

@drewverlee: It looks like the Kafka topic might not have been created yet.

Is there anything special I should have done outside the instructions?

@drewverlee: Not to my knowledge. Sorry, I dont have time to dig into it too deeply. Let me know if you find any mistakes in there.

np.