Fork me on GitHub
#onyx
<
2016-05-04
>
drewverlee00:05:19

Still awesome. I hope i can work that into my demo.

drewverlee01:05:05

hmm running into a problem following the instructions in the engraver repo

*** System restart required ***
Last login: Wed May  4 01:36:56 2016 from 96.80.237.105
[email protected]:~$ docker exec -it kafka /bin/bash
[email protected]:~$ export JMX_PORT=10400
[email protected]:~$ bin/kafka-console-producer.sh --broker-list 127.0.0.1:9092 --topic input-stream
[2016-05-04 01:39:14,379] WARN Property topic is not valid (kafka.utils.VerifiableProperties)
{:message "Hello world"}
[2016-05-04 01:41:17,640] WARN Error while fetching metadata [{TopicMetadata for topic input-stream ->
No partition metadata for topic input-stream due to kafka.common.LeaderNotAvailableException}] for topic [input-stream]: class kafka.common.LeaderNotAvailableException  (kafka.producer.BrokerPartitionInfo)
[2016-05-04 01:41:17,660] WARN Error while fetching metadata [{TopicMetadata for topic input-stream ->
No partition metadata for topic input-stream due to kafka.common.LeaderNotAvailableException}] for topic [input-stream]: class kafka.common.LeaderNotAvailableException  (kafka.producer.BrokerPartitionInfo)
[2016-05-04 01:41:17,661] ERROR Failed to collate messages by topic, partition due to: Failed to fetch topic metadata for topic: input-stream (kafka.producer.async.DefaultEventHandler)

ckarlsen14:05:53

"The embedded server is currently the recommended approach to running BookKeeper along side Onyx. This will be re-evaluated in the beta release of Onyx 0.8.0"

ckarlsen14:05:00

what's the recommended approach here?

michaeldrogalis15:05:18

@ckarlsen: I still don't think we have enough evidence to say what's best, but I'd generally give guidance that running BookKeeper in its own process would be ideal.

michaeldrogalis15:05:24

Ill update that bit in the docs. Thanks!

michaeldrogalis15:05:04

I happen to have an Ansible playbook for installing BookKeeper in standalone mode if it helps: https://github.com/onyx-platform/engraver-bookkeeper/blob/master/tasks/main.yml

michaeldrogalis15:05:18

It launches inside a Docker container.

michaeldrogalis15:05:04

@drewverlee: It looks like the Kafka topic might not have been created yet.

drewverlee16:05:17

Is there anything special I should have done outside the instructions?

michaeldrogalis18:05:14

@drewverlee: Not to my knowledge. Sorry, I dont have time to dig into it too deeply. Let me know if you find any mistakes in there.