Fork me on GitHub
#flambo
<
2016-05-25
>
stephenmhopper12:05:45

@sorenmacbeth: You mentioned setting up an nrepl server on the cluster and connecting to it remotely. Is there a way to do this on a standard edge node without having to install anything on the system? If so, what files do I need to copy over to the edge node?

sorenmacbeth14:05:29

@stephenmhopper: what do you mean edge node? I add the code to start an nrepl server on a port into my flambo application uberjar, and then call that function via spark-submit on the cluster

sorenmacbeth14:05:45

I then connect to that host and port with the nrepl client in emacs

stephenmhopper14:05:32

@sorenmacbeth: oh. So I’m still building and deploying my app as an uberjar, I’m just binding the nrepl server to a port

stephenmhopper14:05:50

Do you have a code snippet or blog post that I could use as a reference for this?

stephenmhopper14:05:22

Also, would it be possible to just do this via SSH tunneling? The sys ops guys get nervous and start asking questions if I just open ports on their machines

sorenmacbeth14:05:20

sure you can ssh tunnel to it

stephenmhopper15:05:34

@sorenmacbeth: This is a n00b question, but I’m using cursive instead of cider and emacs. Can I still use the cider library to get my output to print out both on my local machine and in my terminal session?

stephenmhopper16:05:09

@sorenmacbeth: I think I have this mostly figured out, but I have a couple lingering questions:

stephenmhopper16:05:37

1. When you connect via nrepl, are you starting your uberjar using spark-submit, or java -jar?

stephenmhopper17:05:09

nvmd, everything is working

stephenmhopper17:05:22

@sorenmacbeth this is pretty cool. Thank you so much for your work on this project.

sorenmacbeth19:05:47

@stephenmhopper: great! glad you got it working

jrotenberg19:05:50

that moment when your long ass stream of interop calls works the first time

jrotenberg19:05:12

i should probably go buy a lottery ticket right now

jrotenberg19:05:10

and just quit while i’m ahead

jrotenberg19:05:17

and open a sandwich shop or something