@shaken In the non-alpha version, I would expect the namespaces to lose their .alpha suffix and therefore path/to/something/alpha.clj will be moved to path/to/something.clj

yes

In the spec-alpha2 repo, just FYI, the namespaces are clojure.spec-alpha2, clojure.spec-alpha2.test, clojure.spec-alpha2.gen and the files have _alpha2 in them. So the _structure_ there is closer to the post-alpha version (and the -alpha2 portion of the namespaces would be deleted, and the _alpha2 portion of the filenames would be removed).

@seancorfield For example, the main file would be “spec/src/main/clojure/clojure/spec.clj” and the subordinate items “spec/src/main/clojure/clojure/test/spec.clj” and “spec/src/main/clojure/clojure/gen/spec.clj” ?

@seancorfield Thank you for the alpha2 reference. I will look there, as well. I appreciate the responses!

Yes, but as @hiredman said, the spec/src/main/clojure part is just the root of the source files for classpath purposes. The path of the files (relative to that) are the pieces that map to namespaces.

In most Clojure projects, the root of the source files will just be <repo>/src (and the tests will be in <repo>/test -- whereas in Contrib libraries, they follow a more Maven-y style of layout and use <repo>/src/test/clojure for the tests).

Yes, @hiredman’s statements about class path made sense! I was trying to get a sense of the structure right at the end of the path, which your comments have clarified. My real conundrum is about partitioning my application into namespaces and how to fit this with namespaced keywords. I am used to applications composed of lots of small files (less than 200 lines) and the added wrinkle of namespaced keywords makes knitting together a Clojure application… interesting. Happily, I think I am getting it worked out. The namespaces and namespaced keywords of an application make up a directed acyclic graph, and like any dependency structure take a little thought to be neat and concise.

keyword namespaces don't have to have any relationship to file namespaces / file paths

@noisesmith If you use an unqualified double-colon, you get the local namespace (filename related) and the double-colon as-name-slash format uses the required name, which is derived from the required namespace (again, filename related). (I do see there is also an arbitrary form for namespace-qualifying your keywords. Perhaps they all arbitrary and the above relationships are by-convention.) Perhaps due to my inexperience with the language, it seems that keeping namespaced keyword and namespaces (file-structure) aligned will make the program easier to understand. Please help me understand if my intuition is not a good approach .

sure - those reader shortcuts exist, but they aren't based on file paths, they are based on aliases

but the real point is that you don't need to use those shorthands, and you don't need to restructure things just so those shortcuts are available

@shaken Also, you can create aliases (and namespaces) on the fly to use with qualified keywords -- that have nothing to do with files.

(alias 'm  (create-ns 'ws.domain.member))

So then you can use ::m/foo and it expands to :ws.domain.member/foo -- and you do not need ws/domain/member.clj to exist.

We also use qualified keywords where the "namespace" part of it does not correspond to any namespace or alias, e.g., :wsbilling/member-id

Cool! I guess this all falls out of keywords being constructs that resolve to their hash, so you don’t need to obtain the namespaced keyword from another file in the way you would pull in an enumerated value in a more C-like language (which is, I admit, my frame of reference). Thanks again, everyone!

to nitpick, keywords don't resolve to their hash - they are cached so that equality checking is cheap, but they resolve to themselves

they may cache their hash value as an optimization though(?) since they are so often used as keys

Is anyone up to helping me figure out zippers? I've got an XML parsing problem

Specifically, I'm looking at some output from JUnit

The cases I care about are:

Successes: They look like <testcase classname="App landing page" name="has the necessary components" time="13.706" /> i.e., they have no content

Failures: They look like

<testcase classname="App landing page" name="can fail a test" time="10.822">
   <failure type="exception" message="Failed: This fails deliberately"><![CDATA[Error: Failed: This fails deliberately...(more)...
   </failure>
</testcase>

And skipped: they look pretty much like failures

<testcase classname="App landing page" name="it can skip a test" time="0.002">
   <skipped message="Temporarily disabled with xit" />
  </testcase>

That's kind of it --- I would like to count the number of successful, failing, and skipped tests, and get data out of them

I'm not convinced a zipper would help here - you don't need to edit it and the structure is very predictable and shallow

why not xml-seq and group-by ?

I do love group-by, I don't know the former --- I will read up

in fact, you might just want clojure.xml/parse instead of xml-seq

I do recommend zippers in general, I just don't think they are the optimal tool for this specific task

you might be right..... I have been worried that the xml might be heavily nested

but it might be much flatter than i expected

if heavily nested comes up, xml-seq would help, if not xml/parse is simpler

if you needed to make a new xml output by restructuring a complex tree, that's where a zipper would shine

got it

if you ever tried to do complex tree restructures with immutable data, and you came up with something that was general and actually worked, you were probably 80% of the way to implementing a zipper :D

:thinking_face: I have to pre-parse my data somehow.

1. Unhandled java.net.MalformedURLException
   no protocol: <?xml version="1.0" encoding="UTF-8" ?> <testsuites disabled="0" errors="0" failures="2" tests="7"...

that's from chucking a raw string at xml/parse

"file, input stream, or string naming a URI"

i need to use.... thinks of computer word... bytes?

oh it'll take the file? that'll do

if you find you need to use a string, (java.io.ByteArrayInputStream (.getBytes s)) does do the trick (fixed)

aaaaaa this is so much easier than what i was trying before

🙏:skin-tone-2:

glad I could help

👋:skin-tone-2: at @me1238 -- welcome to the Slack!

(I think we met at ClojureBridge some time back?)

Is it possible to get nREPL to print the port it's listening on? I have to have a few open at once and sometimes the port gets lost in the scrollback

hi there everyone!

firstly, is this the right place to talk about Datomic?

I'm not quite sure....

@aaguirre, welcome! There is an active #datomic channel.

oh, thx for the welcome @kodnin 😎😎

I'll tell you my story: we are working on a project were Datomic is being used. We want to analyze de data using ML alorightms (we are data analyst). The thing is we don't event know where to start from!! Could someone point me in any direction?

alright, I'm back with another one

and I think the answer might blow my non-functional mind a little

what's the idiomatic way to perform a loop within a loop?

I guess using the word loop is a bit of a misnomer

I mean, I've been working on replacing my inner logic of for each with map (usually)

I think we've got one loop in our entire codebase (with a recur). Everything else is map/`reduce` etc

I guess I should say what data I'm working with

well I haven't used for or loop yet

and I still haven't used reduce and I'm not sure if that's because I don't fully understand it or if I just haven't needed to

could you provide the input and output?

mostly nested imperative loops can be solved using a list comprehension

I think I've actually got past that point of nested loops, but I'd forgotten, haha

I'm not at the point where I have 2 vectors, both with the same amount of items

I want to iterate over the first and also access the same element in the second

https://clojuredocs.org/clojure.core/interleave ?

Maybe I should zip them together into a vector/hash-map so I can iterate over each matching index

Or https://clojuredocs.org/clojure.core/zipmap ?

oh

I wrote a function to do that haha

that's the hardest part - finding the name of the existing function, haha

I was looking for zip coming from Python but the results weren't what I wanted

map does that too, it can take multiple lists and work like this:

(map vector '(1 2 3) '(4 5 6))
=> ([1 4] [2 5] [3 6])

I mean, map can also be given multiple collections

Damn, @rahul080327 beat me to it 😉

😅

Didn't know that

https://clojuredocs.org/clojure.core/map

I had (apply map vector columns)

because it was a vector of vectors

I basically spend most of my time on clojuredocs it seems 😉

not sure how complete it is, but on the topic of finding core clojure functions check out https://re-find.it/

So, is there no way to emulate how a traditional for each would work?

even my first test didn't find the function I was expecting, but it does give you a whole wack of functions that are pretty close! I input "abc" and made the result '(\a \b \c), hoping to have clojure.core/seq returned to me

Or do I just need to get that out of my mind and manipulate the data to a start where I don't need that?

As in, the scoping

Generally, I've been find with map, anonymous functions or partial/comp

but the whole for x in y: providing its own scope and allowing multiple statements is easy, but perhaps not idiomatic

you can use https://clojuredocs.org/clojure.core/doseq closest thing to foreach i guess

Like, could I map with do

oh, I see

re doseq

but it doesn't return and I feel like it's not the 'right' way

use for if you want it to return something

(for [x (range 5)]
  (inc x))
=> (1 2 3 4 5)

For me, the way that works is if the code inside returns something use map otherwise use doseq or run!

I'm not following what a foreach does that you can't do with the core functions anyway

How can i update-in a :key within a specific map located in a vector of maps?

(using swap!)

previously solved this using map-indexed to get a indexed list of maps...

or keep-indexed

are there alternatives?

@sova (update-in [{:key 0} {:key 1} {:key 2}] [1 :key] inc) returns [{:key 0} {:key 2} {:key 2}]

The docstring for update-in reads

'Updates' a value in a nested associative structure

thank you. how would i figure out that [1 :key] 1 position?

I don't follow. Can you expand on your problem?

(swap! tv-state update-in [second-hit :comments] concat (:id new-comment-map)) is not doing the trick. second-hit is a search on matching ID and is an integer keeping note of position. maybe the error is different

And is (:id new-comment-map) a sequence of comments?

specifically it is one map

i found my error, it is from an earlier reset! of the atom.

it changes the atom from a vector of maps to a list(?)

how can i conj more maps onto a vector of maps?

(let [more-maps [{:a 1} {:a 2}]] (concat [{:a 0} {:a 3}] more-maps)) gives you ({:a 0} {:a 3} {:a 1} {:a 2})

Thank you

I’d also consider just using into for this one.

(let [more-maps [{:a 1} {:a 2}]]
  (into [{:a 0} {:a 3}] more-maps))

That leads to a simple (swap! my-atom into some-coll) pattern

What is an idiomatic way to configure my clojure application? Is there any "standard"? I want to be able to swap config files with db addresses, usernames and passwords to change the behavior of the application

How can I track down where my spec error is coming from? Including a new dependency so I know it's one of it's dependencies, but spec doesn't seem to tell me which one...

Caused by: clojure.lang.ExceptionInfo: Call to clojure.core/ns did not conform to spec. {:clojure.spec.alpha/problems ({:path [:clauses :refer-clojure :clause], :pred #{:refer-clojure}, :val import, :via [:clojure.core.specs.alpha/ns-refer-clojure :clojure.core.specs.alpha/ns-refer-clojure], :in [2 0]} {:path [:clauses :require :clause], :pred #{:require}, :val import, :via [:clojure.core.specs.alpha/ns-require :clojure.core.specs.alpha/ns-require], :in [2 0]} {:path [:clauses :import :clause], :pred #{:import}, :val import, :via [:clojure.core.specs.alpha/ns-import :clojure.core.specs.alpha/ns-import], :in [2 0]} {:path [:clauses :use :clause], :pred #{:use}, :val import, :via [:clojure.core.specs.alpha/ns-use :clojure.core.specs.alpha/ns-use], :in [2 0]} {:path [:clauses :refer :clause], :pred #{:refer}, :val import, :via [:clojure.core.specs.alpha/ns-refer :clojure.core.specs.alpha/ns-refer], :in [2 0]} {:path [:clauses :load :clause], :pred #{:load}, :val import, :via [:clojure.core.specs.alpha/ns-load :clojure.core.specs.alpha/ns-load], :in [2 0]} {:path [:clauses :gen-class :clause], :pred #{:gen-class}, :val import, :via [:clojure.core.specs.alpha/ns-gen-class :clojure.core.specs.alpha/ns-gen-class], :in [2 0]}), :clojure.spec.alpha/spec #object[clojure.spec.alpha$regex_spec_impl$reify__2509 0x48b22fd4 "[email protected]"], :clojure.spec.alpha/value (clojure.tools.namespace.find (:require [ :as io] [clojure.set :as set] [clojure.tools.namespace.file :as file] [clojure.tools.namespace.parse :as parse]) (import ( File FileReader BufferedReader PushbackReader InputStreamReader) (java.util.jar JarFile JarEntry))), :clojure.spec.alpha/args (clojure.tools.namespace.find (:require [ :as io] [clojure.set :as set] [clojure.tools.namespace.file :as file] [clojure.tools.namespace.parse :as parse]) (import ( File FileReader BufferedReader PushbackReader InputStreamReader) (java.util.jar JarFile JarEntry)))}

the namespace with the problem is clojure.tools.namespace.find

I believe that’s something that was fixed long ago

yeah, I'm pretty sure updating one of my dependency's dependency will fix the issue, but wanted to pinpoint which one

the actual problem is the use of import instead of :import in the ns decl

yeah, not the first time I encounter the error myself. The issue is finding where this is. Are you saying it's just related with the clojure core version?

no, the error is in the org.clojure/tools.namespace dependency

[digitalocean "1.2"]
   [cheshire "5.3.1"]
     [com.fasterxml.jackson.core/jackson-core "2.3.1"]
     [com.fasterxml.jackson.dataformat/jackson-dataformat-smile "2.3.1"]
     [tigris "0.1.1"]
   [http-kit "2.1.18"]
   [midje "1.6.0"]
     [bultitude "0.2.2"]
       [org.tcrawley/dynapath "0.2.3"]
     [colorize "0.1.1" :exclusions [[org.clojure/clojure]]]
     [gui-diff "0.5.0"]
       [org.clojars.trptcolin/sjacket "0.1.3" :exclusions [[org.clojure/clojure]]]
         [net.cgrand/parsley "0.9.1"]
         [net.cgrand/regex "1.1.0"]
     [ordered "1.2.0" :exclusions [[org.clojure/clojure]]]
     [org.clojure/core.unify "0.5.2" :exclusions [[org.clojure/clojure]]]
     [org.clojure/math.combinatorics "0.0.1"]
     [org.clojure/tools.namespace "0.2.2"]
     [slingshot "0.10.3"]
     [swiss-arrows "0.1.0"]
     [utilize "0.2.3" :exclusions [[org.clojure/clojure]]]
   [prismatic/schema "0.2.0"]
     [potemkin "0.3.2"]

yep - just include the most recent version in your list of dependencies - that will override it

that digitalocean library looks like it is including a lot of test dependencies 😕

@alexmiller sweet, that did the trick 🙂 Thanks a lot

@hiredman indeed, and in the end only a small part of the lib is actually tested...

I would atleast exclude midje there

that would also probably be sufficient (unless you’re using midje)

ah, did not know about the exclude feature, that's very handy

fwiw, the error message here should be much better on Clojure 1.10

strange, I'm on 1.10.0 already

also depends a bit on where you’re seeing (if you’re in an editor or using a build tool, etc)

error showed when doing lein ring server-headless

so in terminal

huh, yeah I can repro that with a minimal ring server app

although the very first line of the error is:

Exception in thread "main" Syntax error macroexpanding clojure.core/ns at (clojure/tools/namespace/find.clj:9:1).

there are some things in that output that surprise me though, so maybe I’ll turn this into a ticket or two if I can figure out the cause

perhaps the most surprising is that it is loading this namespace when no code is using it, just merely by adding it as a dep

isn't the idea of the lein-ring tool to do a kind of DI to create a local webserver as a convenience for apps that would deploy to a container? If I'm remembering this correctly,, I could imagine it doing spooky startup magic

oh, there’s definitely some spookiness

server-headless runs the server locally, and uses tools.namespace to reload changed code

ah, I was wondering if it was specific to the fact that this is specifically tools.namespace

What’s the best way to handle reading a file line-by-line, then writing back to the same file line-by-line without having to store the entire contents in memory?

use a RandomAccessFile?

write to a second file and move it when done?

my concern with RandomAccessFile is that if your unit of work is a "line" this is a bad match for a datatype of bytes in terms of random access usage

eg. if you increase the length of a line, I'd fear that would overwrite the next line

The line length will change between each line.

yeah, I think you could do that with RandomAccessFile but it seems text-editor-complete as a task

your editor will be in overwrite mode rather than insert mode

Thanks for the help. Moving a file within clojure\java is something I’ll need to look up how to do but on the other hand, maybe storing a line-seq list in memory is the best solution for my use-case? If I’m writing to one file then moving it to replace another file then I’m doing at least 2x more IO operations?

on the OS level the move is just reassigning a pointer

Your doing the same number of reads and writes, just to two files and temporarily using more inodes (the inodes for the input file are freed when you move the new file)

Ah I found the renameTo method of java.io.File

sounds like the ticket to me

Agreed…err convinced rather. Thanks for explaining that, OS level ops is definitely not an area I’m familiar with.

caveat - this assumes a sane file system implementation, and both files being created on the same fs

Ah, yes, the use case fits that criteria.

Oh and found java.io.FIle/createTempFile from https://github.com/clojure-cookbook/clojure-cookbook/blob/master/04_local-io/4-10_using-temp-files.asciidoc great!

a gotcha there is that sometimes the default tmp directory is not on the same file-system as regular files, which might be OK if you don't mind the extra copying when you move the file

Good to know. I think for the use case, renaming remotes in any .git/config files found in a directory, potentially contaminating a project dir or .git folder is a worse side effect than extra copying if the tmp directory is not on the same file-system

(defn update-remotes
  "Reads a .git/config file and writes updated config to temp file."
  [{:keys [src dest] :as update}]
  (let [count (atom 0)]
    (with-open [r (io/reader src)
                w (io/writer dest)]
      (doseq [line (line-seq r)]
        (.write w (replace-remote update line))
        (swap! count inc)))
    (assoc update :count @count)))

perhaps (reduce (fn [n line] (.write w (replace-remote update line)) (inc n)) 0 (line-seq r)) (fixed)

@jayzawrotny not sure what your use case is, but you can also use jgit lib to read/write git config from java code

That’s a great recommendation but it may be a bit much for my use case, plus an excellent learning opportunity.

Thanks for the help. Here’s the culmination of the combined efforts: https://github.com/eccentric-j/rename-git-remotes/blob/master/src/rename_git_remotes/cli.clj

anyone know how to translate this Java into Clojure? new Compute.Builder

the class is Compute.Builder

(Compute$Builder.)

rip

thanks

inner classes are really just classes with $ in the name on the bytecode level

if you need to import, Compute$Builder is the class name, importing Compute doesn't bring it into scope, amazingly enough

oh then woops

@haywood what's going on is literally that the java compiler generates a new class called Foo$Bar if Foo defines a class called Bar inside it, with all that implies

hmm, that seems like good info for the official interop page

there's a lot of weird gotchas with the JVM, it's hard to know where the part to document for Clojure ends and the JVM trivia starts sometimes

yea good point

well I really appreciate the explanation, makes sense now

inner-classes are a bit of a hack in JVM bytecode :’)

almost as good as generics (those are easiest to deal with - they simply don't exist in any way that matters for clojure)

wasn’t it something like that a inner class can capture private variables from its outer class, and that generates all sorts of accessors in the outer class? I think I went down the “oh how are inner classes implemented in java bytecode”-rabbithole before