I'm trying to figure out how you're getting that error. Are you printing the hiccup out and trying to read it back in?

Ah! I should have mentioned that. I’m evaluating a form with Cider whose sole purpose is to return a hiccup form. so…

(defn datatable []
;; a bunch of Hiccup here
)

Can you fix the html->hiccup converter or are you stuck with some hiccup from somewhere?

That would be a good thing to do… I use http://html2hiccup.buttercloud.com and maybe I’ll need to build my own tool at some point. But I’m guessing the problems will be hard to eliminate, as I drop arbitrary HTML I find on the web (for shame!) into it and the input is probably janky at times.

When I get that error, there's a :line and :column number that shows up in the exception's :via

{:type clojure.lang.LispReader$ReaderException
   :message java.lang.RuntimeException: Map literal must contain an even number of forms
   :data #:clojure.error{:line 417, :column 38}
   :at [clojure.lang.LispReader read LispReader.java 314]} 

My guess is that it's producing a keyword or symbol with a space in it (probably a keyword).

omg. did I not read the error message carefully? stand by.

the first issue on that github repo might also be the cause, https://github.com/buttercloud/html2hiccup/issues/1

I might try just try a different converter, maybe https://github.com/green-coder/html-to-hiccup

I’ll try the other converter. You made me realize that I need to look at the converter itself. And reminded me that I should look for Github issues on the tools I use. My error output doesn’t show the line number, I don’t think… just

Show: Project-Only All
  Hide: Clojure Java REPL Tooling Duplicates  (9 frames hidden)

3. Unhandled clojure.lang.ExceptionInfo

2. Caused by clojure.lang.LispReader$ReaderException

1. Caused by java.lang.RuntimeException
   Map literal must contain an even number of forms

                 Util.java:  221  clojure.lang.Util/runtimeException
           LispReader.java: 1357  clojure.lang.LispReader$MapReader/invoke
           LispReader.java:  285  clojure.lang.LispReader/read
           LispReader.java: 1398  clojure.lang.LispReader/readDelimitedList
           LispReader.java: 1347  clojure.lang.LispReader$VectorReader/invoke
           LispReader.java:  285  clojure.lang.LispReader/read
           LispReader.java: 1398  clojure.lang.LispReader/readDelimitedList
           LispReader.java: 1347  clojure.lang.LispReader$VectorReader/invoke
           LispReader.java:  285  clojure.lang.LispReader/read
           LispReader.java: 1398  clojure.lang.LispReader/readDelimitedList
           LispReader.java: 1347  clojure.lang.LispReader$VectorReader/invoke
           LispReader.java:  285  clojure.lang.LispReader/read
           LispReader.java: 1398  clojure.lang.LispReader/readDelimitedList
           LispReader.java: 1347  clojure.lang.LispReader$VectorReader/invoke
           LispReader.java:  285  clojure.lang.LispReader/read
           LispReader.java: 1398  clojure.lang.LispReader/readDelimitedList
           LispReader.java: 1347  clojure.lang.LispReader$VectorReader/invoke
           LispReader.java:  285  clojure.lang.LispReader/read
           LispReader.java: 1398  clojure.lang.LispReader/readDelimitedList
           LispReader.java: 1347  clojure.lang.LispReader$VectorReader/invoke
           LispReader.java:  285  clojure.lang.LispReader/read
           LispReader.java: 1398  clojure.lang.LispReader/readDelimitedList
           LispReader.java: 1347  clojure.lang.LispReader$VectorReader/invoke
           LispReader.java:  285  clojure.lang.LispReader/read
           LispReader.java: 1398  clojure.lang.LispReader/readDelimitedLis

what do you see if you print (:via (Throwable->map *e))

Well, I’ll be darned.

[{:type clojure.lang.ExceptionInfo,
  :data #:clojure.error{:phase :read-source},
  :at
  [clojure.main$repl$read_eval_print__9206$fn__9207
   invoke
   "main.clj"
   433]}
 {:type clojure.lang.LispReader$ReaderException,
  :message
  "java.lang.RuntimeException: Map literal must contain an even number of forms",
  :data #:clojure.error{:line 14, :column 36},
  :at [clojure.lang.LispReader read "LispReader.java" 314]}
 {:type java.lang.RuntimeException,
  :message "Map literal must contain an even number of forms",
  :at [clojure.lang.Util runtimeException "Util.java" 221]}]

Now that is something good to know about.

👍

:star-struck: Now I can roast marshmallows under the glowing stars instead of hunting through maps all night long.

CIDER can be less than helpful when dealing with errors 😕

I turned off cider's stacktrace popup thing

I just (pprint *e) when I need to look at the stack trace 🤷

The fact that (:via (Throwable->map *e))did so much suggests that Cider errors could, too… maybe there’s something that can be tweaked for this.

I like Portal for this sort of thing, since it's good at displaying data and doesn't try to be "clever" about printing things 🙂

yea, Exceptions contain lots of useful information, but it's not fully utilized by all the available tools yet (I'm not complaining. I'm very grateful for tools like cider).

Too late. I already reported you to the cider people.

Better find another career.

I absolutely need to get going with Portal as I’m dealing with huge web data structures now and wading into working with db’s.

I go back and forth on using CIDER vs plain nREPL with VS Code, mainly because CIDER messes up stacktraces...

...but since I stopped even looking at the REPL window and started using Portal instead, I no longer care what CIDER does to stacktraces 😛 🙂

Do you use Portal in a browser?

Portal for VS Code uses a native panel in VS Code which is nicer.

(I switched away from Emacs because I wanted a better integrated UI)

I now have VS Code open so that I can do certain things in it and copy the result into Emacs. Emacs is getting suspicious and wants to know where I’ve been when I do that. It’s a bad sign for me and Emacs.

Portal installed! Standalone version via Chrome WPA. That alone was a rather mind opening experience. https://github.com/djblue/portal/blob/master/doc/guides/standalone.md

What I like about Portal integrated into VS Code is that I can control Portal navigation and viewing via hot keys without even changing focus to the Portal window.

Between Joyride and Calva REPL snippets, it's a very scriptable environment.

Slinking around, whispering this into my ear… on the eve of my 92nd anniversary with Emacs. Looking up Joyride now.

Hey, I used Emacs on and off since the 17.x days!

We made & use https://urbandictionary.github.io/html2hiccup/ which parses with hickory and does some transforms & simplifications

Also checkout https://html2hiccup.dev/ which is pretty neat

The bang makes it look like input! mutates something, doesn't it? Could mitigate that someone by naming it get-input!, but some people tell me to skip that get for getters, and there is still that sense of it mutating something, anyway...

Any reason for the getters and setters? Would it make sense to just use swap! and @ from call-sites?

It woudln't. 😃 For set-day! quite a few things happen. For this particular getter it could work, but I want this to work for a beginner of Clojure, and not be introducing deref and things.

I'm getting there... 😃

So, the template would look something like so:

(ns aoc2022-1
  (:require [util-aoc :as aoc]))

;; Start by loading `util_aoc.cljs` in the REPL
;; (ctrl+alt+c enter)
;; Then load this file the same way.
;; Then evaluate the top level forms in the
;; Rich comment form `(comment ...)` below

(comment
  (aoc/set-day! 1)
  
  ;; See `util_aoc.cljs` for caveats re this `def`
  (def real-input (aoc/fetched-input))

  (def test-input [1000
                   2000
                   3000
                   nil
                   4000
                   nil
                   5000
                   6000
                   nil
                   7000
                   8000
                   9000
                   nil
                   10000])

  (defn part-1 [input]
    ;; Your solution here
    )
  ...
  (aoc/update-attempt! (part-1 test-input))
  ...
  :rcf)

One thing I'd maybe question here is for input and other getters they should be passed the data they're getting stuff from, so maybe just raise the deref to the calling code if it's not too much trouble? That would make obvious where it's being dereferenced, plus allow you to reduce race conditions by allowing you to do a single deref and use the data for multiple things.

The only thing I can see from the browser that might cause this is that the crsf field is sent twice

I have the token in a var named crsf and tried passing it like this:

:form-params {:__csrf_magic [csrf csrf] .....}

Are you sure that what the browser is showing you is form encoded?

I would check the content type header

Are these supposed to be form fields or headers? Also you can control how array fields are serialized: https://github.com/dakrone/clj-http#query-string-parameters

In any case, different form data fields can have the same name. You can't accurately model it with just a map, but there should be a way to create a proper form data object that your HTTP client understands. E.g. JS itself has js/FormData. No clue about clj-http though.

sure, and I don't know, but my expectation is a browser would show it as multiple fields with the same name, not the same field with multiple values

that looks vaguely like a pretty way a browser would display json

a top level def also seems like a bad place for a crsf token, because I would expect that to change with each request

I guess it does say "Form data" at the top, so maybe I am completely off base there

if you search for Multipart in the clj-http readme there are some examples that will be useful

The content-type is application/x-www-form-urlencoded; charset=UTF-8 and the raw data is __csrf_magic=sid:709a278c6a9cdafe00e2d91a691c00546629a759,1525927520&__csrf_magic=sid%3A709a278c6a9cdafe00e2d91a691c00546629a759%2C1525927520&viewtype=default&filter=&sorttype=bytes&states=100&getactivity=yes

Ah ha! Mucking with curl showed the CSRF token was changing. Firefox wasn't showing that, or somehow I was very confused by what it was showing me. Anyway, after getting clj-http to follow redirects on a POST, I was able to get the 2nd token. Let there be data 😄 Thanks everyone!

How is it relevant to #clojure though? Are you looking for a Clojure library?

Yeah, I'm trying to do it from within Clojure. Using clj-http to capture the page. Mainly for debugging purposes. Looking at a wall of HTML isn't fun. Seeing a partially rendered version would be helpful.

Looking at a bunch of Hiccup is a little better, but not much.

If it's just for a one-off debugging, I'd use w3m --dump. :) Otherwise, I'd use some Java library, like jsoup.

I’ve been using jsoup for parsing

and a library called jericho can do some rendering

; up in the ns
(:import net.htmlparser.jericho.Source
           java.io.StringReader
           net.htmlparser.jericho.LoggerProvider) 


(defn jericho [html cols]
  (let [r (-> html
              (StringReader.))
        src (Source. r)
        _ (.setLogger src (.getLogger LoggerProvider/DISABLED "foo"))
        r (-> src
              (.getRenderer)
              (.setMaxLineLength cols)
              (.setIncludeHyperlinkURLs false)
              (.toString))]
    (.toString r)))

net.htmlparser.jericho/jericho-html {:mvn/version "3.4"}

enlive parses HTML (with JSoup or another option) and emits a data structure like clojure.xml's. Then you can use clojure.core/xml-seq and filter by text node. This is a 92% solution - but you can improve it, if necessary, by using clojure.zip/xml-zip.

Instead of using one alias per main namespace, I'd use a single alias with a single entry point and make it accept one argument, which would be the day.

Your deps.edn doesn't work because EDN is not code - it's data. In your case, :aliases ends up being a list where the first item is a symbol reduce, the second item is another list with fn, and so on.

Yeah thank you for the Explanation. I guess I get it now I'll try your suggestion and see how it goes.

I've added the following code to a single entry point in a my core namespace that is bound to my :dev alias and i now simply run cllj -M:dev 1 in the terminal and it works like a Charm.

(defn -main
  ""
  [day-str]
  (let [day (parse-long day-str)
        main-fn (read-string (str "aoc2022.day" (when (< day 10) 0) day "/-main"))]
    (println "AOC 2022 Day " day)
    (require (symbol (str "aoc2022.day" (when (< day 10) 0) day)))
    ((resolve main-fn))))

You can also use requiring-resolve. And instead of using str+`when`, you can use format:

user=> (format "aoc2022.day%02d/-main" 2)
"aoc2022.day02/-main"

%02d means "take the argument, treat it as an integer, pad it to the length of two, with zeroes on the left side".

interesting. I didn't know that Clojure had a Common Lisp like format. I did replace the when part as you suggested. However, I don't understand how to use the requiring-resolve function. is it instead of the require function or instead of the resolve?

That's Java's format though. But there's also cl-format, yes. requiring-resolve is used instead of require+`resolve`.

Yeah. I got it to work now. the function is only llike 2 lines.

(defn -main [day-str]
  (let [day (parse-long day-str)]
    (println "AOC 2022 Day " day)
    ((requiring-resolve (symbol (format "aoc2022.day%02d/-main" day))))))

Great!

Thank you @U2FRKM4TW for your patience.🙏

fn is bound to a symbol there since symbols passed to a macro aren't resolved. You gotta resolve it before calling it.

I tend to use the following pattern when writing macros since it makes them easier to test, but I think it also helps show what's happening in this case:

(defn eg* [fn]
  (fn 1))
(defmacro eg [fn]
  (eg* fn))

(eg* 'inc) ;; nil

calling the eg macro will pass the unevaluated forms as the arguments

Shouldn't the macro return a quoted list instead of calling the function?

right, I think that's the intention, but just trying to show what's happening

(eg* 'inc) will call ('inc 1) which evaluates nil

it is possible to pass a function to macro, but it is almost never something you actually want to do

https://gist.github.com/hiredman/b2096b04927a9c9db480c39806dac297 for example builds a function object that is the continuation of expanding the macro and passes it back to itself