This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2019-07-06
Channels
- # announcements (13)
- # aws (3)
- # beginners (10)
- # calva (3)
- # clj-kondo (1)
- # clojure (63)
- # clojure-spec (15)
- # clojure-sweden (1)
- # clojure-uk (6)
- # community-development (2)
- # cursive (32)
- # datomic (20)
- # duct (1)
- # emacs (11)
- # events (1)
- # fulcro (32)
- # keechma (23)
- # luminus (2)
- # reagent (1)
- # ring (1)
- # shadow-cljs (23)
- # spacemacs (5)
- # specter (4)
- # sql (13)
- # tools-deps (16)
- # vim (1)
- # yada (2)
@seancorfield Nice! I'll investigate the custom row builder option, but maybe I just go with that snippet u show above... the thing is: I have no control over the queries... once they are ran against database, the results need to be wrapped in a Avro Message... so I'm using the Resultset to get ResultsetMetadata so that I can get the field type name, precision, etc...
And later, when reading those messages, be able to get what was the "real" database type to 'materialize' them inside another database...
@gleisonsilva I bet you could create a row builder that produced Avro messages directly.
@seancorfield so imagine I have the driver on my Linux filessystem
As JAR file? It's a local dependency.
https://stackoverflow.com/questions/2404426/leiningen-how-to-add-dependencies-for-local-jars#14070422 OK found it
Thx @seancorfield. I will try out!
In deps.edn
you just add the full path of the JAR file to the :paths
vector. Not sure how you do it in project.clj
.

I'm loading about 13 million records (3 columns) of data into memory (via clojure/java.jdbc). I intend to keep this data in memory and incrementally poll the database to get new records. The initial load takes a few minutes. Is there anything you guys would suggest to make this faster/more efficient? I'm not doing anything special really. I'm using :row-fn
and wrapping the final result like (vec rows)