just following up on this one, @jaret? 🙂

Yes @U0509NKGK you just need to retract. If there are values present for that attribute, they must be unique in the set of current assertions.

You do not need to and should not excise them.

@jaret thanks pal! still think your documentation is missing some key paragraphs there, though 🙂

"... so the two will be described together." <page ends>

I get this error message on my experiment

{:cause "No op uniquely specified in x-nano-op header or in URI path"}

which presumably is telling me that I dont have my dispatch logic set up

It doesn't seem obvious how I am supposed to set it up though

when I post to the other api gateway, the one with ions in its name I get

HTTP/1.1 500 Internal Server Error
Date: Fri, 16 Jul 2021 10:01:04 GMT
Content-Type: text/plain
Content-Length: 20
Connection: keep-alive
server: Jetty(9.4.36.v20210114)
apigw-requestid: CjrTIierrPEEPdQ=

Ion execution failed

Response code: 500 (Internal Server Error); Time: 8282ms; Content length: 20 bytes

its supposed to return a hardcoded

{:status 200
   :headers {"Content-Type" "application/edn"}
   :body {:it :worked}}

https://docs.datomic.com/cloud/ions/ions-tutorial.html#configure-entry-points > the `:http-direct` section specifies functions that will be callable via HTTP but it looks like you can only set up a single http-direct function per ion-config file; is that correct??

so I followed https://docs.datomic.com/cloud/troubleshooting.html#http-500 and I see the message

{
    "Msg": "IonHttpDirectException",
    "Ex": {
        "Via": [
            {
                "Type": "java.lang.IllegalArgumentException",
                "Message": "No implementation of method: :->bbuf of protocol: #'datomic.java.io.protocols/ToBbuf found for class: clojure.lang.PersistentArrayMap",
                "At": [
                    "clojure.core$_cache_protocol_fn",
                    "invokeStatic",
                    "core_deftype.clj",
                    583
                ]
            }
        ],
        "Trace": [
            [
                "clojure.core$_cache_protocol_fn",
                "invokeStatic",
                "core_deftype.clj",
                583
            ],
            [
                "clojure.core$_cache_protocol_fn",
                "invoke",
                "core_deftype.clj",
                575
            ],
            [
                "datomic.java.io.protocols$fn__3594$G__3589__3599",
                "invoke",
                "protocols.clj",
                12
            ],
            [
                "$__GT_bbuf",
                "invokeStatic",
                "io.clj",
                20
            ],
            [
                "$__GT_bbuf",
                "invoke",
                "io.clj",
                17
            ],
            [
                "clojure.core$update",
                "invokeStatic",
                "core.clj",
                6185
            ],
            [
                "clojure.core$update",
                "invoke",
                "core.clj",
                6177
            ],
            [
                "datomic.ion.http_direct$encode_body",
                "invokeStatic",
                "http_direct.clj",
                66
            ],
            [
                "datomic.ion.http_direct$encode_body",
                "invoke",
                "http_direct.clj",
                61
            ],

I am trying' to return

{:status 200
   :headers {"Content-Type" "application/edn"}
   :body {:it :worked}}

do let me know if that is not correct

It's more like a #pedestal question maybe You can see here the supported bodies https://github.com/pedestal/pedestal.ions/blob/master/src/io/pedestal/ions.clj#L21

oh is it pedestal running behind the scenes? that is helpful to know

Humm... not sure now. When I started with datomic ions, pedestal was the way to go. I will re-read the docs.

but

(supers (class {:hello :world}))
=>
#{clojure.lang.AFn
  java.lang.Runnable
  java.lang.Iterable
  clojure.lang.IHashEq
  clojure.lang.IMapIterable
  java.util.Map
  clojure.lang.Seqable
  java.io.Serializable
  clojure.lang.IObj
  clojure.lang.IEditableCollection
  clojure.lang.ILookup
  clojure.lang.Associative
  clojure.lang.APersistentMap
  clojure.lang.IKVReduce
  clojure.lang.IPersistentCollection
  clojure.lang.IFn
  java.lang.Object
  clojure.lang.MapEquivalence
  java.util.concurrent.Callable
  clojure.lang.IMeta
  clojure.lang.IPersistentMap
  clojure.lang.Counted}

(extend-protocol IonizeBody
...
  clojure.lang.IPersistentCollection
  (default-content-type [_] "application/edn")
  (ionize [o] (pr-str o))
...

but the protocol mentioned in the error log was .protocols/ToBbuf

@U793EL04V sorry for missleading

Instead of wiring a web handler to a single function, use a routing library such as Compojure or pedestal.

I think I am using the HTTP Direct Ions Handler https://docs.datomic.com/cloud/ions/ions-tutorial.html#http-direct

ions http handler is a single ring function. You should use compojure, pedestal, or any other ring routing library

Using pedestal for example, the same service-map that you will use on ions ring handler, you can use to develop at localhost using jetty

That's helpful thanks Enzzo

Aggregation functions (count in this case) are not called when there are no results. The result set is #{} (set of no tuples). No tuples means no aggregation functions called. The . calls ffirst (ie first slot from first tuple) which is nil.

Thank you, for the technical answer. 🙂 But I really think count should return 0 for an empty set, should it not? It feels so... wrong…

they ain't gonna change it now 🙂

so different aggregates should work differently for empty sets?

@U09R86PA4’s point is not merely technical, it is consistent across all aggregates.

@U4VT24ZM3 The semantics of what you want are unclear in the general case. Ignore the . syntax for now, because it’s just syntax sugar for an ffirst on the query result. The result set after :where and :with is a tuples (one per slot in the :find), unaggregated. Aggregation takes the unaggregated :find slots and produces another set with the aggregated columns unbound, and then the aggregation functions are called with what the correlated, unbound values would be, and the result of the aggregation is placed into it. Some code to illustrate:

;; :find before aggregation
(sort (d/q '[:find ?l ?n
             :where [?l ?n]]
           (into
            (mapv vector (repeat "a") (range 5))
            (mapv vector (repeat "b") (range 5)))))
=> (["a" 0] ["a" 1] ["a" 2] ["a" 3] ["a" 4] ["b" 0] ["b" 1] ["b" 2] ["b" 3] ["b" 4])
;; :find collecting sets for aggregation
(sort (d/q '[:find ?l (vec ?n)
             :where [?l ?n]]
           (into
            (mapv vector (repeat "a") (range 5))
            (mapv vector (repeat "b") (range 5)))))
=> (["a" [0 1 2 3 4]] ["b" [1 2 3 4 0]])
;; aggregation value substituted in place
(sort (d/q '[:find ?l (count ?n)
             :where [?l ?n]]
           (into
            (mapv vector (repeat "a") (range 5))
            (mapv vector (repeat "b") (range 5)))))
=> (["a" 5] ["b" 5])

so aggregation always has the shape of reducing one-or-many values to one value to place into an existing tuple. It can’t make new tuples in the result set, only reduce

so if (count ?n) returned 0, into what tuple would it be placed?

Here’s the same code example as above, but with an empty result set:

;; :find before aggregation
(sort (d/q '[:find ?l ?n
             :where [?l ?n]
             ;; not in result set
             [(ground "Z") ?l]]
           (into
            (mapv vector (repeat "a") (range 5))
            (mapv vector (repeat "b") (range 5)))))
=> ()
;; :find collecting sets for aggregation
(sort (d/q '[:find ?l (vec ?n)
             :where [?l ?n]
             ;; not in result set
             [(ground "Z") ?l]]
           (into
            (mapv vector (repeat "a") (range 5))
            (mapv vector (repeat "b") (range 5)))))
=> ()
;; aggregation value substituted in place
(sort (d/q '[:find ?l (count ?n)
             :where [?l ?n]
             ;; not in result set
             [(ground "Z") ?l]]
           (into
            (mapv vector (repeat "a") (range 5))
            (mapv vector (repeat "b") (range 5)))))
=> ()

How could count produce 0 in this case?

The only way to get what you want is to make aggregations “special” somehow when there are no unaggregated items in the :find

How are you setting up authentication?

@U0CJ19XAM Earlier I used access gateway with IAM. I dont understand if I can use IAM here(in IonApiGateway) or I need use JWT or another way to auth.

Can you show an example your client config map?

FWIW, you shouldn't have to configure anything in API Gateway to "set up authentication", that should be handled for you separately from an api gateway authorizer.

My example client config map: {:server-type :ion :region "eu-central-1" :system "*" :endpoint "*.http://eu-central-1.amazonaws.com" }

Where I can set up this if not in api gateway? I try do curl from terminal with my IAM user but its dont work.

Do you have an aws profile established for your user on your laptop? If so, attach it to :creds-profile "your creds-profile" in the map.

Yes I have aws profiles. And how after this I can test this right? I add :creds-profile "your creds-profile"

Wait, you're trying to connect your client to the IonApiGateway, shouldn't you be using ClientApiGatewayEndpoint

Wait, Am I need add ClientApiGatewayEndpoint to :endpoint for use curl https://$(IonApiGatewayEndpoint) ? im confusion

Ah. We are talking about totally different things.

I thought you were having problems connecting via the datomic client. Is the datomic client connecting correctly?

Connecting via datomic client does not work. I keep getting a "Execution error (ExceptionInfo) at datomic.tools.ops.aws/invoke!" error even though my user has been configured correctly. ClientApiGatewayEndpoint seems to be working when accessing with curl. The thing is, I'm trying to follow an updated version of Datomic cloud documentation that was released couple of days ago. I thought trying https://docs.datomic.com/cloud/ions/ions-reference.html#invoke-web-service might be useful but curl request fails with 502 Bad Gateway error. Not sure if I'm doing it the right way:)

I'm assuming you're using the recently released 884-9095 version of cloud. We create 2 API gateways for you (unless you explicitly chose not to when when deploying the cloudformation templates). The 1st API Gateway is for the datomic client, and it replaces the access-gateway / socks proxy. This is the ClientApiGatewayEndpoint output in cloudformation. You should put that url in your client config map:

{:server-type :ion
 :region "eu-central-1"
 :system "*****"
 :endpoint ""
 }

Joe, thank you so much! It's clearer now. No, I haven't created my ions yet, trying to check and configure everything I can before doing that. So once deployed, my ions will be accessible through this IonApiGatewayEndpoint, right? Do I require any specific AWS IAM policy to have access? Really appreciate your help!

The IonApiGatewayEndpoint is on the internet, so however you want to auth that is up to you. But no, that IonApiGatewayEndpoint does not require any IAM policy. The ClientApiGatewayEndpoint requires the same AWS IAM policy as before this release (to secure access to your database).

Got it, thank you so much!

Have fun, reach out if you run into anything else!