Fork me on GitHub
#off-topic
<
2019-04-25
>
Daniel Hines14:04:34

Thoughts on aspect oriented programming? Seems like it’s macros but heavier.

Conor14:04:32

Github's #1 bot (?) Markus Elfring is a big fan

Conor14:04:09

AOP tends to involve too much magic/surprises for my liking, though I've only really come across it in Spring

Daniel Hines14:04:22

Yeah, that’s what Wikipedia said.

Daniel Hines14:04:13

But there are a few things that really are cross-cutting. Tracing, authentication, maybe a few others.

Daniel Hines14:04:36

I don’t see how cross cutting concerns can be handled in a way that’s universal without being obscure.

Daniel Hines14:04:42

(Or just function composition)

john15:04:28

Another factoid about locality and perception that I find interesting: It takes 1.3 seconds for light to get from the moon to earth, so, pending any QM discoveries, we'll never have human-perceptibly "local" access to state on the moon. However, given the size of the earth, light in a vacuum can round trip to any location on earth in just under the level of human perception (roughly 16 ms, give or take). So, it's like the size of the earth and human perception are conveniently related such that state at any location can be made to seem local relative to human perception, given the speed of light.

Daniel Hines17:04:33

The truism still rings true. It really is a small world 🗺️

john17:04:03

Indeed :)

bfay16:04:55

"human perception" is a bit vague, though - each sensory system is tuned a bit differently in its sensitivity to time. I'm thinking specifically of sound - 15 ms isn't a lot of time, but it is noticeable for musicians. It's small enough that if two sounds play 15 ms apart from each other, it might not sound like two discrete events, but it's enough that you can feel that something is off.

4
mloughlin16:04:43

they used to say there was no perceivable differences in a movie's frames per second over ~24, back when they were shot at... 24fps! 🙂

mloughlin16:04:59

now we have games that run at >144 fps, we know it's totally possible to perceive it

mloughlin16:04:51

16ms comes out to a little over ~60 perceivable moments per second?

john16:04:41

yeah... Perhaps if the diff between 60 and 144 is noticeable then my numbers are a bit off. Good point about audio too. But, strangely, neuroscientists claim that 44 khz range frequencies become downsampled by our auditory systems and, by the time they reach our consciousness, the experiential bits are moving through the brain no faster than the alleged 200 hz limit of the brain.

👍 8
polymeris02:04:51

But the cochlea does not "sample" the waves digitally. It's an analogue system, shaped like a cone, where different parts resonate at different frequencies.

john03:04:18

presumably though they're converted into spike trains in the auditory cortex somewhere right?

polymeris03:04:07

I guess... but the frequency of that doesn't correlate with the frequency of the actual waves, it has already been converted from the time to the frequency domain. Just like eyes perceive color in the terahertz range.

polymeris03:04:39

By having cones sensitive to those ranges

john03:04:06

right... the problem is that... well... from what I understand, many neuroscientists believe that the "seat of consciousness" sort of sits in the front lobes of the brain - front-striatal-loops. But, for that to be true, you have to explain how the information gets from the visual cortex, auditory cortex and somatosensory cortex, into those frontal, affective areas of the brain.

john03:04:02

To explain that, they tend to say that the stream of our consciousness is actually a very thin byte stream of only a few bytes per second... I can't remember the estimate... maybe a few hundred or a few kilobytes

john03:04:58

Reason being, you have to explain how all that information from all those different features get integrated at only 200 hz

polymeris03:04:15

Ohhh, I understand what you are getting at, I think

john03:04:39

So, the argument is that our actual consciousness is like a pinhole that quickly saccades across our perceptions

john03:04:03

But the richness of my own subjective experience makes that very hard to believe, IMO

polymeris03:04:50

IDK, it seems to me that I am conscious about a very small subset of the stuff I should be percieving

polymeris03:04:08

There is constant 10kHz auditory input going on in the background

polymeris03:04:41

But it's not getting to that "seat of consciousness"

polymeris03:04:47

Unless it's relevant in conjunction with other inputs

john03:04:58

But our TV is like 1080p, right? What do you subjectively feel like the resolution of your visual system is? Mine feels like... I don't know, 16K? 32K? Allegedly, only a pinhole of that gets through to consciousness.

polymeris03:04:58

If I focus my eyes on this last comment of yours I cannot read any of the others

polymeris03:04:13

In fact I only can read maybe a few words at a time

polymeris03:04:51

My brain reconstructs a 16K image from what it knows the other comments and my surroundings to be

john03:04:54

at 200 hz, it's hard to integrate such a rich visual experience, and funnel it down to a few K, all while catching baseball

john03:04:28

Where is that image reconstructed? and how do those 16K get to the frontal lobes all at once?

polymeris03:04:02

200Hz of what, BTW?

polymeris03:04:18

I don't know much of about this stuff

polymeris03:04:44

But is it 200 bits a second or 200 GB a second or each neuron fires at 200Hz?

john03:04:01

The brain is believed to operate on a few different frequency ranges. The highest range is 200hz. That means that it is believed that the information communication medium of the brain - spike trains - move through the brain at those frequencies.

john03:04:02

Less believed theories claim that quantum effects are being leveraged by our consciousness, allowing long-distance communication between neurons, much faster than the spike trains we're usually measuring.

john03:04:12

I tend to want to believe the former, since I fancy the idea of seeing a human-like AI sooner rather than later. But this paradox about integrating such massive information at such slow rates makes me wonder if the later is rather true.

john03:04:46

Most AI folks you hear will poopoo on the quantum theories of consciousness, because they desperately want to believe that consciousness is predicated on classical mechanics.

john03:04:56

And they say that MRIs would likely mess with our consciousness if quantum activity was involved

polymeris03:04:02

Spike trains... so it's bits?

polymeris03:04:11

I am not familiar with the concept

john03:04:22

yeah, perhaps you could just call them bits

polymeris03:04:16

And that 200Hz limit is everywher?

john03:04:42

a given neuron has a tree of branches that respond to different spike trains differently... So there's a lot of parallelism, harmonization and dissonance between those spike trains.. So it's sorta analog too

john03:04:21

Yeah, lots of communication takes place over brain waves that are in the 5 10 and 15 hz range. Super low.

john03:04:09

There's another kind of synaptic connection called "gap junctions"

john03:04:05

They synapt electrically and are much faster, but people haven't yet implicated them as some fundamental component of consciousness AFAIAA

polymeris03:04:38

So you have this communication that happens between the auditory cortex and the front lobes at max 200Hz... does that limit also hold in the intra-lobe signals as well?

john03:04:42

Yeah, presumably it's a global limit

john03:04:02

Some believe this circuit is seat of consciousness, sotospeak https://en.wikipedia.org/wiki/Frontostriatal_circuit

john03:04:09

Even ancient trilobites from the Cambrian era are thought to have some homolog of that circuit.

john03:04:36

So IIUC, for experiences from the sensory lobes to be experienced by our seat of consciousness (and for a person to give positive self-report of an experience) then it has to integrate with that circuit. Most information integration takes place in the thalamus

john03:04:37

Neuroscientists have been able to show that when parts of the visual cortex, perceiving certain aspects of a scene, do not integrate with those fronto-striatal circuits, then people have no self-report of the experience at all.

john03:04:23

So anyway, you'd have to explain how the rich diversity of all those rich sensory data sources are all integrated into those frontal loops so quickly.

john03:04:04

And it may be possible, but I just don't think I've heard a reasonably theory on how yet.

polymeris03:04:32

Well, I don't know, but that first auditory layer I can explain

polymeris03:04:33

It's just reduced from the rich 20Hz-20kHz to a frequency analysis of some stimulated cells in the ear

polymeris03:04:45

Just like cones in the eye

polymeris03:04:30

Where you have the THz range that gets reduced to a "few" red, blue and green cones being stimulated or not

polymeris03:04:48

And that's a very mechanical process

polymeris03:04:22

Maybe the other layers above, reaching to consciousness, can be explained by similar abstractions

polymeris03:04:41

But that's too much for me to grasp

john03:04:13

Yeah, there's lots of layers though... The visual cortex has 4 layers, some of which have sub layers. And the scenes and object semantics are built up there. So lots of data is being compressed into signals that summarize objects and whatnot

john04:04:20

Which pass some information laterally across the cortices via waves, but mostly through the thalamus, where lots of integration happens. The hippocampus, two small lobes around the sides of the thalamus, have "place cells" that actually maintain a grid of our location within a subjective radius of roughly one mile.

john04:04:59

All of that information has to bounce around, alot, and integrate, send it over to the frontal lobes to see what it thinks, check with the cerebellum to remember how to do the basic motor action, and the commit the decision back to the motor cortex, all while catching a baseball, all under 200hz

john04:04:09

Let's put it this way: the human brain is thought to compute at 1,000 petaflops. That's 10 quadrillion (10,000,000,000,000,000) floating point operations per second. However, the "bus speed" of the brain is only 200 hz. How do you ship 10 quadrillion flops between each other when your bus is only 200 hz? Easy, right? You just have lot's of parallel busses. But the problem is that we know information must flow into funnels in the brain, so that different streams can flow into different circuits. So what kind of bus funnels can possibly integrate 10 quadrillion flops of computation at 200 hz? Not saying it's not possible, but I'm not aware of any hard-science theories on how that is supposed to work, given Amdahl's law https://en.wikipedia.org/wiki/Amdahl%27s_law

polymeris04:04:52

Does the brain even do flops, though? As programmers we tend to fall too much into the zeitgeist of trying to interpret everything as a computer, sometimes, I think.

john04:04:41

eh, it's just an analogous estimate.. It's not like the brain is working with floating points.

polymeris04:04:21

When you strike the string on a guitar, how many petaflops does it process to turn that into soundwaves?

polymeris04:04:09

And that's a much simpler system, I think

polymeris04:04:46

But trying to emulate it digitally is still somewhat hard

john04:04:22

When they say 10 petaflops, they're using some model of a neuron as an analog of an actual circuit. So if you had a guitar with a quadrillion strings, then you could use those harmonies to probably compute some big logic

polymeris04:04:19

> model of a neuron as an analog of an actual circuit It's not a circuit, though

polymeris04:04:55

Maybe this is derailing the conversation a bit, but if we were in 1619 we would be talking about how many levers a neuron is equivalent to

polymeris04:04:38

Or in 1819, how many steam machines

polymeris04:04:44

Yes, there is a physical theory of computation

polymeris04:04:25

But there also was a theory of thermodynamics, and of classical mechanics

john04:04:04

fair point, but when neuroscientists are making claims about how much the brain can compute, they're trying to guess at how many different states a given neuron can switch on, like a circuit. They may not be right, but they're doing their best to approximate some computational power of a given neuron.

john04:04:52

If it so happens that neurons can also tap into their DNA to store and retrieve information in real time, as some believe, then that could significantly increase that number of flops.

Alex Miller (Clojure team)16:04:22

there's more going on in hearing than is implied by just "downsampling"

john16:04:08

"down" may be miss-leading there, yeah.

Alex Miller (Clojure team)16:04:14

like feature and pattern detection at different levels

john16:04:59

yeah, translated into different features

john16:04:43

I'm not entirely sold on the "200 hz brain speed limit" thing either

Alex Miller (Clojure team)16:04:52

in his copious free time, Rich has been working for years on a system that actually models human hearing

danielneal14:04:11

is it written in clojure?

Alex Miller (Clojure team)14:04:18

I believe it is more of a mathematical model, but you'd have to ask him

john16:04:15

Yeah, honestly I don't know much about it

Alex Miller (Clojure team)16:04:26

it's a fascinating subject if you ever get a chance to ask him about it

john16:04:48

I'd def ping him about it at a future conf some time

borkdude16:04:13

what is it with Lisp and cognition… I did my final thesis at a “music cognition institute” where I met Common Lisp.

jaide16:04:06

I bet the word “composition” comes up a lot in both circles for sure.

borkdude16:04:34

if it wasn’t for that experience, maybe I wouldn’t be doing Clojure right now 😉

jaide16:04:55

How come?

borkdude16:04:12

Because I was introduced to Lisp there and I liked it

👍 4
Ivan Koz17:04:02

@john interestingly it becomes harder to see difference between 120 and say 200 hz refresh rate, unlike 24 vs 60 vs 120, so 200hz at brains sounds reasonable. Or noticeable lag in our retina\optic nerve is present, also human reaction on visual event is about 80-250ms

john17:04:31

@nxtk yeah, I'm suspicious of the 200hz limit though cause the 44khz audio feature translation thing just seems super magical to me.

respatialized17:04:27

What is the "44khz audio feature translation thing?"

john18:04:06

Afaik, human consciousness mostly exists below a 200 hz range. But human perception of audio is up to 41,100 khz. So presumably auditory features from the high range are being translated into features that fit in those 200 hz range spike trains.

😮 4
Ivan Koz17:04:33

maybe there is pre-processing parts which operate at higher frequencies, something analogous to FPGA's

Ivan Koz17:04:16

or in parallel, each on its frequency range

john17:04:20

Somehow that thing - the cochlea and/or whatever else - is also able to signal to us that a particular instrument in a recording of a band is off beat with the rest. And in our consciousness it all feels subjectively like our whole brain piece is going full speed of the auditory source, up to 44,100 khz

polymeris18:04:54

Up to ~20k, really. That 44.1k is the cutoff for Nyquist freq

john17:04:44

and 200 hz is just so ridiculously slow... It's hard to believe

andy.fingerhut18:04:09

I can believe it, but it takes me at least 5 milliseconds.

😂 4