med-mastodon.com is one of the many independent Mastodon servers you can use to participate in the fediverse.
Medical community on Mastodon

Administered by:

Server stats:

339
active users

#substrate

0 posts0 participants0 posts today

Through scaling #DeepNeuralNetworks we have found in two different domains, #ReinforcementLearning and #LanguageModels, that these models learn to learn (#MetaLearning).

They spontaneously learn internal models with memory and learning capability which are able to exhibit #InContextLearning much faster and much more effectively than any of our standard #backpropagation based deep neural networks can.

These rather alien #LearningModels embedded inside the deep learning models are emulated by #neuron layers, but aren't necessarily deep learning models themselves.

I believe it is possible to extract these internal models which have learned to learn, out of the scaled up #DeepLearning #substrate they run on, and run them natively and directly on #hardware.

This allows those much more efficient learning models to be used either as #LearningAgents themselves, or as a further substrate for further meta-learning.

I have an #embodiment #research on-going but with a related goal and focus specifically in extracting (or distilling) the models out of the meta-models here:
github.com/keskival/embodied-e

It is of course an open research problem how to do this, but I have a lot of ideas!

If you're inspired by this, or if you think the same, let's chat!

GitHubGitHub - keskival/embodied-emulated-personas: A project space for Embodied Emulated Personas - Embodied neural networks trained by LLM chatbot teachersA project space for Embodied Emulated Personas - Embodied neural networks trained by LLM chatbot teachers - GitHub - keskival/embodied-emulated-personas: A project space for Embodied Emulated Perso...

Latest paper out led by PhD student Georgia Sinclair, "Is substrate choice an overlooked variable in #ecotoxicology experiments?" looks at the issue of substrate choice for toxicology experiments. By measuring small molecule metabolites (#metabolomics) we show that the metabolic effects of #contaminants on organisms can vary by substrate even when using artificial, clean material.

Read more at lnkd.in/g4edDWT8

Continued thread

So, what if all #computation on this physical #substrate is #experiential? Running longer interdependent steps of computation makes relations, and a network of relations of experience makes coherent conscious thought, which might involve #qualia, #senses, #memories, #pleasure and #pain, simply depending on the topology of that network of relations.
Pleasure and pain are simply reinforcement and de-reinforcement of any functional model between sensory experience and motor control.