Mastodon

0 posts0 participants0 posts today

Philo Sophies<a href="https://troet.cafe/tags/Zoomposium" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Zoomposium</a> with Dr. <a href="https://troet.cafe/tags/Patrick" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Patrick</a> <a href="https://troet.cafe/tags/Krau%C3%9F" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Krauß</a>: Building instructions for <a href="https://troet.cafe/tags/artificial" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#artificial</a> <a href="https://troet.cafe/tags/consciousness" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#consciousness</a>Transferring the various stages of <a href="https://troet.cafe/tags/Damasio" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Damasio</a>'s <a href="https://troet.cafe/tags/theory" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#theory</a> of consciousness 1:1 into concrete <a href="https://troet.cafe/tags/schematics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#schematics</a> for <a href="https://troet.cafe/tags/deeplearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#deeplearning</a>. To this end, strategies such as <a href="https://troet.cafe/tags/feedforward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#feedforward</a> connections, <a href="https://troet.cafe/tags/recurrent" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#recurrent</a> <a href="https://troet.cafe/tags/connections" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#connections</a> in the form of <a href="https://troet.cafe/tags/reinforcement" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#reinforcement</a> learning and <a href="https://troet.cafe/tags/unsupervised" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#unsupervised</a> <a href="https://troet.cafe/tags/learning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#learning</a> are used to simulate the <a href="https://troet.cafe/tags/biological" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#biological</a> <a href="https://troet.cafe/tags/processes" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#processes</a> of the <a href="https://troet.cafe/tags/neuronal" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#neuronal</a> <a href="https://troet.cafe/tags/networks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#networks</a>. More at: <a href="https://philosophies.de/index.php/2023/10/24/bauanleitung-kuenstliches-bewusstsein/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://philosophies.de/index.php/2023/10/24/bauanleitung-kuenstliches-bewusstsein/</a>or: <a href="https://youtu.be/rXamzyoggCo" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://youtu.be/rXamzyoggCo</a>

Philo Sophies<a href="https://planetearth.social/tags/Zoomposium" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Zoomposium</a> with Dr. <a href="https://planetearth.social/tags/Patrick" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Patrick</a> <a href="https://planetearth.social/tags/Krau%C3%9F" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Krauß</a>: Building instructions for <a href="https://planetearth.social/tags/artificial" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#artificial</a> <a href="https://planetearth.social/tags/consciousness" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#consciousness</a>Transferring the various stages of <a href="https://planetearth.social/tags/Damasio" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Damasio</a>'s <a href="https://planetearth.social/tags/theory" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#theory</a> of consciousness 1:1 into concrete <a href="https://planetearth.social/tags/schematics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#schematics</a> for <a href="https://planetearth.social/tags/deeplearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#deeplearning</a>. To this end, strategies such as <a href="https://planetearth.social/tags/feedforward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#feedforward</a> connections, <a href="https://planetearth.social/tags/recurrent" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#recurrent</a> <a href="https://planetearth.social/tags/connections" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#connections</a> in the form of <a href="https://planetearth.social/tags/reinforcement" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#reinforcement</a> learning and <a href="https://planetearth.social/tags/unsupervised" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#unsupervised</a> <a href="https://planetearth.social/tags/learning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#learning</a> are used to simulate the <a href="https://planetearth.social/tags/biological" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#biological</a> <a href="https://planetearth.social/tags/processes" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#processes</a> of the <a href="https://planetearth.social/tags/neuronal" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#neuronal</a> <a href="https://planetearth.social/tags/networks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#networks</a>. More at: <a href="https://philosophies.de/index.php/2023/10/24/bauanleitung-kuenstliches-bewusstsein/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://philosophies.de/index.php/2023/10/24/bauanleitung-kuenstliches-bewusstsein/</a>or: <a href="https://youtu.be/rXamzyoggCo" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://youtu.be/rXamzyoggCo</a>

RoundSparrow 🐦<a href="https://mastodon.social/tags/FWakeLyricLinks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FWakeLyricLinks</a> (previous post refs)<a href="https://mastodon.social/tags/FWakeSilent" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FWakeSilent</a> <a href="https://mastodon.social/tags/TrumpSilent" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#TrumpSilent</a> ++ <a href="https://mastodon.social/tags/SoundOfSilence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SoundOfSilence</a> forward refs: <a href="https://mastodon.social/tags/FWakeFeedForward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FWakeFeedForward</a> <a href="https://mastodon.social/tags/FeedForward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FeedForward</a> <a href="https://mastodon.social/tags/HelloDarknessOpera" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HelloDarknessOpera</a> "Hello Darkness Opera" ++ <a href="https://mastodon.social/tags/OperasByRoundSparrow" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OperasByRoundSparrow</a><a href="https://mastodon.social/tags/FWakeCancer" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FWakeCancer</a> <a href="https://mastodon.social/tags/FWakeInMyBrain" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FWakeInMyBrain</a> "FWake In my Brain" <a href="https://mastodon.social/tags/FWakeRestlessDreams" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FWakeRestlessDreams</a> <a href="https://mastodon.social/tags/FWakeNarrowStreets" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FWakeNarrowStreets</a> /\<a href="https://www.youtube.com/watch?v=u9Dg-g7t2l4" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.youtube.com/watch?v=u9Dg-g7t2l4</a>

RoundSparrow 🐦<a href="https://mastodon.world/@paninid" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@paninid</a> <a href="https://mastodon.social/tags/ActuallyAutistic" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ActuallyAutistic</a> Thank You! Appreciate it! <a href="https://mastodon.social/tags/FeedForward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FeedForward</a> is cool!<a href="https://www.GutknechtAutism.org" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.GutknechtAutism.org</a>

RoundSparrow 🐦<a href="https://mastodon.social/@neotoy" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@neotoy</a> Agreed, <a href="https://mastodon.social/tags/FinnegansWakeMixingBoards" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FinnegansWakeMixingBoards</a> All mixed up <a href="https://mastodon.social/tags/Humanity2024" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Humanity2024</a> Thanks for <a href="https://mastodon.social/tags/FeedForward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FeedForward</a> Hate sucks, <a href="https://mastodon.social/tags/OutGroupHateOpera" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OutGroupHateOpera</a> <a href="https://www.youtube.com/watch?v=4RFK8Ft-GNQ" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.youtube.com/watch?v=4RFK8Ft-GNQ</a>

Ada CzerwonogoraEscribí este brevísimo resumen del artículo de Hattie & Timperley (2007) para mi módulo de Evaluación en la Maestría en Didáctica de la Educación Superior (UCLAEH):El poder de la retroalimentación y devolución formativa<a href="https://yodemoliendohoteles.wordpress.com/2024/03/31/el-poder-de-la-retroalimentacion-y-devolucion-formativa/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://yodemoliendohoteles.wordpress.com/2024/03/31/el-poder-de-la-retroalimentacion-y-devolucion-formativa/</a><a href="https://mastodon.social/tags/feedback" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#feedback</a> <a href="https://mastodon.social/tags/feedforward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#feedforward</a> <a href="https://mastodon.social/tags/assessment" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#assessment</a> <a href="https://mastodon.social/tags/evaluaci%C3%B3n" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#evaluación</a> <a href="https://mastodon.social/tags/evaluacionformativa" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#evaluacionformativa</a>

Matt WillemsenIn a Striking Discovery, AI Shows Human-Like Memory Formation <a href="https://scitechdaily.com/in-a-striking-discovery-ai-shows-human-like-memory-formation/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://scitechdaily.com/in-a-striking-discovery-ai-shows-human-like-memory-formation/</a> <a href="https://mastodon.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://mastodon.social/tags/human" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#human</a> <a href="https://mastodon.social/tags/brain" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#brain</a> <a href="https://mastodon.social/tags/memory" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#memory</a> <a href="https://mastodon.social/tags/hippocampus" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#hippocampus</a> <a href="https://mastodon.social/tags/modeling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#modeling</a> <a href="https://mastodon.social/tags/FeedForward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FeedForward</a> <a href="https://mastodon.social/tags/Transformer" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Transformer</a>

Victoria Stuart 🇨🇦 🏳️‍⚧️Addendum 101 Wide Feedforward All You Need <a href="https://arxiv.org/abs/2309.01826" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://arxiv.org/abs/2309.01826</a>* 2 non-embedding components in transformer architecture: attention; feed forward network * attention captures interdependencies betw. words regardless of position * FFN non-linearly transforms ea. input token independently * FFN (sig. fract. parameters) highly redundant * modest drop in accuracy removing FFN on decoder layers & sharing single FFN across encoder<a href="https://mastodon.social/tags/ML" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ML</a> <a href="https://mastodon.social/tags/transformers" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#transformers</a> <a href="https://mastodon.social/tags/NeuralNetworks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NeuralNetworks</a> <a href="https://mastodon.social/tags/attention" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#attention</a> <a href="https://mastodon.social/tags/FFN" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FFN</a> <a href="https://mastodon.social/tags/FeedForward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FeedForward</a>

gtbarryA jargon-free explanation of how AI large language models workWord vectors - Humans represent words with letters. Language models use a long list of numbersEach layer of an LLM is a transformer - Each layer takes a sequence of inputs—each word—and adds informationFeed-forward layers predict the next word<a href="https://mastodon.social/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LLM</a> <a href="https://mastodon.social/tags/neuralnetwork" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#neuralnetwork</a> <a href="https://mastodon.social/tags/artificialintelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#artificialintelligence</a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ai</a> <a href="https://mastodon.social/tags/generativeAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#generativeAI</a> <a href="https://mastodon.social/tags/WordVectors" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#WordVectors</a> <a href="https://mastodon.social/tags/transformer" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#transformer</a> <a href="https://mastodon.social/tags/FeedForward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FeedForward</a> <a href="https://mastodon.social/tags/data" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#data</a> <a href="https://mastodon.social/tags/bigdata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#bigdata</a> <a href="https://mastodon.social/tags/tech" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#tech</a> <a href="https://mastodon.social/tags/innovation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#innovation</a><a href="https://arstechnica.com/science/2023/07/a-jargon-free-explanation-of-how-ai-large-language-models-work/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://arstechnica.com/science/2023/07/a-jargon-free-explanation-of-how-ai-large-language-models-work/</a>

Elod Pal CsirmazA new type of <a href="https://fosstodon.org/tags/neuralnetworks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#neuralnetworks</a> and <a href="https://fosstodon.org/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> 2/3... Recent successes at one shot tasks where states changes become learning also point in this direction.Free neural networks from being <a href="https://fosstodon.org/tags/feedforward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#feedforward</a>. Genetic algorithms come to mind for training, but we'd need a suitable base structure that supports gene exchanges & some kind of recursion for repeated structures.Another idea is to use backpropagation to develop a new learning method, just like when a <a href="https://fosstodon.org/tags/programming" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#programming</a> language or manufacturing...

Victoria Stuart 🇨🇦 🏳️‍⚧️Absorbing Phase Transitions in Artificial Deep Neural Networks <a href="https://arxiv.org/abs/2307.02284" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://arxiv.org/abs/2307.02284</a>To summarize, we believe that the this work places the order-to-chaos transition in the initialized artificial deep neural networks in the broader context of absorbing phase transitions, & serves as the first step toward the systematic comparison between natural/biological & artificial neural networks. ...<a href="https://mastodon.social/tags/NeuralNetworks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NeuralNetworks</a> <a href="https://mastodon.social/tags/MeanFieldTheory" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MeanFieldTheory</a> <a href="https://mastodon.social/tags/SignalPropagation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SignalPropagation</a> <a href="https://mastodon.social/tags/PhaseTransitions" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PhaseTransitions</a> <a href="https://mastodon.social/tags/backpropagation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#backpropagation</a> <a href="https://mastodon.social/tags/feedforward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#feedforward</a>

Phil McAleerColleagues get surprised when I say I enjoy “marking” and I always think that is because their focus is wrong; I see it as “giving feedback and feedforward” rather than just marking or grading. This blog has many excellent tips on providing effective <a href="https://mastodon.social/tags/feedback" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#feedback</a> and <a href="https://mastodon.social/tags/feedforward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#feedforward</a> - despite the clunky name. I think seeing the process for what it really is could help lecturers get more out of it. <a href="https://mastodon.social/tags/SoTL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SoTL</a><a href="https://www.facultyfocus.com/articles/educational-assessment/ten-tips-efficient-effective-grading/" rel="nofollow noopener noreferrer" target="_blank">https://www.facultyfocus.com/articles/educational-assessment/ten-tips-efficient-effective-grading/</a>

The vOICe vision BCI 🧠🇪🇺Distinct early and late neural mechanisms regulate feature-specific sensory adaptation in the human visual system <a href="https://www.pnas.org/doi/10.1073/pnas.2216192120" rel="nofollow noopener noreferrer" target="_blank">https://www.pnas.org/doi/10.1073/pnas.2216192120</a> fatigue and sharpening "at different points in the sensory processing cascade, likely reflecting distinct <a href="https://mas.to/tags/feedforward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#feedforward</a> and <a href="https://mas.to/tags/feedback" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#feedback</a> interactions"; <a href="https://mas.to/tags/neuroscience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#neuroscience</a>

Michael Hackel<a href="https://bildung.social/tags/FediLZ" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FediLZ</a> <a href="https://bildung.social/tags/Feedback" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Feedback</a> <a href="https://bildung.social/tags/FeedForward" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FeedForward</a> <a href="https://bildung.social/tags/matheedu" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#matheedu</a> Ich habe Mal wieder mein Selbsteinschätzungsraster überarbeitet. Danke <a href="https://bildung.social/@noelte030" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@noelte030</a> für die Inspiration durch seine Bücher.Was haltet ihr davon? Verbesserungsvorschläge?

Recent searches

Search options

Administered by:

Server stats:

#FeedForward