Toot

Written by Dan Goodman on 2025-01-23 at 17:12

@GabrielBena

Our intuition suggested that resource constraints are likely to be important: there's little incentive to specialise if you have infinite resources. Sure enough, when we did large parameter sweeps we see that you get more specialisation when resources (neurons, synapses) are tight.

This seems like an important insight: we see that resource constrained biological brains are great at generalisation, an expected outcome of having specialised modules with generalisable functions, while machine learning systems are not. Maybe we give them too much computational power? 🤯

=> View attached media

=> More informations about this toot | View the thread | More toots from neuralreckoning@neuromatch.social

Mentions

=> View GabrielBena@neuromatch.social profile

Tags