cellularflow is a small PyTorch language model which replaces the transformer FFN with addressable key-value memory banks for continual learning

github.com

cross-posted to:
[email protected]

cellularflow is a small PyTorch language model which replaces the transformer FFN with addressable key-value memory banks for continual learning

github.com

☆ Yσɠƚԋσʂ ☆@lemmy.ml to

AI@lemmy.mlEnglish · 2 months ago

cross-posted to:
[email protected]

GitHub - celcilin/cellularflow: Memory-Augmented Continual Learning LLM architecture decoupling knowledge storage from sequence reasoning to eliminate catastrophic forgetting.

github.com

Memory-Augmented Continual Learning LLM architecture decoupling knowledge storage from sequence reasoning to eliminate catastrophic forgetting. - celcilin/cellularflow

You must log in or register to comment.

Chat

AI@lemmy.ml

artificial_intel@lemmy.ml

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

3 users / day
4 users / week
33 users / month
41 users / 6 months
0 local subscribers
6.64K subscribers
64 Posts
20 Comments
Modlog

mods: