cellularflow is a small PyTorch language model which replaces the transformer FFN with addressable key-value memory banks for continual learning

github.com

cross-posted to:
[email protected]

cellularflow is a small PyTorch language model which replaces the transformer FFN with addressable key-value memory banks for continual learning

github.com

cm0002@infosec.pub to

AI - Artificial intelligence@programming.devEnglish · 1 month ago

cross-posted to:
[email protected]

GitHub - celcilin/cellularflow: Memory-Augmented Continual Learning LLM architecture decoupling knowledge storage from sequence reasoning to eliminate catastrophic forgetting.

github.com

Memory-Augmented Continual Learning LLM architecture decoupling knowledge storage from sequence reasoning to eliminate catastrophic forgetting. - celcilin/cellularflow

Chat

AI - Artificial intelligence@programming.dev

Aii@programming.dev

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

AI related news and articles.

Rules:

No Videos.
No self promotion: Don’t post links to your articles.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

14 users / day
15 users / week
15 users / month
15 users / 6 months
0 local subscribers
380 subscribers
48 Posts
1 Comment
Modlog