Skip to content
r-gouldPublic

About

Hierarchical Temporal Memory (HTM) applied to next token prediction.

Topics

Resources

Stars

1 star

Watchers

1 watching

Forks

Latest commit

 

History

4 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 

Repository files navigation

An implementation of the Hierarchical Temporal Memory (HTM) system: a self-supervised, non-probabilistic, non-gradient-based prediction algorithm inspired by the neocortex in the brain.

Description of the approach: https://r-gould.github.io/2023/08/03/understanding-htm.html

Work in progress:

  • Vectorize spatial pooling and temporal memory algorithm?
  • Extend to include output layer, voting across columns
  • Performance analysis (currently limited by compute)

About

Hierarchical Temporal Memory (HTM) applied to next token prediction.

Topics

Resources

Stars

1 star

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages