Skip to content

A miniature GPT implementation built and trained from scratch.

Notifications You must be signed in to change notification settings

Pyristix/pyristix-gpt

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Pyristix-GPT

A 10.8M parameter GPT model implementation built from scratch and pre-trained on 16.7kb of movie dialogue data.

Technologies used

  • Python (Pytorch library)
  • Jupyter notebooks

Example Images

An example generation of 100 tokens: pyristix-gpt-generation-cropped

About

A miniature GPT implementation built and trained from scratch.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published