Next-code prediction
Train
Generate
Data
Data
Corpus
TinyCode (Python)
Tokens
Words
Byte-pair · 300 tokens
Byte-pair · 100 tokens
Characters
Min. count
Source
Small Python functions, each under a one-sentence comment, generated for these demos (scripts/word2vec-code.py)
Model
Model
Window
Dimension
2
3
4
8
16
32
Training
Training
Adam rate
Batch
words
Seed
View
View
Window underlines
Network connections
Live
Edit
Fast
Initializing WebGPU…
Run
Speed
1 words/s
2 words/s
5 words/s
Batches, as fast as possible
Epoch
—
Words
—
Batches
0
Perplexity
—
Loss
—