One honest forward pass word2vec · CBOW

You are the AI. The sentence “Witches have ____ and cauldrons.” crosses your desk with the middle word hidden. All you own is two small tables of numbers. Walk the five stations and watch a guess — and a complaint about the guess — come out of nothing but multiply, add, e, and log.

station 1 of 5 — context

the word being graded (the one in the blank)

switching re-runs all five stations — same context, different grade

Every number on this page is live. Nudge the weights at the loss station, then walk back and find what moved.

Try: step to the loss station, nudge three times, then walk back to the bars.