- The weights of a neuron can be one or many. Depends on the input size.
- Say your input is a vector of size 3: you must build neurons of input vector size 3, 3 weights & a single bias
- The bias of a neuron is only relevant for activation.
- Activation is basically a function that asks something like `should I trigger?`. For micrograd, it is a tanh
- Finally, during forward propagation, the output is
-
Notifications
You must be signed in to change notification settings - Fork 0
devshoe/micrograd
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
But in golang.
Resources
Stars
Watchers
Forks
Releases
No releases published