this project is outdated and doesn't work, go here for a working RNN: https://scratch.mit.edu/projects/1289917751/ ==================================== Open-Source Recurrent Neural Network with Backpropagation and Gradient Descent. Or OSRNN for short, if you really want. Or even OSRNNBGD, at this point I don't even care. However, I *cannot* get these stupid gradients to work and I am looking for help to fix this. You will be greatly credited and appreciated. You can set however many tokens and layers you want, along with sequence lengths for a single output. It is NOT limited to the sequence length for text, just re-enter the output and let it continue the text. Congratulations, you just made recursive prompting. Sources: https://en.wikipedia.org/wiki/Recurrent_neural_network https://en.wikipedia.org/wiki/Backpropagation https://en.wikipedia.org/wiki/Gradient_descent https://en.wikipedia.org/wiki/Context_window https://community.openai.com/t/recursive-prompting-appears-to-yield-meaningful-results/1249962 tags: #ai #neural #network #recurrent #neuralnet #neuralnetwork #nn #rnn #recurrentneuralnet #recurrentnerualnetwork
