I am STILL trying to solve the problem of predicting the next number in a sequence when the solution involves more than a basic mathematical operation. Gradient Descent and Long-Short Term Memory (LSTM) are both making inaccurate predictions. I’m beginning to see why I can’t find sample code anywhere on the Internet.

Therefore, I am now researching the mathematical side of solving the next number in a sequence. How did my brain learn how to do this in elementary school? Maybe it’s not cheating to teach a computer how we humans solve these problems if the computer at least has to decide which method to use.

In other words, maybe I can give the computer a range of mathematical operations, and it has to determine which operation (or operations) produces the most accurate output. I would still have to use LSTM, but my input, output, and forget gates definitely need more than just sigmoids and their derivitives.