it's all about the prelude before the conversation. You need to tell it what the AI is and is not capable. It's not trying to be right, it's trying to complete what it thinks the AI would do :)
I tried to recreate it again to check how well it replicates. General context prompt ends in the line 'You say "So, f(x)=x*x".'. You might need to tweak the temperature to make the math more consistent.
I tried to recreate it again to check how well it replicates. General context prompt ends in the line 'You say "So, f(x)=x*x".'. You might need to tweak the temperature to make the math more consistent.
I think it's getting around a limit on algorithmic depth (how many operations the net can learn to do sequentially) by storing partial results in its output. Which is obviously easier, and probably something we should build into the architecture.