Loving that this comes out of a market news pipeline. We have something similar but smaller scale in our trading bot app where we are trying to score incoming crypto/macroeconomic news based on fixed questions like importance, direction, and coins affected.
Doing that via standard chat API is just a bit too much if all you need is quick yes/no or scoring. Adding `floor_p` for the user to see the baseline bias of the model when given nothing is such a great feature as well.
How difficult would it be to calibrate the custom prompt pack on my own data set?