AI Cash-Receipt Forecasts: Backtest Against a Simple Baseline | Eric Kuvykin

Reviewed October 17, 2026. This guide replaces an earlier general overview; the original publication date and URL are retained.

An AI forecast should earn its place by outperforming a transparent baseline on records it could not have seen in advance. Compare errors before using projected receipts in an operating cash decision.

Define the quantity and information cutoff

Choose whether the forecast predicts gross sales, processor deposits or bank cash receipts. These are different targets. For a bank-receipt forecast, retain the actual receipt date and known settlement schedule rather than substituting order dates. Record which information was available when each forecast was issued. A model that sees later receipts during evaluation has an unfair advantage and does not reproduce the real decision.

Start with an understandable benchmark

For illustration, compare an AI prediction with last week’s same-weekday receipts. If Monday’s actual receipts are $10,000, the baseline predicts $9,000 and the AI predicts $10,500, their absolute errors are $1,000 and $500. If Tuesday’s actual receipts are $8,000, the baseline predicts $8,000 and AI predicts $10,000, the errors are $0 and $2,000. Across those two days, average absolute error is $500 for the baseline and $1,250 for AI. One good day did not make the AI better overall.

Evaluate repeated historical cutoffs

Freeze the inputs available at each cutoff, generate both forecasts and compare them with subsequent actuals. Include quiet periods, promotions and delayed deposits, documenting special conditions rather than silently excluding them. Use a sufficient evaluation period for the business’s pattern; the two-day arithmetic above only demonstrates the calculation. NIST’s AI RMF calls for documented measurement and ongoing evaluation; it does not prescribe this particular forecast test.

Tie adoption to an operating decision

Record how an error would change the action: scheduling a supplier payment, preserving a payroll buffer or delaying discretionary spending. A small average error can hide a damaging overestimate on a critical day. Keep an explicit fallback when inputs are missing or conditions change. Forecasts are uncertain operating estimates, not promised revenue or a basis for claiming financing eligibility. The completed report should show both models, dated inputs, actual receipts and errors.

Sources and related reading

Primary reference: NIST AI RMF Core measurement guidance. Worked examples are illustrative analysis, not client results or provider quotes.

Continue with the AMS New Jersey merchant reading path and alternative financing cost and cash-flow guide.

Share this article