| Strategy | Original backtest | Scan-aware retest | Verdict |
|---|---|---|---|
| BTC short (MACD cross + EMA50) | +72.8% ROI · 63% WR | -9.2% ROI · 29% WR | Retired — never funded |
| ETH short (MACD cross + EMA50) | +79.8% ROI · 59% WR | +2.0% ROI · 31% WR | Rebuilt as v2, re-validating |
Three compounding flaws. The backtests graded stop-losses on hourly closing prices, while the live bots check prices every 2 minutes — so the backtest never saw the intrabar spikes that stop out real positions. Entry timing carried look-ahead bias: the backtest entered at prices the live bot could never have gotten. And slippage was modeled at zero. Each flaw alone flatters the results; together they manufactured a +72.8% fantasy out of a losing strategy.
The ETH short bot ran in dry-run while this played out. Its backtest claimed a 63% win rate. Its live record finished at 19 trades, 21% win rate. The deeper diagnosis: 51% of the BTC short's backtested entries never moved even 0.5% in the trade's favor — no exit logic could have saved them. The entries themselves were the problem.
162,565 one-minute bars (TQQQ + SQQQ) and 696,623 one-minute BTC bars, resampled to 5-minute resolution, October 2024 – April 2026. Indicators computed on hourly bars. Spread modeled at $0.02/share for ETFs; 0.03% taker per side plus funding for Coinbase perps. The flaw: trade outcomes were graded on hourly closes.
Same data, same strategy code — but entries and exits are evaluated only at the timestamps a live bot would actually scan, with stops checked against intrabar prices rather than hourly closes. This is the standard every Sphinx Edge strategy must now pass before funding. It is harsher, slower, and tells the truth.