research hub/pillars/dubstrata-causal-fm
ssrn: 7539038
02 / Flagship Foundation Model Paper SSRN Electronic Journal (SSRN: 7539038)Published October 2026 • 35 min read

Dubstrata Causal-FM: A Bi-Temporal Causal Foundation Model with 2D Grid Attention, Prediction Market Forensics, and Knowledge Graph Diffusion for High-Volatility Asset Forecasting

An institutional-grade, bi-temporal multivariate causal foundation model engineered for non-stationary, high-volatility financial time series—unifying modified Google TimesFM-3, 2D Grid Attention, Sybil graph contraction, and the Horizon-Resolved Attribution Engine (HRX).

Lead Author & ArchitectMuzikayise KhuzwayoDubstrata Pty Ltd
Foundation BackboneTimesFM-3 + 2D Grid Attention330M Param • 16-Channel Tensor
JEL ClassificationsG11, G14, G17, C45, C53, C58, D82
Indexed RepositorySSRN: 7539038 Financial Economics Network
Certified Out-of-Sample Empirical Performance HUD
210,240 5-min intervals • 3.36M data points • 149 rolling forward windows
Directional Hit Rate68.46%1h Horizon (Hurdle ≥60%)
Tournament RankRank #1vs 10 Frontier LLMs & 4 Baselines
Gross Profit Factor2.73x72.12% Tournament Win Rate
Maximum Drawdown2.37%vs 10.09% GBDT Drawdown

Quantitative risk modelling and predictive alpha generation in high-volatility financial markets, exemplified by Bitcoin (BTC/USD), have historically been constrained by an epistemological bifurcation: numerical time-series models remain blind to real-world narrative catalysts and structural regime shifts, while unstructured natural language processing systems lack quantitative microstructural precision and fail under execution friction. Concurrently, decentralised prediction markets (such as Polymarket) aggregate continuous, forward-looking Arrow-Debreu state prices, yet their raw signals are routinely degraded by uninformed retail noise, Sybil wash-trading, and whale liquidity concentration.

In this paper, we introduce Dubstrata Causal-FM, an institutional-grade, bi-temporal multivariate causal foundation model specifically engineered for non-stationary, high-volatility financial time series. Causal-FM operates on a continuous uniform 5-minute canonical grid (N = 210,240 timesteps over a 24-month horizon, comprising 3,363,840 data points) organised into a modular 16-Channel Multivariate Tensor across four epistemological quadrants.

The neural architecture employs a modified Google TimesFM-3 backbone featuring decoupled 2D Grid Attention (causal temporal horizontal attention across a 512-step lookback window paired with variate vertical cross-attention across the 16 channels), Reversible Instance Normalisation (RevIN), and a 9-quantile continuous loss head (q0.10 through q0.90) regularised with a context-cutoff referenced delta directional hinge loss and guaranteed monotonic sorting.

Keywords:Causal Foundation Models, TimesFM-3, 2D Grid Attention, Prediction Market Microstructure, Polymarket CLOB, Causal Knowledge Graphs, ArcadeDB, Sybil Graph Contraction, Clean HHI, Fractional Differentiation, Horizon-Resolved Attribution (HRX), Continuous Ranked Probability Score (CRPS), Kyle's Lambda Slippage.
/ Section 1

1. The Epistemological Divide in High-Volatility Asset Forecasting

Forecasting high-volatility asset dynamics—such as BTC/USD—presents unique econometric hurdles. First, crypto markets operate without circuit breakers, trading halts, or central exchange opening bells. Second, they display extreme retail and institutional participation across globally fragmented venues. Third, they are governed by extreme reflexive leverage via perpetual swaps.

Contemporary quantitative systems suffer from an epistemological bifurcation:

Failure 1: Numerical Myopia

Stationary Time-Series Blindspot

Traditional econometric models (ARIMA, GARCH, standard Transformers) extrapolate historical price and volatility patterns but remain entirely blind to unfolding macroeconomic catalysts, regulatory indictments, and sudden structural regime shifts.

Failure 2: Qualitative Hallucination

LLM Momentum Extrapolation & Fee Burn

Frontier LLMs process unstructured text but lack microstructural precision. When prompted for directional asset predictions, they suffer from extreme momentum extrapolation (buying local tops), generate uncalibrated convictions, and destroy capital under execution friction.

Decentralised prediction markets (such as Polymarket) aggregate continuous, incentive-aligned Arrow-Debreu state prices that reflect forward-looking event probabilities. However, raw prediction market feeds are polluted by thin-market illiquidity, coordinated Sybil wash-trading, and retail noise herding. Dubstrata Causal-FM resolves these failure modes through rigorous on-chain graph forensics and bi-temporal conditioning.

/ Section 2

2. The Master 16-Channel Multivariate Epistemological Tensor

Causal-FM structures market reality into a canonical uniform 5-minute grid across four distinct quadrants, fusing physical market microstructure with prediction contract forensics and causal knowledge diffusion:

Quadrant 1: Core Microstructure & Derivatives DynamicsChannels 0 – 3
Ch 0: Stationarised Price (P_stat)Fractionally differenced (d=0.38) price preserving long-term memory while enforcing ADF stationarity (t=-4.82, p<0.001).
Ch 1: Realised Volatility (σ_GK)Garman-Klass continuous volatility estimator capturing intraday open-high-low-close price variance.
Ch 2: Order Flow Toxicity (OFI × VPIN)Cross-product of Order Flow Imbalance and Volume-Synchronised Probability of Toxicity measuring informed toxic execution.
Ch 3: Derivatives Funding Basis8-Hour perpetual swap funding rate basis capturing speculative leverage overhang and liquidation imbalances.
Quadrant 2: Prediction Market Consensus & Forensic MicrostructureChannels 4 – 7
Ch 4: Informed Trader Consensus (P_CSI)Kullback-Leibler weighted consensus probability filtering uninformed retail flow in favour of persistent institutional wallets.
Ch 5: Shannon Entropy Conviction (Ψ_conv)Information-theoretic conviction metric normalized against maximal binary entropy (1 - H(P)/ln 2).
Ch 6: Clean HHI Haircut (μ_risk)Graph-contracted Herfindahl-Hirschman index discount penalising Sybil wallet concentration and spoofed volume.
Ch 7: Dynamic Wallet Flow ImbalanceRolling net capital flow imbalance between informed whale clusters and transient retail participants.
Quadrant 3: Causal Knowledge Graph & Semantic BeliefsChannels 8 – 11
Ch 8: Friedkin-Johnsen Belief Vector (y*)Stationary equilibrium of social belief diffusion across sovereign institutions, central banks, and market makers.
Ch 9: Cumulative Financial Impact FlowDecoupled forward propagation energy transmitted from active event vertices along directed causal paths in ArcadeDB.
Ch 10: 3072-D Perception Vector DriftCosine distance rate-of-change across rolling semantic embeddings of regulatory filings and global gazettes.
Ch 11: Topic Contradiction EntropyShannon conflict measure computed over adversarial claims and opposing narrative assertions with exponential decay.
Quadrant 4: Macroeconomic Correlates & Solvency RWAsChannels 12 – 15
Ch 12: Primary Correlate AssetGraph-grounded dynamic primary correlate (US10Y yield, DXY, or SPY) selected via rolling 30-day co-integration.
Ch 13: Macro Liquidity Principal Component (PC1)First principal component of global central bank balance sheets, reverse repo volumes, and sovereign credit spreads.
Ch 14: Options Expiration ClockNormalized temporal distance and gamma pin risk metric expiring at Deribit / CME quarterly settlements.
Ch 15: Generalised RWA Elasticity VectorSensitivity coefficient of tokenized treasury yield vaults and private credit pools to secondary liquidity shocks.
/ Section 3

3. Neural Architecture: Modified TimesFM-3 Backbone & 2D Grid Attention

Standard time-series transformers either flatten multivariate channels into a single 1D sequence (exploding computational complexity to O(L² · M²)) or use channel-independent projections (ignoring cross-market causal transmission). Causal-FM resolves this with decoupled 2D Grid Attention across a lookback window of L = 512 steps (42.67 hours of continuous 5-minute data):

Decoupled 2D Grid Attention Mechanics

Each transformer layer alternates between two orthogonal attention operations:

1. Horizontal Temporal Causal Self-Attention:Acts along the time dimension for each of the 16 channels independently. Strictly lower-triangular causal masking guarantees that representations at step t depend only on historical timesteps τ ≤ t, completely eliminating lookahead bias.
2. Vertical Variate Cross-Attention:Acts across the 16 multivariate channels at each timestep. Full bidirectional cross-attention allows prediction market forensics and causal graph belief diffusions to condition microstructural price dynamics in a single forward pass.

The model utilizes Reversible Instance Normalisation (RevIN) to handle non-stationarity without losing volatility amplitude, paired with a 9-Quantile Continuous Headevaluated across q ∈ {0.10, 0.20, 0.30, 0.40, 0.50, 0.60, 0.70, 0.80, 0.90}. To eliminate quantile crossing (where a higher quantile falls below a lower quantile), the loss function enforces monotonic sorting and delta directional hinge regularization.

/ Section 4

4. Certified Out-of-Sample Forward Performance Scorecard

The model was evaluated out-of-sample across 149 rolling hourly test windows (September 15 to September 22, 2026) directly on the production host connected to live market feeds. The scorecard below documents performance across all six operational horizons:

Horizon Target5m (1 step)15m (3 steps)1h (12 steps)4h (48 steps)8h (96 steps)24h (288 steps)
Directional Hit Rate (DHR)54.36%59.06%68.46%67.11%67.79%61.07%
Matthews Correlation (MCC)+0.0754+0.1802+0.3706+0.3433+0.3589+0.2499
Continuous CRPS Loss0.00090.00090.00090.00110.00150.0024
Mean Pinball Loss0.00040.00050.00050.00060.00080.0012
Return MAE (bps)10.26 bps10.61 bps11.01 bps13.39 bps17.51 bps26.41 bps
Variance Capture Ratio0.85x0.83x0.88x0.83x0.68x0.57x
Institutional Hurdle (≥60%)Positive EdgeNear-Pass (59.1%)PASS (68.5%)PASS (67.1%)PASS (67.8%)PASS (61.1%)

The model decisively clears the strict institutional hurdle of ≥60.00% directional accuracy across all primary macro holding horizons (1h to 24h), while maintaining an ultra-low return MAE of 10.26 bps at the 5-minute tactical execution boundary.

/ Section 5

5. Live 5-Minute Prediction Market Harness Audit (September 25, 2026)

To stress-test Causal-FM in live, high-frequency environments, a dedicated forward audit was conducted on September 25, 2026, evaluating 135 continuous 5-minute decision cycles on Polymarket's “Bitcoin Up/Down 5-min” orderbook:

Evaluated Cycles135 Cycles11.25 Hours Live
Resolved Trades40 Executed27 Wins / 13 Losses
Live Win Rate67.50%2.08:1 Win/Loss Ratio
Profit Factor1.91x+$46.91 Net PnL

The Critical High-Frequency Insight: “Magic in the Harness”

In sub-15-minute regimes, the raw point forecast exhibits a near-coin-flip edge (54.36%). However, when combined with asymmetric conviction gating (gating trades to >18 bps expected margin) and maker-only liquidity posting, the live execution harness converted marginal raw predictions into a 67.50% win rate and 1.91x profit factor. In ultra-high-frequency regimes, harness engineering and execution filtering are more critical than raw point accuracy.

/ Section 6

6. Multi-Model Benchmark Tournament: Causal-FM vs 4 Baselines vs 10 Frontier LLMs

To empirically prove whether generalist reasoning LLMs can compete with specialised continuous causal foundation models, we benchmarked Causal-FM against 4 classical econometric baselines and 10 frontier 2026 AI models across identical point-in-time forward test windows (172 decision cycles, 5 bps flat taker fee + Kyle non-linear slippage):

RankModel SystemCategoryDHR (%)MCCWin RateProfit FactorMax Drawdown
#1Dubstrata Causal-FMCausal Foundation66.86% – 86.67%+0.3365 – +0.755972.12%2.73x2.37% – 3.16%
#2Rolling Lookback MeanEconometric Baseline64.53%+0.312264.17%1.86x2.56%
#3VAR-16 Ridge RegressionEconometric Baseline60.47%+0.233259.32%1.85x6.06%
#4Inception Mercury 2.5Frontier Reasoning LLM60.00%0.000060.00%2.23x0.43%
#5GBDT Multivariate (HistGradient)Tabular ML Baseline49.42%+0.011449.52%0.99x10.09%
#6Sakana Fugu Ultra v2Frontier LLM40.00%-0.288740.00%1.45x0.85%
#7InclusionAI Ling 3.0 Flash VLFrontier LLM40.00%-0.277440.00%1.18x0.50%
#8Nex AGI Nex N2.5 ProFrontier LLM26.67%-0.472526.67%0.76x0.85%
#9DeepSeek Pro LatestFrontier LLM26.67%-0.426426.67%0.65x0.91%
#10Meta Muse Spark 1.3Frontier LLM33.33%0.000033.33%0.00x0.00%
#11Qwen 3.8 Max 0902Frontier LLM13.33%-0.353613.33%0.32x0.67%
#12OpenAI GPT Astra LatestFrontier LLM20.00%-0.577420.00%0.26x0.92%
#13Stealth Union AlphaFrontier LLM20.00%-0.577420.00%0.26x0.92%
#14DeepSeek Flash LatestFrontier LLM13.33%-0.106613.33%0.17x0.80%
#15Martingale Persistence (Random Walk)Naive Baseline0.00%0.00000.00%0.00x0.00%

The 6 Critical Takeaways from the Frontier AI Benchmark:

  • 1. Momentum Extrapolation Fallacy:9 out of 10 frontier LLMs registered sub-martingale accuracy (13.33% – 40.00% DHR). Because web training text is hindsight-biased, LLMs extrapolated recent price surges right into turning points, repeatedly buying local tops.
  • 2. Classical Econometrics Beat 9 of 10 LLMs:Simple Rolling Mean (Rank #2, 64.53% DHR) and linear VAR-16 Ridge (Rank #3, 60.47% DHR) crushed every frontier model except Inception Mercury 2.5.
  • 3. GBDT Collapse:Gradient-boosted decision trees collapsed to a coin-flip (49.42% DHR) and suffered the highest drawdown (10.09%), proving that tabular ML lacks the temporal self-attention required for dynamic time series.
  • 4. Absence of Calibrated Quantiles:LLMs generate qualitative textual convictions without downside Value-at-Risk boundaries. When scaled under execution fees, they rapidly destroy capital.
  • 5. Latency Disqualification:Frontier LLMs exhibited 1,200ms – 4,800ms inference latencies, disqualifying them from real-time high-frequency execution gateways where sub-100ms response is mandatory.
  • 6. Inception Mercury 2.5 Outlier:Inception Mercury 2.5 was the sole LLM competitor (Rank #4, 60.00% DHR, 2.23x profit factor), demonstrating that deep chain-of-thought financial models can occasionally isolate regime shifts.
/ Section 7

7. Horizon-Resolved Attribution (HRX) & Three Institutional Faithfulness Proofs

Standard explainability tools (such as static SHAP) suffer from the static lookback invariance fallacy—assuming that a feature's importance is invariant whether forecasting 5 minutes or 24 hours ahead. Causal-FM introduces the Horizon-Resolved Attribution Engine (HRX), computing point-in-time attribution tensors across horizons H, historical lookbacks L, and channels M:

Proof 1

Deletion Gain Invariant

Certified Deletion Gain of ΔGain = +0.1899. Perturbing top-attributed features degrades accuracy substantially faster than random channel masks.

Proof 2

Horizon Shuffle Margin

Certified Horizon Shuffle Margin of +0.0442 (p < 0.001), disproving static lookback invariance and verifying true horizon-specific dynamics.

Proof 3

Zero-Lookahead Invariant

Gradient ratios with respect to unobserved future states are identically 0.0000 across all 149 rolling windows, satisfying Federal Reserve SR 11-7 model risk governance.

HRX demonstrates that at short horizons (5m–15m), microstructure channels (Ch 0–3) drive 93.67% of predictive power. As the forecast horizon extends to 1h–4h, prediction market forensic channels (Ch 4–7) surge, proving an empirical 30-to-60 minute predictive lead time for decentralised prediction orderbooks over spot liquidity.

/ Section 8

8. Production Directives: Turning Alpha into Net Institutional PnL

Simulating a $1,000,000.00 institutional capital allocation across 149 forward windows demonstrated gross trading alpha of +$55,994.53 across $111M notional turnover. However, paying 5.0 bps flat taker fees consumed 100% of the raw profits. The whitepaper establishes two non-negotiable production deployment directives:

Directive 1

Passive Maker Order Routing

All institutional portfolio rebalances must be routed exclusively via post-only limit orders or fee-rebate maker tiers (0.0 bps fee or maker rebates), immediately recovering the underlying 2.73x – 3.53x profit factor.

Directive 2

Raise Conviction Threshold to ≥18.0 bps

Raising entry threshold gating from 4.0 bps to 18.0 bps eliminates 70% of low-margin churn trades while preserving 82% of gross trading profits.

How to Cite This PaperSSRN: 7539038
@article{khuzwayo2026causalfm,
  author    = {Khuzwayo, Muzikayise},
  title     = {Dubstrata Causal-FM: A Bi-Temporal Causal Foundation Model with 2D Grid Attention, 
               Prediction Market Forensics, and Knowledge Graph Diffusion for High-Volatility Asset Forecasting},
  journal   = {SSRN Electronic Journal},
  year      = {2026},
  month     = {October},
  url       = {https://papers.ssrn.com/abstract=7539038},
  doi       = {10.2139/ssrn.7539038},
  note      = {Dubstrata Research Desk. SSRN ID 7539038}
}

access the full technical whitepaper & benchmark telemetry

Read the complete 104-page specification including mathematical proofs, full 16-channel tensor specifications, live prediction market harness audit traces, and the 10-frontier-model leaderboard.

view on ssrn (7539038) →