November 5, 2024. Election morning. Polymarket priced Donald Trump at 62 cents. Kalshi priced him at 57. The polling consensus had it within a point. 538 called the race 50 Harris / 49 Trump. Nate Silver's personal model had it 48.6 / 47.6. Real Clear Polling had a literal tie at 48.5 each. By the next morning Trump had won, comfortably. The 5-cent spread between Kalshi and Polymarket lasted through the close. So did the much wider gap between the prediction markets and the polls.
Ask why those 2 things were true at the same time and the methodology of prediction-market analytics opens up.
Three traditions of thought have addressed pieces of that question. Each leaves work for the next.
1Shannon: signal-to-noise as a quantity
In 1948 Claude Shannon published 'A Mathematical Theory of Communication' across 2 issues of the Bell System Technical Journal. The paper defined entropy. It distinguished source from channel from receiver. It introduced the bit. The result that anchors this section is the channel capacity theorem.
For a continuous channel with bandwidth B and additive Gaussian noise, the maximum reliable information rate is
C = B · log2(1 + S/N)
where S is signal power, N is noise power, C is capacity in bits per second. Doubling the signal-to-noise ratio adds 1 bit per Hz. Tripling it adds 1.58. The logarithm is the punch. Cleaning up a noisy channel helps, and the help is bounded.
Map the formula onto a prediction market. The signal is the true probability of the underlying event, the quantity the market is trying to estimate. The noise is the aggregate cognitive distortion across all participants: incomplete information, asymmetric access to it, sentiment, hype, narrative anchoring, partisan distortion, herd behaviour, attention bias, opinion mistaken for analysis. Everything that hides the truth from the people pricing it. The channel is the venue: its fee schedule, oracle, order book, resolution mechanism, latency, the demographic and motivational mix of its participants. The channel does not introduce noise in the Shannon sense. It shapes how a given signal-and-noise mixture gets transmitted into the observed price. The price is the received message: signal plus accumulated cognitive noise, transmitted through one venue's specific mechanism.
Two consequences fall out.
First, for any one venue, the recoverable signal is bounded above by that venue's signal-to-noise ratio. You cannot outwork the channel. A trader running the cleanest possible Bayesian protocol on Polymarket alone is still capped by the cognitive noise of Polymarket's participant population, transmitted through Polymarket's specific mechanism. That is a structural fact, not an operational one.
Second, the same information-theoretic logic that produced the bound also justifies aggregation. Different venues attract different participant populations, with partially independent cognitive-noise distributions. The signal is common across venues. The noise is correlated only weakly. Combining the venues reduces the noise faster than it reduces the signal. The 5-cent Kalshi-Polymarket spread on November 5 was not an arbitrage error. It was 2 channels transmitting the same signal through 2 different cognitive-noise distributions, and the difference between them carried information neither one carried alone.
Signal stops being a metaphor. It becomes a quantity, with a closed-form bound, and a formal reason to read more than one venue at once.
2Silver: from quantity to discipline
64 years later Nate Silver published 'The Signal and the Noise.' The book applies Bayesian probability, descended from Bayes and Laplace, to the chronic underperformance of human forecasting. Silver's diagnostic is sharp and consistent across domains: forecasters issue point predictions, anchor to narratives, refuse to update when the evidence arrives.
Silver's positive case is weather. The US National Weather Service is admirably calibrated. When the NWS issues a 20% chance of rain, rain follows about 20% of the time. The same holds across the probability range. The reason is operational. The NWS logs every forecast, scores every outcome, and lets the feedback adjust the next call. Calibration follows from instrumented practice.
Silver's negative case is political forecasting. Drawing on Philip Tetlock's long-running expert study, Silver notes that when those experts said an event had absolutely no chance of occurring, it occurred about 15% of the time. The 0% bucket was wrong roughly 1 time in 7. Overconfidence is the failure signature, and disciplined forecasting is built to remove it.
The prescription is Bayes's theorem treated as a behavioural protocol: log a prior before looking at the evidence, score the evidence, compute a posterior, treat the posterior as the next prior. Silver leans on the mammogram example to make the arithmetic concrete. A positive screening test in a 40-year-old still corresponds to roughly a 10% probability of cancer, because the prior probability of cancer in that age group is only 1.4%. False positives dominate when the prior is low. The discipline is the willingness to write the prior down before the evidence arrives.
So far the move from Shannon to Silver is straightforward. Information theory gives the bound on what any one channel can transmit. Silver's protocol is the discipline that lets a single forecaster reduce their own contribution to cognitive noise: log a prior before the evidence arrives, score the evidence, update, repeat. Shannon's noise was a stochastic process in a wire. Silver's noise is in the forecaster's head. Both reduce on the same logarithmic curve. Both yield to instrumented practice.
A complication is worth surfacing, and prediction markets are where it bites. Both frames assume a stable underlying state being measured. Weather works that way: tomorrow's precipitation is not changed by anyone forecasting it. Markets do not. The market price is itself a probability estimate, and the act of trading moves it.
In late October 2024 a French former bank trader operating under the pseudonym Théo raised his Polymarket position on Trump from $30M to roughly $80M, financed by liquidating most of his other assets and routed through 11 separate accounts. His decision was informed by neighbour-effect polls he had commissioned from YouGov in Pennsylvania, Michigan, and Wisconsin, designed to surface the social-desirability bias that had distorted public polls in 2016 and 2020. By Election Day his accounts held roughly 25% of the Trump-EC contracts and 40% of the Trump-popular-vote contracts. He was structurally trapped: a position too large to exit without moving the market against himself.
Théo is the case that breaks the simple frame. His own cognitive noise, on this trade, was lower than the polling consensus's. He had identified a specific bias in the consensus and built a counter-instrument to measure around it. From outside, with the benefit of November 6, his estimate was the signal. From inside the venue, in real time, his trades looked indistinguishable from a whale pushing prices for unknown reasons. The market he was reading was the market his reading was making. A single-venue observer had no principled way to separate the 2 contributions.
That reflexivity is the kind of complication Silver's protocol cannot handle directly. The third move has to.
Silver himself instrumented his discipline once before. The PECOTA baseball system he built before the book was a Bayesian forecaster that produced probabilistic ranges per player, tracked itself against realised outcomes, and became the operating logic of FiveThirtyEight's later election work. PECOTA worked partly because baseball is non-reflexive: fans cheering does not change a player's RBI. Prediction markets need the same instrumentation. They also need it to handle the reflexive case PECOTA did not face.
3The instrument layer
The instrumented part of the discipline is what scales. A discipline that requires a notebook is a discipline most practitioners do not run. The ones who do cannot audit themselves at the speed and across the venues prediction markets now span. Polymarket processed roughly $3.3 billion in volume on the 2024 presidential race alone. Kalshi relaunched election markets on October 4, 2024, 32 days before Election Day, after a federal judge ruled against the CFTC's attempt to block them. By 2026 there are roughly a dozen venues with non-trivial volume, each carrying its own fee schedule, oracle source, resolution wording, and liquidity profile.
The empirical pattern across those venues is documented. Joshua Clinton and TzuFeng Huang at Vanderbilt analysed roughly 2,500 political prediction markets traded across the Iowa Electronic Markets, PredictIt, Kalshi, and Polymarket during the final 5 weeks of the 2024 campaign, covering more than $2 billion in transactions. Accuracy varied sharply by venue: 93% of PredictIt markets resolved better than chance, against 78% on Kalshi and 67% on Polymarket. Prices for identical contracts diverged persistently across exchanges. Daily price changes were weakly correlated or negatively autocorrelated. Arbitrage opportunities peaked in the final 2 weeks before the vote.
Read those findings against the Shannon frame and the structure becomes legible. Each venue is a channel transmitting the same underlying signal through a different cognitive-noise distribution. PredictIt's $850 per-contract cap and 5,000-trader-per-market limit, both in force through the 2024 election under the original CFTC no-action letter, selected for academics and political-junkie retail. Polymarket's crypto rails and offshore status selected for a different population again, with different distortions. Kalshi, regulated and dollar-denominated, sat between them. Single-venue accuracy is bounded by single-venue signal-to-noise. Cross-venue divergence is the residual that aggregation can recover, but only after the channel itself is normalised: fees stripped out, oracle wording aligned, resolution timing matched, participant-pool effects accounted for. Without that normalisation, channel differences and cognitive-noise differences read as the same number.
That is what nijinn is built around. The platform separates the 3 variables. It normalises across channels by matching contracts on underlying event rather than headline, stripping fees and slippage from observed prices, and aligning resolution windows. It surfaces the residual cross-venue divergence as the recoverable signal. It scores forecaster predictions against realised outcomes using Brier and calibration curves, treating cognitive noise at the individual scale as a measurable property of each user's track record. Trader-level position concentration, of the kind Théo's accounts exhibited, surfaces as a risk indicator on the contract: a flag that the price contains a single participant's view as much as the population's. An arbitrage opportunity invisible at single-venue resolution becomes visible at multi-venue resolution. A trader's calibration drift, untrackable without a logged history, becomes a number in the audit.
The platform is analytics-only by design, and the reflexivity problem is the reason. A tool that aggregated the cross-venue signal AND executed on it would, at scale, change the signal it was reading. We separate measurement from action and leave the act of trading to the trader.
You write your prior down before checking the price. You let the platform score your record. You see the cross-venue spread, the position concentration, and the calibration curve at the same time. You decide.
The Shannon ceiling is real. Single-venue noise is bounded below by the cognitive distortions of that venue's participant population, and edge is bounded above by the inverse. The Silver protocol is necessary, and insufficient on its own when the underlying is reflexive and the participant pool is the noise source. The instrument layer's job is to make divergence legible while it still matters, separating venue from population from signal, before the count rather than after. On November 5, 2024, the gap between Kalshi and Polymarket lasted roughly a day. The polls' miss is now in the literature. The next divergence is already pricing.