Skip to content
Shadow Theory

Technical Companion: Approximation and Accounting for Quantum Sources

Finite observable accuracy and an explicit rank test

Jeremy RodgersSection 4 of 10Original PDF ↗

Finite observable accuracy and an explicit rank test

The exact source separations have an accessible finite-accuracy consequence against qubit memories and classical sources with at most eight causal states. This is a known spectral-rank technique newly specialized to the delayed law; it does not improve the difficult three-versus-four quantum boundary. It supplies a controlled, finite-data interface for the established quantum and classical memory claims.

Proposition 3.1 (Observable approximation floor). Let H be a normalized joint distribution of a past
and a future block, viewed as a matrix. Let γc(H) = (P
i>c σi(H)2)1/2. For any complete competing
law P ′ factoring through a causal cut with matrix rank at most c,
Technical passage, source page 7.
Searchable transcription
Proposition 3.1 (Observable approximation floor). Let H be a normalized joint distribution of a past
and a future block, viewed as a matrix. Let γc(H) = (P
i>c σi(H)2)1/2. For any complete competing
law P ′ factoring through a causal cut with matrix rank at most c,
TV(P ′, P) ≥γc(H)/
√
2.
Source page 7.
Searchable transcription
TV(P ′, P) ≥γc(H)/
√
2.

A classical c-state source has this rank bound; a quantum memory of Hilbert dimension d has rank at most d2. Every future-accessed, history-correlated system belongs to that cut. The statement allows nonstationary competitors and extra null symbols.

Proof. The classical joint table is a sum of at most c past/future product matrices. Quantum subnormalized conditional states and future effects pair in the d2-dimensional real Hermitian space. Pad the target with zeros for extra outcomes, preserving its nonzero singular values. The matrix difference has zero total sum; its positive and negative entries each sum to δ = TV(P ′, P). Consequently its squared Frobenius norm is at most 2δ2. The least Frobenius error of any rank-c approximant is γc(H), proving the assertion. The latter identity follows by truncating the singular-value decomposition for attainment; for the lower bound, project onto the orthogonal complement of the approximant’s column space and minimize the discarded quadratic mass.

For the four-record trine cut, put r = 1 −λ. The singular values of H = T ⊗T/9 are

1/9,
r/18 (four times),
r2/36 (four times).
Source page 8.
Searchable transcription
1/9,
r/18 (four times),
r2/36 (four times).

Every qubit-cut competitor therefore obeys

TV(P ′, Pλ,4) ≥r
√
1 + r2
18
√
2
,
Source page 8.
Searchable transcription
TV(P ′, Pλ,4) ≥r
√
1 + r2
18
√
2
,

while any at-most-eight-state classical competitor obeys

TV(P ′, Pλ,4) ≥
r2
36
√
2.
Source page 8.
Searchable transcription
TV(P ′, Pλ,4) ≥
r2
36
√
2.

These are outer bounds, not attained optimal approximation frontiers. They vanish at the iid endpoint, as required. They do not exclude a qutrit, because its ordinary rank ceiling is already nine.

Independent four-record trials and finite confidence

Assume N independently prepared trials from one fixed complete four-record law, with every trial and
null retained. The preparation/reset mechanism, clock and independence are physical conditions, not
inferred from a reset flag. Pool all nontarget past pairs into one extra row and all nontarget future
pairs into one extra column; this coarse-graining preserves the rank bound and gives a finite complete
table. Let bH be its empirical frequency matrix and
Technical passage, source page 8.
Searchable transcription
Assume N independently prepared trials from one fixed complete four-record law, with every trial and
null retained. The preparation/reset mechanism, clock and independence are physical conditions, not
inferred from a reset flag. Pool all nontarget past pairs into one extra row and all nontarget future
pairs into one extra column; this coarse-graining preserves the rank bound and gives a finite complete
table. Let bH be its empirical frequency matrix and
eN(α) = 1 +
p
log(1/α)
√
N
.
Source page 8.
Searchable transcription
eN(α) = 1 +
p
log(1/α)
√
N
.
Then
Pr{∥bH −H∥F > eN(α)} ≤α.
Source page 8.
Searchable transcription
Then
Pr{∥bH −H∥F > eN(α)} ≤α.
Indeed E∥bH −H∥2
F = (1 −∥H∥2
F)/N ≤1/N; replacing one trial changes the norm by at most
√
Technical passage, source page 8.
Searchable transcription
Indeed E∥bH −H∥2
F = (1 −∥H∥2
F)/N ≤1/N; replacing one trial changes the norm by at most
√

2/N. Bounded differences gives Pr{f −Ef > u} ≤e−Nu2, and Jensen gives the mean bound. The concentration step can be derived by exposing one independent trial at a time and bounding each conditional centered moment-generating function by the exponential of one eighth its squared range; optimizing its exponential Markov bound yields the displayed inequality. Distance to the rank-c matrix set is one-Lipschitz, so the test

γc( bH) > eN(α)
Source page 8.
Searchable transcription
γc( bH) > eN(α)

has false-rejection probability at most α for every admitted rank-c source. Against the exact target its rejection probability is at least 1 −β whenever γc(H) > eN(α) + eN(β). This supplies a stated sufficient trial budget. It is conservative and is not claimed sample-optimal. It certifies an observable rank obstruction, not a particular microscopic channel or the full infinite word law. Spectral identification, singular-value-tail thresholding and finite confidence are established tech-niques. Du Roy de Chaumaray et al., JMLR 25(415), 1–37 (2024), Eqs. (5)–(6), Theorem 4, uses the same tail statistic for nonparametric hidden Markov order estimation under a different, mixing single-sequence sampling model. The present contribution is the exact trine specialization, joint classical/quantum cut interpretation and complete-null four-record interface. Original least-rank approximation is Eckart–Young (1936). Hsu–Kakade–Zhang (2012), Lemma 8, already gives the same empirical probability-vector/Frobenius concentration method for independently sampled observation triples. No first spectral memory test is claimed. Neither this test nor its target constitutes an experimental distinction between Shadow Theory and ordinary quantum theory. At the new noise endpoint, the calculated qubit-cut TV floor is approximately 0.00961570 and the eight-state classical floor is 0.00111370. For one-percent false-rejection risk and at least 99-percent power against the exact target, the sufficient independent four-record trial budgets are 214,080 and 15,958,893, respectively. Each trial costs four emitted records plus its independently prepared stock. These conservative sufficiency budgets are not practical hardware estimates or sample-optimal claims. The supplied synthetic million-trial table rejects the qubit rank cap but does not reject the eight-state cap at the stated threshold, as expected.

Back to top ↑