Timed challenge-response and memory-occupation challenges

R2Demonstrated

In a timed challenge, a verifier sends an unpredictable question that a device can answer in time only if it holds certain data locally or dedicates certain resources to the answer.

Filling a device's memory with verifier-chosen data and then checking random pieces can bound how much spare memory it has. The approach builds on software-based attestation of embedded devices and on proofs of space. AI-specific public work is thin: one design overview, one study on T4 and H100 GPUs showing that response times reveal co-running models and whether data sits in GPU memory, and memory-wiping designs that use such challenges.

As of September 2026, no network-level test across data-centre servers has been reported. The main obstacle is excluding outside help, such as fast remote memory. Timing-based attestation of embedded devices has been broken in practice, and its attackers judged it "very difficult, if not impossible, to design correctly".

Readinessmedium confidence

R2 for detecting whether a GPU is doing other work: published experiments on T4 and H100 GPUs show that challenge response times reveal co-running models and data residency, but only on single GPUs, and no challenge that bounds free memory across servers has been shown.

Rubric assessment

Assessed use: detecting whether a GPU is doing other work

  • R1 met: the MIRI overview describes memory challenges for verifying the presence of information and the absence of free memory, with timing figures and assumptions 1. The AI 2040 plan names memory-challenge verification as a possible direction 2. The underlying primitives (timed attestation, proofs of space and proofs of secure erasure) are peer-reviewed 5 7 8 10.
  • R2 met through reproducible published results. Monfared et al. describe four verifier-issued challenge probes with their parameters and sample counts, under a threat model in which host and GPU firmware "may be modified, virtualized, or colluding" 3. On T4 and H100 GPUs, solve times rise when language models run alongside, and a VRAM-residency challenge separates data in GPU memory from data in host memory by more than 350 ms 3. No code is linked, which the rubric does not require. SAGE shows timed software attestation on A100 GPUs for trusted execution, not for detecting other work 4. The mechanism's only implementation, Low-trust AI compute verification system overview, is a proposed architecture at R1, so the level rests on the research results.
  • R3 not met: no production-grade challenge tool is publicly documented, and no source reports a party other than the authors relying on such challenges for a verification decision. For bounding spare memory (This compute runs inference, not training), the MIRI overview states that, to its author's knowledge, a network-level timing probe of memory contents between servers "has not yet been demonstrated" 1.

Confidence is medium: the results come from one group's single-GPU experiments without quantified error rates.

Gaps to the next level
  • Production-grade challenge tooling, or use by a party other than the developers for a verification decision.
  • A network-level challenge that bounds free memory across accelerator servers, with public code or measurements described in enough detail to repeat.
  • Quantified false-positive and false-negative rates under adversarial conditions.
  • Evaluation against known attack classes on timed attestation, such as compression and relocation.

Assessed 2026-09-25 against rubric v1.1.

On this page

How it works

A timed challenge asks a device something it can answer correctly, within a deadline, only if it holds certain data locally or dedicates certain resources to the answer 1 3 5. Three families of primitives exist:

  • In timed attestation, as in SWATT, the verifier sends a random seed, and the device computes a checksum over its memory in a pseudorandom order 5. If memory has been altered, the extra work shows up as a detectable delay 5.
  • In a proof of space, a prover shows that it dedicates "a significant amount of disk space as opposed to computation" 7. Constructions use graphs that are hard to pebble, and Merkle hash trees 7.
  • Some proofs of secure erasure fill memory and then run timed rounds, accepting only answers that arrive within a round-trip bound 8 9; see Memory wiping and proofs of secure erasure.

For AI facilities, the MIRI system overview describes two uses of memory challenges: "A) verifying presence of information B) verifying the absence of free memory/storage" 1. Response time is the main evidence, because answering from another device is measurably slower 1. The overview cites average NVMe read latencies of a few microseconds against about 100 ns for DRAM 1. For the absence case, incompressible data is loaded until capacity is full, and random samples are challenged 1.

Monfared et al. propose four GPU probes 3:

  • memory-hard puzzles inspired by proof of work, which reveal parallel effort;
  • verifiable-delay-function workloads, which measure sequential execution;
  • matrix-multiplication timing, which reflects tensor-core performance;
  • a VRAM-residency test.

In the residency test, a large challenge dataset is loaded into GPU memory 3. At random times, fresh challenges require keyed, memory-hard computation over it, and response times show whether it is still resident 3.

What it establishes

A capacity-filling challenge that is answered on time bounds how much free memory a device had at that moment 1. Monfared et al. argue that timing variations can expose GPU engagement, complementing other accountability mechanisms 3; see Declared hardware is idle or shut down. The AI 2040 plan says memory-challenge verification "has the promise of potentially also not requiring a hardware retrofit, but seems likely to face some difficulties with verifying completeness" 2.

A presence check does not show that nothing else is stored 1. The overview notes that data could be pre-staged into local memory before a challenge, which only an unpredictable, capacity-filling challenge rules out 1.

Threat model

  • Known device. SWATT's verifier must know the device's clock speed, instruction set, memory architecture and expected memory contents 5.
  • Cryptographic model. Proofs of space are proved secure in the random oracle model, with one additional mild assumption 7.
  • Compromised stack. Monfared et al. consider host and GPU firmware that "may be modified, virtualized, or colluding" 3.
  • No remote helpers. In data centres, remote memory access is the key helper to exclude 1. Its round trips of about 1–2 µs compare with about 70–200 ns for local DRAM, and the overview says verification "depends on the ability to rule out RDMA, either via response latency or physical disconnection" 1.

Evidence

  • GPU contention. Monfared et al. report that proof-of-work-style and verifiable-delay challenges on a T4, and matrix-multiplication challenges on an H100, take longer when language models run alongside, and that larger models cause larger delays 3.
  • GPU memory residency. On an H100 with a 60 GB challenge dataset, Monfared et al. report that the gap between memory-resident and host-resident responses "exceeds 350 ms, making them trivial to distinguish" 3. Their experiments ran on NVIDIA Turing and Hopper GPUs, and they do not quantify error rates 3.
  • GPU attestation. SAGE, a peer-reviewed software-based attestation mechanism for A100 GPUs, is reported by its authors to be "already practical today" for trustworthy execution without special hardware support 4.
  • Memory wiping. Amodo's wiping design includes a timed challenge phase with an assumed 1 ms round trip, but its July 2026 analysis left the challenge-phase calculations for later 9.
  • Across servers. The MIRI overview states that, to its author's knowledge, distinguishing memory contents between servers with a network-level timing probe "has not yet been demonstrated" 1.

Limitations

  • Broken embedded schemes. Castelluccia et al. implemented attacks based on a return-oriented rootkit and on code compression, together with specific attacks on SWATT and ICE-based schemes 6. They conclude that secure time-based attestation is "very difficult, if not impossible, to design correctly" 6. Perito and Tsudik cite such weaknesses as motivation for proofs of secure erasure 10.
  • Coverage. Castelluccia et al. argue that "all memories (RAM, ROM, EEPROM) have to be attested" 6.
  • Overhead. The VRAM-residency test "intentionally incurs substantial memory overhead" 3, and filling a pod's volatile memory takes tens of minutes 1.
  • Unquantified error rates. Monfared et al. do not define thresholds or statistical tests 3.

Known flaws

Published flaws, with their severity, kind and status. How flaws are rated.

  • Timing-based software attestation has been broken in practiceSignificantDemonstrated attackOpen

    Castelluccia et al. implemented two generic attacks, one based on a return-oriented rootkit and one on code compression, together with specific attacks on SWATT and ICE-based schemes, on commodity sensor nodes. They conclude that secure time-based attestation is "very difficult, if not impossible, to design correctly". The attacks target embedded schemes, not AI accelerators.

    Sources: [6]
  • Remote memory narrows the timing marginSignificantTheoretical argumentOpen

    Data-centre remote memory access returns in about 1–2 µs, against about 70–200 ns for local DRAM. The MIRI overview says verification of memory saturation depends on ruling out remote access by latency or physical disconnection. It adds that pre-staging data is ruled out only by unpredictable, capacity-filling challenges.

    Sources: [1]
  • Error rates not quantifiedMinorOpen questionOpen

    Monfared et al. show separable timing distributions but do not define thresholds or statistical tests, so false-positive and false-negative rates are not quantified.

    Sources: [3]

Blockers

Sources

  1. BN. Cankaya (2026). A System Overview for Near-Term, Low-Trust AI Compute Verification. Machine Intelligence Research Institute. Source recordSupports: memory challenging for presence and absence; response-time domains; latencies; fill times; RDMA caveat; pre-staging; not yet demonstrated at network level · §5.1.2
  2. CR. Dean (2026). Verification Plan. AI 2040. Source recordSupports: memory-challenge verification and low-latency challenges as alternative directions · verification overview; other promising directions
  3. BS. K. Monfared et al. (2026). Timing and Memory Telemetry on GPUs for AI Governance. arXiv. Source recordSupports: PoW, VDF, GEMM and VRAM-residency probes; contention results on T4 and H100; H100 residency result; threat model; overhead; FP/FN caveat · abstract; §4–§6; limitations
  4. AA. Ivanov et al. (2023). SAGE: Software-based Attestation for GPU Execution. 2023 USENIX Annual Technical Conference (USENIX ATC 23), pp. 485–499. Source recordSupports: software-based attestation on A100 GPUs · abstract
  5. AA. Seshadri et al. (2004). SWATT: SoftWare-based ATTestation for Embedded Devices. IEEE Symposium on Security and Privacy 2004, pp. 272–282. Source recordSupports: timed checksum attestation; verifier knowledge requirements · abstract; design sections
  6. AC. Castelluccia et al. (2009). On the Difficulty of Software-Based Attestation of Embedded Devices. Proceedings of the 16th ACM Conference on Computer and Communications Security (CCS 2009), pp. 400–409. Source recordSupports: demonstrated attacks on timed attestation; conclusions · abstract; §3–§5
  7. AS. Dziembowski et al. (2015). Proofs of Space. CRYPTO 2015 (IACR Cryptology ePrint Archive 2013/796). Source recordSupports: proofs of space: dedicating disk space instead of computation; construction · abstract
  8. AS. Bursuc et al. (2024). Software-Based Memory Erasure with Relaxed Isolation Requirements. 2024 IEEE 37th Computer Security Foundations Symposium (CSF 2024). Source recordSupports: timed rounds with a round-trip bound in PoSE; peer-reviewed timed PoSE · §3
  9. CAmodo Design (2026). Memory Wipes - Performance Analysis. Amodo Design. Source recordSupports: challenge phase of a PoSE implementation; 1 ms RTT assumption · protocol section
  10. AD. Perito & G. Tsudik (2010). Secure Code Update for Embedded Devices via Proofs of Secure Erasure. Computer Security – ESORICS 2010, LNCS 6345, pp. 643–662. Source recordSupports: peer-reviewed proofs of secure erasure; weaknesses of timed software attestation as motivation · abstract

M-0016JSONSource-checked 2026-09-25 · changed 2026-09-28Suggest an edit

Also called Memory challenges; Memory-occupation challenges; Software-based attestation; Proof-of-space-style challenges

Search

Full search page