Summary
Overview
A confidence-gated HBM controller uses telemetry, uncertainty bounds, and thrash budgets to decide when speculative residency actions are safe.
Abstract
Technical Abstract
The system forecasts near-term object reuse from page faults, DMA activity, stall time, allocator state, fragmentation indicators, and memory pressure. HBM is partitioned into pinned, speculative, staging, and reserve regions, and prefetch, pin, eviction, and compaction are permitted only while fault and churn budgets remain within policy.
Search Context
SEO Keywords
HBM residency patent, memory prefetch patent, accelerator memory patent, thrash budget patent, fragmentation aware memory patent
Related Patents
More Patents in memory residency, KV systems, and deterministic inference
These filings sit nearby in the portfolio and strengthen internal linking across related patent topics.