<!-- llms-explorer concept facts · https://llms-explorer.com/tree/subchannel-bursts-and-bank-interleaving/ · pack 2026-09-30 · ~645 tokens -->

# 16-Bit Sub-Channel Bursts and Non-Sequential Tensor Bank Interleaving

> Source-anchored research for 16-Bit Sub-Channel Bursts and Non-Sequential Tensor Bank Interleaving. Run status: COMPLETED.

Parent: [Local Inference Micro-Architectures: Signaling, Quantization Superblocks, and Kernel Pipeline Scheduling](https://llms-explorer.com/tree/inference-microarchitectures-and-kernel-pipelines/) · 3 facets · 8 facts · page: https://llms-explorer.com/tree/subchannel-bursts-and-bank-interleaving/

## How it works

- Pipelined prefetch engines in GPU memory controllers prioritize full BL32 transfers over chop commands during auto-regressive GEMV passes to maximize bus duty cycle. (high confidence) — [source](https://www.jedec.org/standards-documents/docs/jesd239)
- Each 16-bit sub-channel commands its own bank cycle timing (tRC, tRP, tRCD), allowing concurrent row activations across independent bank groups. (high confidence) — [source](https://www.jedec.org/standards-documents/docs/jesd239)

## Comparisons and alternatives

- Empirical bus utilization during MoE token dispatch increases by 28-35% on GDDR7 compared to GDDR6 32-bit channels due to eliminated bank conflicts. (high confidence) — [source](https://developer.nvidia.com/blog/blackwell-memory-architecture)

## Facts and statements

- GDDR7 divides each 32-bit channel into two independent 16-bit sub-channels, reducing burst payload size to 32 bytes (BL16) or 64 bytes (BL32) per transaction. (high confidence) — [source](https://www.jedec.org/standards-documents/docs/jesd239)
- The 32-byte minimum burst length directly matches L2 cacheline fill requirements for fine-grained tensor activations without fetching unneeded contiguous memory bytes. (high confidence) — [source](https://www.jedec.org/standards-documents/docs/jesd239)
- Non-sequential tensor access in Mixture-of-Experts (MoE) routing and paged KV cache lookup avoids same-bank serialization by distributing lookups across distinct sub-channel queues. (high confidence) — [source](https://developer.nvidia.com/blog/blackwell-memory-architecture)
- Burst Chop mode (BC16) allows early termination of a 32-byte burst transaction to service an urgent pending read, but leaves high-speed PAM3 transceivers idle for 2 UI during turn-around. (high confidence) — [source](https://www.jedec.org/standards-documents/docs/jesd239)
- A standard 256-bit GDDR7 interface provides 16 pseudo-independent 16-bit sub-channels across four 64-bit physical memory controllers. (high confidence) — [source](https://www.jedec.org/standards-documents/docs/jesd239)
