Estimate — sign in for exact rates.

 Trusted GPU & AI infrastructure since 2015 — Huntsville, AL
[email protected] Track order Support Log in
16 GB GDDR6 · RDNA 4 · gfx1201

AMD Radeon RX 9070 XT 16GB

What this card can do

One card
9B models at 8-bit, 32K context
Windows
Windows preview, lab-measured
Linux
Linux lab alpha, unqualified

How we test and measure →

The RX 9070 XT also advertises 16 GB of GDDR6 memory, but it is not interchangeable with the non-XT RX 9070 or the RDNA 3 RX 7800 XT. The same pinned Qwen3.5-9B Q8 candidate across those pages gives a way to isolate hardware differences in later matched tests, provided driver, prompts, context and active requests are recorded.

This candidate’s 32K context and full-GPU placement are requested settings, not observed fit. Check current free memory and sustained behavior, not only a successful file download or model-load message. Windows and Linux require their own evidence, and no card-specific result is published here.

AMD specifications

Models on this card

Qwen3.8-27B Model page

Bitworks

Bitworks: no recipe for this card yet.

Community

Reported by the community and linked to each original. Results can differ on your system.

Related reports from the same author or project — not independent replication

IQ4_S256 · 1 card · Linux · rainference HIP · 759 tok/s prompt (aggregate) · by rainroar on Blog

Reported on Blog by rainroar — posted 2026-09-12 · measured 2026-09-11 Original report

RX 9070 XT rainference C4 Qwen3.8-27B — DFlash2

Method (as reported): One recorded C4 SSE burst after a different-prompt warmup; cold prefill/no KV reuse; server restarted between warmup and recorded burst.

  • Reported GPU setup RX 9070 XT 16GB (gfx1201)
  • GPU count 1
  • Operating system Linux (Arch Linux; ROCm 7.2.4)
  • Engine rainference working tree; manifests 054/055 applied
  • Backend HIP
  • Model Qwen3.8-27B IQ4_S256
  • Configured context 16,384 tokens
  • Actual input 3,400 tokens
  • Output 512 tokens
  • Full window tested no
  • Reported context Shared 16K paged pool; four slots labelled 4K; 3,400+512 tokens per request.
  • Simultaneous clients 4
  • Server slots 4
  • Workers 1
  • Topology single (One RX 9070 XT; engine compiled for a maximum of four sequences.)
  • Speculative decoding DFlash2 external 1.9B drafter; 2 draft tokens per round
  • Offload other (Input embedding on host (--emb-host); other placement unreported.)
  • CPU Ryzen 9 9900X
  • Memory configuration 60 GB RAM as reported; byte convention unknown
  • Host notes Desktop compositor shared the GPU during the reported run.
  • 98.3 tok/s — other (aggregate across clients) · API server · 4 clients · input 3,400 tokens
    Steady window: 1,947 output tokens over 19.8 s, from last stream's first token to burst end; no prefill outstanding.
  • 81.6 tok/s — other (aggregate across clients) · API server · 4 clients · input 3,400 tokens
    Decode-phase aggregate begins at each stream's first token and includes overlap with unfinished prompt processing.
  • 54.3 tok/s — other (aggregate across clients) · API server · 4 clients · input 3,400 tokens
    Full-burst aggregate uses all 2,048 generated tokens and includes four cold prompt-processing phases.
  • 24.6 tok/s — other (per request) · API server · 4 clients · input 3,400 tokens
    Author-reported per-stream rate for the C4 burst; not a latency percentile.
  • 759 tok/s — prompt speed (aggregate across clients) · API server · 4 clients · input 3,400 tokens
    Aggregate cold prefill across four distinct-prefix prompts; 256-token server-side chunks and no KV reuse.
  • 4.2–17.92 s — time to first token (per request) · API server · 4 clients · input 3,400 tokens
    First-to-last stream TTFT range after simultaneous release; not a percentile.
  • 15.91 GB — memory used (server-wide) · API server · 4 clients · input 3,400 tokens
    Peak VRAM from the author's periodic sampler on the single card.

Not reported: model file checksum, system memory, Public rainference repository, source commit and license, GPU driver version, Main and draft artifact digests and download provenance, Repeated samples, variance and run-order effects, Raw prompt/output bundles behind author-reported digests, Output grading, cancellation and sustained stability, Remaining model and operation placement

  • One self-published author and host; no statistical winner follows from the three arms.
  • Linux custom rainference/HIP evidence only; it does not establish native-Windows or FastLLM behavior.
  • The custom .raif artifacts are not FastLLM catalog GGUFs; engine source, build, license and artifact digests are unverified.
  • Input embeddings are on the host; remaining model and operation placement and dedicated-memory residency are not proven.
  • The engine was compiled for at most four sequences; this is no evidence for C8 behavior.

Setup guide (external)

IQ4_S256 · 1 card · Linux · rainference HIP · 835 tok/s prompt (aggregate) · by rainroar on Blog

Reported on Blog by rainroar — posted 2026-09-12 · measured 2026-09-11 Original report

RX 9070 XT rainference C4 Qwen3.8-27B — in-file MTP

Method (as reported): C4 SSE comparison burst under the same stated workload; cold prefill/no KV reuse; server restart required; repetition count unreported.

  • Reported GPU setup RX 9070 XT 16GB (gfx1201)
  • GPU count 1
  • Operating system Linux (Arch Linux; ROCm 7.2.4)
  • Engine rainference working tree; manifests 054/055 applied
  • Backend HIP
  • Model Qwen3.8-27B IQ4_S256
  • Configured context 16,384 tokens
  • Actual input 3,400 tokens
  • Output 512 tokens
  • Full window tested no
  • Reported context Shared 16K paged pool; four slots labelled 4K; 3,400+512 tokens per request.
  • Simultaneous clients 4
  • Server slots 4
  • Workers 1
  • Topology single (One RX 9070 XT; engine compiled for a maximum of four sequences.)
  • Speculative decoding in-file MTP head
  • Offload other (Input embedding on host (--emb-host); other placement unreported.)
  • CPU Ryzen 9 9900X
  • Memory configuration 60 GB RAM as reported; byte convention unknown
  • Host notes Desktop compositor shared the GPU during the reported run.
  • 96 tok/s — other (aggregate across clients) · API server · 4 clients · input 3,400 tokens
    Steady window starts at the last stream's first token and ends at burst completion; no prefill outstanding.
  • 83 tok/s — other (aggregate across clients) · API server · 4 clients · input 3,400 tokens
    Decode-phase aggregate begins at each stream's first token and includes overlap with unfinished prompt processing.
  • 56.1 tok/s — other (aggregate across clients) · API server · 4 clients · input 3,400 tokens
    Full-burst aggregate uses all 2,048 generated tokens and includes four cold prompt-processing phases.
  • 24 tok/s — other (per request) · API server · 4 clients · input 3,400 tokens
    Author-reported per-stream rate for the C4 burst; not a latency percentile.
  • 835 tok/s — prompt speed (aggregate across clients) · API server · 4 clients · input 3,400 tokens
    Aggregate cold prefill across four distinct-prefix prompts; 256-token server-side chunks and no KV reuse.
  • 3.8–16.29 s — time to first token (per request) · API server · 4 clients · input 3,400 tokens
    First-to-last stream TTFT range after simultaneous release; not a percentile.
  • 15.02 GB — memory used (server-wide) · API server · 4 clients · input 3,400 tokens
    Peak VRAM from the author's periodic sampler on the single card.

Not reported: system memory, Public rainference repository, source commit and license, GPU driver version, Main artifact digest and download provenance, Repeated samples, variance and run-order effects, Raw prompt/output bundles behind author-reported digests, Output grading, cancellation and sustained stability, Remaining model and operation placement

  • One self-published author and host; no statistical winner follows from the three arms.
  • Linux custom rainference/HIP evidence only; it does not establish native-Windows or FastLLM behavior.
  • The custom .raif artifact is not a FastLLM catalog GGUF; engine source, build, license and artifact digest are unverified.
  • Input embeddings are on the host; remaining model and operation placement and dedicated-memory residency are not proven.
  • The engine was compiled for at most four sequences; this is no evidence for C8 behavior.

Setup guide (external)

IQ4_S256 · 1 card · Linux · rainference HIP · 871 tok/s prompt (aggregate) · by rainroar on Blog

Reported on Blog by rainroar — posted 2026-09-12 · measured 2026-09-11 Original report

RX 9070 XT rainference C4 Qwen3.8-27B — no speculation

Method (as reported): C4 SSE comparison burst under the same stated workload; cold prefill/no KV reuse; server restart required; repetition count unreported.

  • Reported GPU setup RX 9070 XT 16GB (gfx1201)
  • GPU count 1
  • Operating system Linux (Arch Linux; ROCm 7.2.4)
  • Engine rainference working tree; manifests 054/055 applied
  • Backend HIP
  • Model Qwen3.8-27B IQ4_S256
  • Configured context 16,384 tokens
  • Actual input 3,400 tokens
  • Output 512 tokens
  • Full window tested no
  • Reported context Shared 16K paged pool; four slots labelled 4K; 3,400+512 tokens per request.
  • Simultaneous clients 4
  • Server slots 4
  • Workers 1
  • Topology single (One RX 9070 XT; engine compiled for a maximum of four sequences.)
  • Speculative decoding none
  • Offload other (Input embedding on host (--emb-host); other placement unreported.)
  • CPU Ryzen 9 9900X
  • Memory configuration 60 GB RAM as reported; byte convention unknown
  • Host notes Desktop compositor shared the GPU during the reported run.
  • 98.2 tok/s — other (aggregate across clients) · API server · 4 clients · input 3,400 tokens
    Steady window starts at the last stream's first token and ends at burst completion; no prefill outstanding.
  • 83.2 tok/s — other (aggregate across clients) · API server · 4 clients · input 3,400 tokens
    Decode-phase aggregate begins at each stream's first token and includes overlap with unfinished prompt processing.
  • 57.6 tok/s — other (aggregate across clients) · API server · 4 clients · input 3,400 tokens
    Full-burst aggregate uses all 2,048 generated tokens and includes four cold prompt-processing phases.
  • 24.6 tok/s — other (per request) · API server · 4 clients · input 3,400 tokens
    Author-reported per-stream rate for the C4 burst; not a latency percentile.
  • 871 tok/s — prompt speed (aggregate across clients) · API server · 4 clients · input 3,400 tokens
    Aggregate cold prefill across four distinct-prefix prompts; 256-token server-side chunks and no KV reuse.
  • 3.72–15.61 s — time to first token (per request) · API server · 4 clients · input 3,400 tokens
    First-to-last stream TTFT range after simultaneous release; not a percentile.
  • 14.26 GB — memory used (server-wide) · API server · 4 clients · input 3,400 tokens
    Peak VRAM from the author's periodic sampler on the single card.

Not reported: system memory, Public rainference repository, source commit and license, GPU driver version, Main artifact digest and download provenance, Repeated samples, variance and run-order effects, Raw prompt/output bundles behind author-reported digests, Output grading, cancellation and sustained stability, Remaining model and operation placement

  • One self-published author and host; no statistical winner follows from the three arms.
  • Linux custom rainference/HIP evidence only; it does not establish native-Windows or FastLLM behavior.
  • The custom .raif artifact is not a FastLLM catalog GGUF; engine source, build, license and artifact digest are unverified.
  • Input embeddings are on the host; remaining model and operation placement and dedicated-memory residency are not proven.
  • The engine was compiled for at most four sequences; this is no evidence for C8 behavior.

Setup guide (external)

Q4_K_M and AD-IQ4_XS-IQ3_S (separate arms) · 1 card · Windows · llama.cpp ROCm/HIP · 24 tok/s (other measure, see details) · 42 tok/s (other measure, see details) · by Ataa Aldaghstani / ataadevs on Blog

Reported on Blog by Ataa Aldaghstani / ataadevs — posted 2026-08-17 Original report

RX 9070 XT Windows Qwen3.8 coding-task MTP comparison

Method (as reported): Same repository-explanation task; q4_0 K/V, FA on, fit off; author averages with timing denominator unspecified.

  • Reported GPU setup RX 9070 XT 16GB
  • GPU count 1
  • Operating system Windows (Windows)
  • Engine llama.cpp
  • Backend ROCm/HIP
  • Model Qwen3.8-27B Q4_K_M and AD-IQ4_XS-IQ3_S (separate arms)
  • Actual input input length not reported
  • Full window tested no
  • Reported context 32,096 Q4 arm; 64,096 mixed-quant arm; occupied input unreported.
  • Simultaneous clients 1
  • Server slots 1
  • Topology single
  • Speculative decoding MTP2
  • CPU Ryzen 7 7800X3D
  • Memory configuration DDR5; capacity unknown
  • Host notes Display on another GPU.
  • 24 tok/s — other (scope not stated) · agent session · 1 client
    Compared with 17 tok/s (Q4_K_M no MTP vs MTP2); reported difference: speculative decoding
    Author average; timing denominator unspecified; Q4_K_M at configured 32,096; repository-explanation task.
    This row: configured context: 32,096 tokens · quantisation: Unsloth Q4_K_M · speculative decoding: MTP2
  • 42 tok/s — other (scope not stated) · agent session · 1 client
    Compared with 27.5 tok/s (AtomicChat mixed quant no MTP vs MTP2); reported difference: speculative decoding
    Author average; timing denominator unspecified; mixed quant at configured 64,096; repository-explanation task.
    This row: configured context: 64,096 tokens · quantisation: AtomicChat AD-IQ4_XS-IQ3_S · speculative decoding: MTP2

Not reported: model file checksum, system memory, Artifact/build digests, Occupied inputs and output counts, Timing denominator, Repetitions/variance, Objective task scoring

  • Q4 arms required mid-task compaction.
  • Mixed-quant MTP quality was judged weaker subjectively.
  • Cross-quant comparison also changes context.
  • Linked setup advice is not adopted or qualified.

Setup guide (external)

custom 2.72 BPW tensor mix · 1 card · Windows · patched llama.cpp Vulkan · 24 tok/s generation · by 7269827-rgb on GitHub

Reported on GitHub by 7269827-rgb Original report

RX 9070 XT custom Qwen3.8 long-context state follow-up

Method (as reported): Post-publication shallow-context empty-/loaded-cache checks; q4_0 K/V and MTP2; state UNCLASSIFIED.

HEAD seen at retrieval: c7abad32e4f2 (not necessarily the commit the author measured)

  • Reported GPU setup RX 9070 XT 16GB
  • GPU count 1
  • Operating system Windows (Windows)
  • Engine patched llama.cpp bf0040e15 lineage; exact archived patch missing
  • Backend Vulkan
  • Model Qwen3.8-27B custom 2.72 BPW tensor mix (7269827-rgb)
  • Configured context 262,144 tokens
  • Actual input input length not reported
  • Full window tested no
  • Reported context 256K is capacity; reported samples were shallow-context, not full-window.
  • Simultaneous clients 1
  • Topology single
  • Speculative decoding MTP2
  • 24 tok/s — generation speed (scope not stated) · 1 client
    Shallow-context empty-cache sample 1/3; state UNCLASSIFIED; 256K configured capacity not occupied.
    This row: configured context: 262,144 tokens · quantisation: custom 2.72 BPW tensor mix · speculative decoding: MTP2
  • 23 tok/s — generation speed (scope not stated) · 1 client
    Shallow-context empty-cache sample 2/3; state UNCLASSIFIED; 256K configured capacity not occupied.
    This row: configured context: 262,144 tokens · quantisation: custom 2.72 BPW tensor mix · speculative decoding: MTP2
  • 25.8 tok/s — generation speed (scope not stated) · 1 client
    Shallow-context empty-cache sample 3/3; state UNCLASSIFIED; 256K configured capacity not occupied.
    This row: configured context: 262,144 tokens · quantisation: custom 2.72 BPW tensor mix · speculative decoding: MTP2
  • 26 tok/s — generation speed (scope not stated) · 1 client
    Shallow-context loaded-cache sample 1/3; state UNCLASSIFIED; 256K configured capacity not occupied.
    This row: configured context: 262,144 tokens · quantisation: custom 2.72 BPW tensor mix · speculative decoding: MTP2
  • 29.3 tok/s — generation speed (scope not stated) · 1 client
    Shallow-context loaded-cache sample 2/3; state UNCLASSIFIED; 256K configured capacity not occupied.
    This row: configured context: 262,144 tokens · quantisation: custom 2.72 BPW tensor mix · speculative decoding: MTP2
  • 26.9 tok/s — generation speed (scope not stated) · 1 client
    Shallow-context loaded-cache sample 3/3; state UNCLASSIFIED; 256K configured capacity not occupied.
    This row: configured context: 262,144 tokens · quantisation: custom 2.72 BPW tensor mix · speculative decoding: MTP2

Not reported: CPU, system memory, Cause of unreproduced fast state, Exact original patch, General quality across tasks, Concurrency

  • Faster campaign headlines did not reproduce reliably.
  • 40K gate speeds used a different binary.
  • 200K sustained figure is a per-problem proxy, not a timed floor.
  • Do not transfer custom quant/attention quality to stock artifacts.

Setup guide (external)

Related link (external)

Related link (external)

Related link (external)

UD-Q4_K_M · 2 cards · Windows · llama.cpp-rdna-lab ROCm/HIP 7.2 · 43.75 tok/s generation · 1799.29 tok/s prompt · by MrLordCat on GitHub

Reported on GitHub by MrLordCat · measured 2026-09-26 Original report

Dual RX 9070 XT Qwen3.8 Windows custom-fork MTP report

Method (as reported): One cold run per cell; FP8 K/V, FA, batch 8192 / ubatch 1024; no warmup or cache reuse.

HEAD seen at retrieval: e648079e8656 (not necessarily the commit the author measured)

  • Reported GPU setup 2 × RX 9070 XT 16GB
  • GPU count 2
  • Operating system Windows (Windows 11)
  • Engine llama.cpp-rdna-lab fea1c3180 plus uncommitted FA change
  • Backend ROCm/HIP 7.2
  • Model Qwen3.8-27B UD-Q4_K_M
  • Configured context 49,152 tokens
  • Actual input 32,996 tokens
  • Output 256 tokens
  • Full window tested no
  • Reported context One cold run per cell; configured window not fully occupied.
  • Simultaneous clients 1
  • Server slots 1
  • Topology dual-split (ROCm1,ROCm0; layer split 1:1; no P2P; PCIe placement unknown.)
  • Speculative decoding MTP n3
  • CPU Ryzen 7 5800X3D
  • System memory 64 GiB
  • 43.75 tok/s — generation speed (per request) · API server · 1 client · input 32,996 tokens
    Compared with 25.74 tok/s (Same custom fork no MTP vs MTP n3); reported difference: speculative decoding
    Single cold L2 Windows HIP cell; 32,996 input / 256 output; custom fork and uncommitted FA change.
    This row: configured context: 49,152 tokens · speculative decoding: MTP n3
  • 1799.29 tok/s — prompt speed (per request) · API server · 1 client · input 32,996 tokens
    Compared with 1879.06 tok/s (Same custom fork no MTP vs MTP n3); reported difference: speculative decoding
    Same one-run L2 Windows HIP comparison; reported prompt processing declined.
    This row: configured context: 49,152 tokens · speculative decoding: MTP n3

Not reported: model file checksum, Exact executable/artifact hashes, Uncommitted change identity, Windows raw receipts unavailable in pinned tree, Repeated-run variance, Concurrent throughput

  • Specialized fork, not stock FastLLM.
  • Do not infer dual-card scaling without a single-card control.
  • Windows/Linux comparisons also change driver and P2P.
  • W24/W26 kernel gains belong to separate Linux research lanes.

Setup guide (external)

Related link (external)

IQ4_XS-v3 · 1 card · Linux · llama.cpp HIP ROCm · 28.41 tok/s generation · 1193 tok/s prompt · by kr4ckhe4d on GitHub

Reported on GitHub by kr4ckhe4d · measured 2026-10-02 Original report

Qwen3.8 llama.cpp build comparison on RX 9070 XT

Method (as reported): ABBA build order; two server loads per build, two deep measures/load plus discarded warmup; Q8 KV, batch 2048, microbatch 1024, FA on.

HEAD seen at retrieval: c18f1bc96ce3 (not necessarily the commit the author measured)

  • Reported GPU setup RX 9070 XT
  • GPU count 1
  • Operating system Linux (CachyOS)
  • Engine llama.cpp HIP build 11345 (a868c3e3c)
  • Backend ROCm
  • Model Qwen3.8-27B IQ4_XS-v3
  • Configured context 32,768 tokens
  • Actual input 16,852 tokens
  • Output 700 tokens
  • Full window tested no
  • Simultaneous clients 1
  • Server slots 1
  • Workers 1
  • Topology single
  • Prefix cache off
  • CPU Ryzen 7 9800X3D
  • Memory configuration 2 x 16 GiB DDR5-6000
  • System memory 32 GiB
  • Memory speed 6000 MT/s
  • 28.41 tok/s — generation speed (per request) · 1 client · input 16,852 tokens
    Compared with 26.84 tok/s (baseline build 7c35571e5; reported a868c3e3c; no MTP); reported difference: engine build
    Deep-input build comparison; Q8_0 KV, flash attention on.
    This row: configured context: 32,768 tokens
  • 1193 tok/s — prompt speed (per request) · 1 client · input 16,852 tokens
    Compared with 959 tok/s (build 7c35571e5 vs a868c3e3c; no MTP); reported difference: engine build
    Same source comparison; prompt cache off.
    This row: configured context: 32,768 tokens

Not reported: exact model digest, serving driver identity, concurrent behavior

  • Single Linux host; not Windows or non-XT RX 9070 evidence.
  • The source's Q3 MTP row uses a different quant and is not included.
  • Build changes were not bisected to an individual kernel.

Related link (external)

Qwen3.8-Flash-Next

Bitworks

Bitworks: no recipe for this card yet.

References

Discussion

Share setups, questions and your own results. Posts are reviewed before they appear. Replies from Bitworks staff are marked.

Log in Create an account to join the discussion.

Bitworks listings for this card