Devices / NVIDIA Ampere · GA102
GeForce RTX 3090
The large-memory SM86 device and the card the final qualification of every artifact is run on.
SM86 · compute capability 8.6
Qualification
Physically qualified
Bob and Coppelius passed fresh training, continuation, and prediction on this exact profile (R6, 2026-09-21); the Repeat-host Coppelius artifact repeated them here with the R6 predictions (R8, 2026-09-22); the completion-driven host repeated them again in 2.1 / 2.0 / 0.85 s instead of 495 / 495 / 330 s (R9, 2026-09-22). The card reuses each system's SM86 device components; it has no 3090-specific kernel or larger-memory schedule yet.
Driver facts · live
Typed profile
Read at build time from Platform.RunPod.Nvidia.SM86 at 408ac92b. Systems bind to these values by name; none branches on a card name.
| Fact | Value | Alpha definition |
|---|---|---|
| Product identity | NVIDIA GeForce RTX 3090 | runPodRTX3090ProductIdentity |
| Target identity | runpod-nvidia-geforce-rtx3090-sm86 | runPodRTX3090TargetIdentity |
| Compute capability | 8.6 | runPodRTX3090TargetProfile |
| Total video memory | 25,769,803,776 B (24 GiB) | runPodRTX3090TotalVideoMemory |
| QMD architecture | 0x00000086 | runPodSM86QMDArchitecture |
| Compute class | 0x0000C7C0 | runPodSM86ComputeClass |
| SPA version | 0x00000806 | runPodSM86SPAVersion |
Instruction set · 34 typed instructions
Every GPU instruction Alpha can emit for this device
The typed instruction set is SM86InstructionBody in Accelerator.SM86.Instruction; each name links to the line that defines it, each opcode to the line that encodes it. The SASS column is the mnemonic NVIDIA's tools would print for the same encoding. Instructions this device has that Alpha has not yet typed are not listed: Alpha only claims what its compiler can emit and its runtime has executed.
| Alpha name | SASS | Opcode | Meaning | Operands |
|---|---|---|---|---|
SM86MoveConstant | MOV (constant bank) | 0xA02 | destination = c[bank][offset], a 32-bit word from a constant bank. |
|
SM86SpecialToRegister | S2R | 0x919 | destination = a special register (thread or cooperative-thread-array index). |
|
SM86MoveImmediate | MOV (immediate) | 0x802 | destination = a 32-bit immediate. |
|
SM86IntegerMultiplyAddConstant | IMAD (constant bank) | 0xA24 | destination = left * c[bank][offset] + addend, 32-bit integer. |
|
SM86IntegerMultiplyAddImmediate | IMAD (immediate) | 0x824 | destination = left * immediate + addend, 32-bit integer. |
|
SM86IntegerMultiplyAddWideConstant | IMAD.WIDE.U32 | 0x625 | destination pair = left * right + c[bank][offset], a 64-bit product plus a 64-bit constant. |
|
SM86IntegerAddThreeImmediate | IADD3 (immediate) | 0x810 | destination = left + immediate, the three-input adder with one input zero. |
|
SM86IntegerAddThreeRegister | IADD3 (register) | 0x210 | destination = left + right, the three-input adder with one input zero. |
|
SM86ShiftRightImmediate | SHF.R.U32.HI | 0x819 | destination = source logically shifted right by an immediate amount. |
|
SM86LogicThreeInputTruthTable | LOP3.LUT | 0x212 | destination = truthTable(left, right, zero), any bitwise function of the inputs given as an 8-bit lookup table. |
|
SM86IntegerToFloat | I2FP.F32.S32 | 0x245 | destination = the signed 32-bit integer source converted to binary32. |
|
SM86FloatAdd | FADD | 0x221 | destination = left + right, binary32, round to nearest even. |
|
SM86FloatMultiply | FMUL | 0x220 | destination = left * right, binary32, round to nearest even. |
|
SM86FloatFusedMultiplyAdd | FFMA | 0x223 | destination = left * right + addend, binary32 with a single rounding. |
|
SM86MultiFunctionUnitApproximation | MUFU | 0x308 | destination = an approximate transcendental of the source (cosine, sine, exp2, log2, reciprocal, reciprocal square root, square root, tanh) from the multi-function unit. |
|
SM86FloatMinimumOrMaximum | FMNMX | 0x209 | destination = the minimum or the maximum of left and right, binary32. |
|
SM86FloatNegate | FADD (negated source, zero addend) | 0x221 | destination = -source, binary32. |
|
SM86FloatPairToPackedHalfPair | F2FP.PACK_AB | 0x23E | destination = two binary32 sources converted and packed into one register of two binary16 halves. |
|
SM86HalfToFloat | HADD2.F32 | 0x230 | destination = the selected binary16 half of the source widened to binary32. |
|
SM86TensorCoreHalfMatrixMultiplyAccumulate16x8x16Float32 | HMMA.16816.F32 | 0x23C | destination = fragmentA (16x16, binary16) * fragmentB (16x8, binary16) + accumulator (16x8, binary32) on the tensor cores, one warp-wide 16x8x16 tile. |
|
SM86LoadGlobal | LDG.E | 0x981 | destination = the 32-bit word at address + offset in global memory. |
|
SM86LoadGlobalWide | LDG.E.128 | 0x981 | destination quad = the 128 bits at address + offset in global memory. |
|
SM86WarpShuffle | SHFL | 0xF89 | destination = the source register of another lane of the warp, selected by index, up, down or butterfly mode. |
|
SM86LoadShared | LDS | 0x984 | destination = the 32-bit word at address + offset in shared memory. |
|
SM86LoadSharedMatrix | LDSM | 0x83B | destination = one, two or four 8x8 binary16 matrices loaded from shared memory into tensor-core fragment layout, optionally transposed. |
|
SM86StoreShared | STS | 0x388 | the 32-bit value stored at address + offset in shared memory. |
|
SM86BarrierSynchronize | BAR.SYNC | 0xB1D | every thread of the cooperative thread array waits until all have arrived. |
|
SM86StoreGlobal | STG.E | 0x986 | the 32-bit value stored at address + offset in global memory. |
|
SM86StoreGlobalWide | STG.E.128 | 0x986 | the 128-bit value quad stored at address + offset in global memory. |
|
SM86StoreGlobal64 | STG.E.64 | 0x986 | the 64-bit value pair stored at address + offset in global memory. |
|
SM86ReduceGlobalAddFloat32 | RED.E.ADD.F32 | 0x98E | the binary32 value atomically added to the word at address + offset in global memory, no result returned. |
|
SM86PredicateGreaterThanImmediate | ISETP.GT (immediate) | 0x80C | destination predicate = source > immediate, signed 32-bit. |
|
SM86Branch | BRA | 0x947 | continue at the instruction offset bytes away, relative to the next instruction. |
|
SM86Exit | EXIT | 0x94D | this thread finishes the program. |
|
Operand vocabularies
The named values an instruction's operands range over: special registers, execution guards, shuffle modes, half selectors, shared-matrix shapes, multi-function operations, extremum modes, and the scoreboard barriers and yield modes carried by every instruction's SM86Control word (Stall, Yield, WriteBarrier, ReadBarrier, WaitMask, ReuseMask).
SM86SpecialRegister
| Alpha name | SASS | Meaning |
|---|---|---|
SM86CooperativeThreadArrayIdX | SR_CTAID.X | the cooperative thread array (block) index on x. |
SM86CooperativeThreadArrayIdY | SR_CTAID.Y | the cooperative thread array (block) index on y. |
SM86CooperativeThreadArrayIdZ | SR_CTAID.Z | the cooperative thread array (block) index on z. |
SM86ThreadIdX | SR_TID.X | the thread index on x within its cooperative thread array. |
SM86InstructionGuard
| Alpha name | SASS | Meaning |
|---|---|---|
SM86InstructionAlways | — | no guard: the instruction always executes. |
SM86InstructionWhen | @P | the instruction executes only in threads where the predicate is true. |
SM86InstructionWhenNot | @!P | the instruction executes only in threads where the predicate is false. |
SM86ShuffleMode
| Alpha name | SASS | Meaning |
|---|---|---|
SM86ShuffleIndex | SHFL.IDX | read the lane named by the lane operand. |
SM86ShuffleUp | SHFL.UP | read the lane that is lane places below this one. |
SM86ShuffleDown | SHFL.DOWN | read the lane that is lane places above this one. |
SM86ShuffleButterfly | SHFL.BFLY | read the lane whose index is this lane's index xor the lane operand. |
SM86HalfSelector
| Alpha name | SASS | Meaning |
|---|---|---|
SM86LowHalf | — | the low binary16 half (H0) of a 32-bit register. |
SM86HighHalf | — | the high binary16 half (H1) of a 32-bit register. |
SM86MultiFunction
| Alpha name | SASS | Meaning |
|---|---|---|
SM86Cosine | MUFU.COS | cosine of the source, radians. |
SM86Sine | MUFU.SIN | sine of the source, radians. |
SM86ExponentialBase2 | MUFU.EX2 | two raised to the source. |
SM86LogarithmBase2 | MUFU.LG2 | the base-2 logarithm of the source. |
SM86Reciprocal | MUFU.RCP | one divided by the source. |
SM86ReciprocalSquareRoot | MUFU.RSQ | one divided by the square root of the source. |
SM86SquareRoot | MUFU.SQRT | the square root of the source. |
SM86HyperbolicTangent | MUFU.TANH | the hyperbolic tangent of the source. |
SM86FloatExtremum
| Alpha name | SASS | Meaning |
|---|---|---|
SM86FloatMinimum | FMNMX with PT | the smaller of the two operands. |
SM86FloatMaximum | FMNMX with !PT | the larger of the two operands. |
SM86Barrier
| Alpha name | SASS | Meaning |
|---|---|---|
SM86Barrier0 | — | — |
SM86Barrier1 | — | — |
SM86Barrier2 | — | — |
SM86Barrier3 | — | — |
SM86Barrier4 | — | — |
SM86Barrier5 | — | — |
SM86Barrier6 | — | — |
SM86BarrierNone | — | — |
SM86WaitBarrier
| Alpha name | SASS | Meaning |
|---|---|---|
SM86WaitBarrier0 | — | — |
SM86WaitBarrier1 | — | — |
SM86WaitBarrier2 | — | — |
SM86WaitBarrier3 | — | — |
SM86WaitBarrier4 | — | — |
SM86WaitBarrier5 | — | — |
SM86YieldMode
| Alpha name | SASS | Meaning |
|---|---|---|
SM86Continue | — | — |
SM86Yield | — | — |
Profile coverage
What has been measured, and what has not
Three tiers make a fully profiled device. A tier marked not measured lists exactly the fields it will fill so the gap is explicit.
- 1
Driver facts
LiveWhat the resource manager reports and the typed profile binds: product identity, compute capability, video memory, the QMD architecture, compute class and SPA version the command stream is built for.
- product identity
- compute capability
- total video memory
- QMD architecture
- compute class
- SPA version
- UVM / RM / QMD / pushbuffer / GPFIFO admission bits
- 2
Micro-benchmarks
Not measured yetMeasured instruction and memory behaviour, so the compiler can reason about cost from numbers read on this card rather than assumptions.
- issue rate and latency per typed instruction (FFMA, IMAD, MUFU, LDG, STG, LDSM, HMMA…)
- shared-memory bandwidth and bank behaviour
- global-memory bandwidth by access pattern and width
- tensor-core throughput at 16×8×16
- barrier and warp-shuffle cost
- submission, doorbell and semaphore round-trip cost
- sustained clocks under the training workload
- 3
Model-shaped calibration
First readingThe cost of the exact artifacts Alpha emits for each system on this device. End-to-end wall time and the device / waiting / checkpoint-I/O split from the GPU's own semaphore timestamps exist (below); per-kernel costs have not been measured.
- per-kernel time for every launch in Bob's and Coppelius's schedules
- occupancy and register / shared-memory pressure per kernel
- end-to-end step time and its split between host protocol, launches and waits
- memory footprint against the profile's video memory
Measured on this card · 2026-09-22
First model-shaped reading
Read from the retained run record (report); these are readings of Alpha's current artifacts, not the card's limits.
| Reading | Value |
|---|---|
| Coppelius training request (10 AdamW updates, 1,024-token context, 57.7 M parameters) | 2.08 s wall (R9, completion-driven host); 494.7 s with the clock-driven host (R8) |
| Coppelius prediction (three prompts) | 0.85 s wall (R9); 330.0 s (R8) |
| Device busy within the submissions window, from the GPU's own semaphore timestamps | 1.39 s of 1.79 s (78 %) fresh, 1.29 s of 1.73 s (74 %) resume |
| Checkpoint I/O, 328 × 4 MiB chunks, host-stamped | 43 ms fresh, 77 ms resume |
| Device idle gap between consecutive submissions | 0.7–0.9 ms median — the 1 ms poll interval |
| membarrier(GLOBAL) on this host | 6.0 ms per call; replaced by PRIVATE_EXPEDITED (≈ 0 ms) |
| Peak utilization / power / memory | 100 % · 258 W · 1,289 MiB |
| Driver / clocks / power limit as reported | 580.126.09 · SM 2100 MHz · memory 9751 MHz · 350 W |
Sources