skip to content
[readonly]

15 packages match "gpt2"

  • total 16
  • drwxr-xr-x-../
  • drwxr-xr-x-Oct 27 01:59@ajax/mesh-ref-gpt2-logits/# 0.1.0 GPT-2's logits helpers: the greedy pick (first largest, FTZ compare) and the FNV-1a 64 digest over every step's logits
  • drwxr-xr-x-Oct 27 01:59@ajax/mesh-ref-gpt2-norm/# 0.1.0 GPT-2's layer normalization of a row: 256-thread strided sums, then the block tree, in Z
  • drwxr-xr-x-Oct 27 01:59@ajax/mesh-ref-gpt2-weights/# 0.1.0 GPT-2 124M synthetic weights from a counter hash: kcheck's checks without a checkpoint
  • drwxr-xr-x-Oct 27 03:26@ajax/mesh-prog-gpt2x/# 0.1.0 gpt2x, GPT-2 124M's exact-mode GPU kernels (embed, norm, GEMM/GEMV, KV, attention, logits) bitwise equal to the CPU reference, as PTX from C
  • drwxr-xr-x-Oct 27 01:59@ajax/mesh-ref-gpt2-kv/# 0.1.0 GPT-2's KV cache: per layer, K and V rows of the full width for each position, and its digest
  • drwxr-xr-x-Oct 27 01:59@ajax/mesh-ref-gpt2-shape/# 0.1.0 GPT-2 124M's shape: layers, heads, widths, vocabulary, context, and the flat weight buffer's layout in checkpoint order
  • drwxr-xr-x-Oct 27 01:59@ajax/mesh-ref-gpt2-linear/# 0.1.0 GPT-2's linear layer, one output row: sequential dots over k from +0 in Z, then bias, bias-GELU or a residual add
  • drwxr-xr-x-Oct 27 01:45@ajax/mesh-abi-view-gpt2x/# 0.1.0 programs/gpt2x's view: GPT-2 exact-mode kernels' parameter block, ops and epilogues
  • drwxr-xr-x-Oct 27 01:59@ajax/mesh-ref-gpt2-attend/# 0.1.0 GPT-2's attention for one head and query: scaled dots, block-tree max and sum, softmax, the 4-group value sum, in Z
  • drwxr-xr-x-Oct 27 01:59@ajax/mesh-ref-gpt2-scalar/# 0.1.0 GPT-2's scalar functions from + - * / in the cluster float mode: exp by a degree-10 polynomial, tanh, the tanh GELU, Newton sqrt
  • drwxr-xr-x-Oct 27 01:59@ajax/mesh-ref-gpt2/# 0.1.0 GPT-2 124M in the cluster float mode on the CPU: the forward pass, prefill and decode, greedy generation, bitwise equal to the GPU kernels
  • drwxr-xr-x-Oct 27 05:23@ajax/mesh-inferd/# 0.1.0 meshd's side of an inference request: which members serve it, the call to their gpt2 worker, the answer
  • drwxr-xr-x-Oct 27 05:23@ajax/mesh-infer-wire/# 0.1.0 The gpt2 service protocol's wire: frames, key=value messages, checksummed KV layers
  • drwxr-xr-x-Oct 27 05:23@ajax/mesh-infer-request/# 0.1.0 An inference request: the control port's infer words and GET /infer's query, parsed; results as text
  • drwxr-xr-x-Oct 27 05:23@ajax/mesh-infer-svc/# 0.1.0 Where each member's inference services listen, and the address one member dials for another's