Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Jul 31, 2024

• Internal change

  Show description for 1982a6b
  

  pculliton

  authored and

  copybara-github

  committed
  1982a6b

  Copy full SHA for 1982a6b

Commits on Jul 30, 2024

• Split matmul into matvec; add large matrix benchmark

  Show description for a24eda8
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  a24eda8

  Copy full SHA for a24eda8

• Extend LayersOutputFunc to take query index and auxillary int

  Show description for d37c088
  

  pchx

  authored and

  copybara-github

  committed
  d37c088

  Copy full SHA for d37c088

• Fix Windows build - macro conflict with param name

  Show description for 8b4915f
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  8b4915f

  Copy full SHA for 8b4915f

• MatMul cleanup: Mat struct, simplify args.

  Show description for 6ea4232
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  6ea4232

  Copy full SHA for 6ea4232

Commits on Jul 29, 2024

• Add Python code for converting Griffin Orbax weights. Refs #301

  Show description for d9f86f8
  

  fischbacher

  authored and

  copybara-github

  committed
  d9f86f8

  Copy full SHA for d9f86f8

• 1.05x prefill speedup: matvec -> matmul for !MHA

  Show description for f276831
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  f276831

  Copy full SHA for f276831

• Add offset arg to MatMul, rename, Matmul for logits = ~1.1x decode speedup

  Show description for 2721f54
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  2721f54

  Copy full SHA for 2721f54

Commits on Jul 25, 2024

• Major revamp #2 of Prefill: fix token order, parallel for multi-query

  Show description for aaf5189
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  aaf5189

  Copy full SHA for aaf5189

Commits on Jul 23, 2024

• Fix setting scales in Py binding

  Show description for c1f243c
  

  The gemma.cpp Authors

  authored and

  copybara-github

  committed
  c1f243c

  Copy full SHA for c1f243c

• Minor polishing: adding comments, renaming variables.

  Show description for 2346b5a
  

  danielkeysers

  authored and

  copybara-github

  committed
  2346b5a

  Copy full SHA for 2346b5a

Commits on Jul 22, 2024

• Fix msan uninitialized scale in optimize_test

  Show description for 33334ad
  

  danielkeysers

  authored and

  copybara-github

  committed
  33334ad

  Copy full SHA for 33334ad

• Use all CPU sockets when pinning threads to cores

  Show description for 74a6dc8
  

  The gemma.cpp Authors

  authored and

  copybara-github

  committed
  74a6dc8

  Copy full SHA for 74a6dc8

Commits on Jul 19, 2024

• Split up ops.h into ops/ops-inl and matmul-inl

  Show description for 85cac13
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  85cac13

  Copy full SHA for 85cac13

• Cleanup: add wrapper functions and rename vars to interleaved

  Show description for 5844e6a
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  5844e6a

  Copy full SHA for 5844e6a

Commits on Jul 18, 2024

• Major Prefill/Generate cleanup, 1.3x Prefill speedup

  Show description for 12016d3
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  12016d3

  Copy full SHA for 12016d3

• Fix msan uninitialized scale

  Show description for 3fe79b3
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  3fe79b3

  Copy full SHA for 3fe79b3

• Add scale parameter to MatMul.

  Show description for e87e65c
  

  danielkeysers

  authored and

  copybara-github

  committed
  e87e65c

  Copy full SHA for e87e65c

Commits on Jul 17, 2024

• Update gemma-27b to the correct query scaling.

  Show description for 5a751a9
  

  danielkeysers

  authored and

  copybara-github

  committed
  5a751a9

  Copy full SHA for 5a751a9

• De-templatize Activations, add RowVectorBatch class

  Show description for 992a2cb
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  992a2cb

  Copy full SHA for 992a2cb

Commits on Jul 16, 2024

• Simplify FFW by using MatMul_4x4_Batch_Add.

  Show description for ff34370
  

  danielkeysers

  authored and

  copybara-github

  committed
  ff34370

  Copy full SHA for ff34370

Commits on Jul 15, 2024

• Fix examples/hello_world for real.

  Show description for 48b900b
  

  pchx

  authored and

  copybara-github

  committed
  48b900b

  Copy full SHA for 48b900b

• Further 1.02x prefill speedup from batch 64->512

  Show description for cd53037
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  cd53037

  Copy full SHA for cd53037

• Fix gemma_cpp/examples/hello_world build.

  Show description for aaee666
  

  pchx

  authored and

  copybara-github

  committed
  aaee666

  Copy full SHA for aaee666

Commits on Jul 12, 2024

• Increase the prefill batch size to 64.

  Show description for c879133
  

  The gemma.cpp Authors

  authored and

  copybara-github

  committed
  c879133

  Copy full SHA for c879133

Commits on Jul 11, 2024

• Improve readability with RepeatedAttentionWindowSizes

  Show description for df3fb70
  

  The gemma.cpp Authors

  authored and

  copybara-github

  committed
  df3fb70

  Copy full SHA for df3fb70

• SVE build fix: avoid capturing vectors directly.

  Show description for edaf61b
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  edaf61b

  Copy full SHA for edaf61b

• Simplify matmul: only 2 overloads

  Show description for be765af
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  be765af

  Copy full SHA for be765af

• Remove allocation from GEMM_4x4_Tile when decoding compressed weights by implementing

  Show description for 3e92088
  

  asandbox

  authored and

  copybara-github

  committed
  3e92088

  Copy full SHA for 3e92088

• Refactor configurables.

  Show description for f519ab6
  

  sherlockwu

  authored and

  copybara-github

  committed
  f519ab6

  Copy full SHA for f519ab6

Commits on Jul 10, 2024

• Record time measurements in MatMul tests.

  Show description for 960ff4b
  

  asandbox

  authored and

  copybara-github

  committed
  960ff4b

  Copy full SHA for 960ff4b

• Fix windows build: min conflict, unused VF

  Show description for ee6e017
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  ee6e017

  Copy full SHA for ee6e017

• Add more comments to attention computation (and some small restructuring).

  Show description for 063bbaa
  

  danielkeysers

  authored and

  copybara-github

  committed
  063bbaa

  Copy full SHA for 063bbaa

Commits on Jul 8, 2024

• Update gemma_test to also pass for the v1.1. models.

  Show description for cf76f0a
  

  danielkeysers

  authored and

  copybara-github

  committed
  cf76f0a

  Copy full SHA for cf76f0a

• Lint fix - string append, remove stale TODO

  Show description for 6a3f7cf
  

  jan-wassenberg

  authored and

  copybara-github

  committed
  6a3f7cf

  Copy full SHA for 6a3f7cf

Pagination

Previous

Next