Commits

Branch selector

 jetstream-v0.2.3

User selector

All users

Datepicker

All time

Commit History

Commits on Jun 19, 2024

• make sure GPU works (#130)

  Show description for fa1f120
  qihqi

  authored
  fa1f120

  Copy full SHA for fa1f120

Commits on Jun 17, 2024

• Update README.md (#129)

  bhavya01

  authored
  aa90b05

  Copy full SHA for aa90b05

• Update summary.md (#125)

  qihqi

  authored
  7526a90

  Copy full SHA for 7526a90

Commits on Jun 15, 2024

• Update README.md (#128)

  qihqi

  authored
  8bffb5d

  Copy full SHA for 8bffb5d

Commits on Jun 14, 2024

• Update submodules, prepare for leasing v0.2.4 (#127)

  qihqi

  authored
  d8d2da4

  Copy full SHA for d8d2da4

• Add lock in prefill and generate to prevent starvation (#126)

  Show description for dc90aea
  FanhaiLu1

  authored
  dc90aea

  Copy full SHA for dc90aea

• Add different token sampling algorithms to decoder. (#123)

  bvrockwell

  authored
  97aaeae

  Copy full SHA for 97aaeae

Commits on Jun 13, 2024

• Remove JSON config mangling for Gemma ckpt (#124)

  Show description for fe8dbde
  lsy323

  authored
  fe8dbde

  Copy full SHA for fe8dbde

Commits on Jun 12, 2024

• Add activation quantization support to per-channel quantized linear layers (#105)

  Show description for 8a125b6
  lsy323

  authored
  8a125b6

  Copy full SHA for 8a125b6

• add script to isntall for GPU (#122)

  qihqi

  authored
  e2ee7dd

  Copy full SHA for e2ee7dd

Commits on Jun 11, 2024

• Mixtral enablement. (#120)

  Show description for d6bf068
  

  wang2yn84

  and

  qihqi

  authored
  d6bf068

  Copy full SHA for d6bf068

Commits on Jun 10, 2024

• Fix convert_checkpoint.py for hf and gemma (#121)

  qihqi

  authored
  87b8d92

  Copy full SHA for 87b8d92

• Add support for Llama3-70b (#101)

  Show description for 4535bdf
  bhavya01

  authored
  4535bdf

  Copy full SHA for 4535bdf

Commits on Jun 7, 2024

• Add guide on adding HF ckpt conversion support (#119)

  Show description for e07aee6
  lsy323

  authored
  e07aee6

  Copy full SHA for e07aee6

• Support HF LLaMA ckpt conversion (#118)

  Show description for 94b576c
  lsy323

  authored
  94b576c

  Copy full SHA for 94b576c

Commits on Jun 6, 2024

• Integrate disaggregated serving with JetStream (#117)

  Show description for 52ec00f
  FanhaiLu1

  authored
  52ec00f

  Copy full SHA for 52ec00f

Commits on Jun 4, 2024

• Fix conversion bug (#116)

  Show description for 7f6e45f
  yeandy

  authored
  7f6e45f

  Copy full SHA for 7f6e45f

• Add for readme interleave multiple host with ray (#114)

  Show description for f4426c2
  FanhaiLu1

  authored
  f4426c2

  Copy full SHA for f4426c2

• Enable jax profiler server in run with ray (#112)

  Show description for fe328bb
  FanhaiLu1

  authored
  fe328bb

  Copy full SHA for fe328bb

• Metrics bug: server_lib should be config_lib (#113)

  Show description for a32be5d
  Bslabe123

  authored
  a32be5d

  Copy full SHA for a32be5d

Commits on May 31, 2024

• Release JetStream v0.2.2 (#110)

  JoeZijunZhou

  authored
  958678c

  Copy full SHA for 958678c

• Jetstream: 8128c8a -> v0.2.2 (#111)

  Show description for 23fddb5
  Bslabe123

  authored
  23fddb5

  Copy full SHA for 23fddb5

• Add run_server with ray for interleave serving (#109)

  Show description for b234a57
  FanhaiLu1

  authored
  b234a57

  Copy full SHA for b234a57

Commits on May 30, 2024

• Update Jetstream commit id (#108)

  Show description for fac5c8e
  FanhaiLu1

  authored
  fac5c8e

  Copy full SHA for fac5c8e

Commits on May 29, 2024

• Update run_interactive.py with finer control of profiler. (#103)

  wang2yn84

  authored
  1ecf4d7

  Copy full SHA for 1ecf4d7

• Ray Disaggregated Serving MVP (#106)

  Show description for c360158
  FanhaiLu1

  authored
  c360158

  Copy full SHA for c360158

Commits on May 28, 2024

• Fix convert script cannot generate bf16 weights (#104)

  Show description for 57e6fcf
  lsy323

  authored
  57e6fcf

  Copy full SHA for 57e6fcf

• Fix ray conflict changes (#100)

  Show description for 2880904
  FanhaiLu1

  authored
  2880904

  Copy full SHA for 2880904

Commits on May 23, 2024

• Integrates ragged attention to JetStream Pytorch (#93)

  Show description for 517d847
  

  wang2yn84

  and

  lsy323

  authored
  517d847

  Copy full SHA for 517d847

• Pass metrics client config through to Jetstream (#99)

  Show description for 65c39d4
  Bslabe123

  authored
  65c39d4

  Copy full SHA for 65c39d4

Commits on May 22, 2024

• Fix gemma model, enable_weight_quantization is available through quant_config. (#98)

  wang2yn84

  authored
  08c6dc3

  Copy full SHA for 08c6dc3

• Update README.md, the quantize flag is no longer available, quantize_type assumes the role of the original flag. (#97)

  wang2yn84

  authored
  de8d9d8

  Copy full SHA for de8d9d8

• Fix flax and ray dependencies (#96)

  Show description for 4e7085c
  FanhaiLu1

  authored
  4e7085c

  Copy full SHA for 4e7085c

• Enable Blockwise Int4 quantized linear layer (#84)

  Show description for efde000
  lsy323

  authored
  efde000

  Copy full SHA for efde000

Commits on May 20, 2024

• Move flags in scripts to a common function (#92)

  Show description for 0fe239b
  lsy323

  authored
  0fe239b

  Copy full SHA for 0fe239b

Pagination

Previous

Next