Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Feb 24, 2021

• Fix the bias-add and add the layer-norm-eps parameter (#791)

  Show description for e2dfcad
  RezaYazdaniAminabadi

  authored
  e2dfcad

  Copy full SHA for e2dfcad

• Fixing the module-inject Api (#786)

  RezaYazdaniAminabadi

  authored
  48065c0

  Copy full SHA for 48065c0

Commits on Feb 20, 2021

• [doc] fix incorrect param name (#773)

  Show description for e60e92e
  stas00

  authored
  e60e92e

  Copy full SHA for e60e92e

Commits on Feb 19, 2021

• Update engine.py (#767)

  jeffra

  authored
  29fa4b2

  Copy full SHA for 29fa4b2

Commits on Feb 18, 2021

• CPU-Adam fix for scalar mode (#735)

  Show description for ee1ffe2
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  ee1ffe2

  Copy full SHA for ee1ffe2

• Fix transformer kernel CUDA illegal memory access error (#765)

  conglongli

  authored
  1fcc5f7

  Copy full SHA for 1fcc5f7

Commits on Feb 17, 2021

• [dist] set args.local_rank to LOCAL_RANK (#764)

  jeffra

  authored
  68e138b

  Copy full SHA for 68e138b

• Fix NameError: name 'dist' is not defined (#763)

  tma15

  authored
  8067efa

  Copy full SHA for 8067efa

Commits on Feb 16, 2021

• Minor doc tweaks (#761)

  Show description for c28a71f
  tjruwase

  authored
  c28a71f

  Copy full SHA for c28a71f

• Checks for None tensors and skip them when splitting the buckets in zero stage 2. (#728)

  Show description for 7cab55c
  cli99

  authored
  7cab55c

  Copy full SHA for 7cab55c

Commits on Feb 12, 2021

• Activation checkpointing for non-tensor arguments and return values (#741)

  Show description for ec8b1cb
  tjruwase

  authored
  ec8b1cb

  Copy full SHA for ec8b1cb

• [install] add -e/--examples flag to checkout submodules (#755)

  Show description for 7bf1b83
  jeffra

  authored
  7bf1b83

  Copy full SHA for 7bf1b83

• [install] fixes/improvements/docs (#752)

  Show description for 78e776a
  

  stas00

  and

  jeffra

  authored
  78e776a

  Copy full SHA for 78e776a

• Replace timer print rank 0 with logging (#732)

  Show description for 6fb1610
  

  Sean Naren

  and

  jeffra

  authored
  6fb1610

  Copy full SHA for 6fb1610

Commits on Feb 11, 2021

• 1-bit Adam documentation fix (#747)

  Show description for 248f638
  

  conglongli

  and

  jeffra

  authored
  248f638

  Copy full SHA for 248f638

• fix spelling mistake (#749)

  sdtblck

  authored
  1b8ca8e

  Copy full SHA for 1b8ca8e

• Only initialize distributed if required (#734)

  Show description for 59eed17
  

  Sean Naren

  and

  jeffra

  authored
  59eed17

  Copy full SHA for 59eed17

• Add flops profiler tutorial (#682)

  Show description for e2dfe0d
  cli99

  authored
  e2dfe0d

  Copy full SHA for e2dfe0d

Commits on Feb 10, 2021

• Clickable screenshots (#746)

  Show description for 6ee3b29
  tjruwase

  authored
  6ee3b29

  Copy full SHA for 6ee3b29

• 1bit_adam dependencies (#742)

  stas00

  authored
  6beca3c

  Copy full SHA for 6beca3c

Commits on Feb 9, 2021

• Fixed typo in Readme. (#737)

  TheDudeFromCI

  authored
  c5b3f40

  Copy full SHA for c5b3f40

Commits on Feb 8, 2021

• Improve starred expressions (#696)

  Show description for b08aa6f
  

  joneyolfson

  and

  cli99

  authored
  b08aa6f

  Copy full SHA for b08aa6f

Commits on Feb 4, 2021

• [launcher] look ma, no more zombies (#714)

  Show description for 4f1d827
  

  stas00

  and

  jeffra

  authored
  4f1d827

  Copy full SHA for 4f1d827

Commits on Feb 2, 2021

• bump to 0.3.11

  jeffra

  committed
  72b23ea

  Copy full SHA for 72b23ea

Commits on Feb 1, 2021

• local rank of -1 means not set (#720)

  jeffra

  authored
  45c33ee

  Copy full SHA for 45c33ee

• Add executable permission to `ds_elastic` and `ds_report` in `bin`. (#711)

  Show description for 6332e31
  

  joneyolfson

  and

  jeffra

  authored
  6332e31

  Copy full SHA for 6332e31

• properly set engine.local_rank if it's set to -1

  jeffra

  committed
  3cecbc1

  Copy full SHA for 3cecbc1

Commits on Jan 29, 2021

• set_batch_fn and remove old sanity check (#712)

  

  Shaden Smith

  authored
  5e522ef

  Copy full SHA for 5e522ef

• Dist testing backend fixes, etc. (#708)

  jeffra

  authored
  2e2dd86

  Copy full SHA for 2e2dd86

Commits on Jan 27, 2021

• [transformer-kernel] turn off unit test printing (#701)

  jeffra

  authored
  91b1b7f

  Copy full SHA for 91b1b7f

• Update torch16.yml

  jeffra

  authored
  cd29f8b

  Copy full SHA for cd29f8b

• Create torch16.yml (#699)

  jeffra

  authored
  7833aed

  Copy full SHA for 7833aed

Commits on Jan 26, 2021

• Fix wrong idx bug in invertible LayerNormBackward1 (#692)

  Show description for 5221832
  

  Taka152

  and

  Reza Yazdani

  authored
  5221832

  Copy full SHA for 5221832

Commits on Jan 25, 2021

• Add optional timeout parameter to deepspeed.init_distributed (#637)

  Show description for 852c524
  

  sdtblck

  and

  jeffra

  authored
  852c524

  Copy full SHA for 852c524

Commits on Jan 20, 2021

• Fix ZeRO 2 + Pipelining (#677)

  Show description for 34c83a5
  leogao2

  authored
  34c83a5

  Copy full SHA for 34c83a5

Pagination

Previous

Next