Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 16, 2021

• Update documentation about Megatron examples (#141)

  Show description for 1fed12e
  

  conglongli

  and

  jeffra

  authored
  1fed12e

  Copy full SHA for 1fed12e

Commits on Nov 13, 2021

• add autotuning hf examples (#146)

  Show description for 2467552
  cli99

  authored
  2467552

  Copy full SHA for 2467552

Commits on Oct 30, 2021

• CL code/doc update (#142)

  conglongli

  authored
  e4d1096

  Copy full SHA for e4d1096

Commits on Oct 25, 2021

• curriculum learning fix (#139)

  conglongli

  authored
  11ca395

  Copy full SHA for 11ca395

Commits on Oct 22, 2021

• fix breaking api (#138)

  conglongli

  authored
  8d01699

  Copy full SHA for 8d01699

Commits on Oct 21, 2021

• rename beginner tutorial

  jeffra

  committed
  255e9ee

  Copy full SHA for 255e9ee

• minor edits to beginner example

  jeffra

  authored
  b33a211

  Copy full SHA for b33a211

• Add self contained beginner example (#137)

  Show description for 269b508
  

  jeffra

  and

  codedecde

  authored
  269b508

  Copy full SHA for 269b508

Commits on Sep 18, 2021

• Add zero stage 2 script

  tjruwase

  committed
  174ae3b

  Copy full SHA for 174ae3b

Commits on Sep 10, 2021

• remove dropout from moe. (#132)

  awan-10

  authored
  24712bd

  Copy full SHA for 24712bd

Commits on Sep 1, 2021

• Disable memory usage profiler (#131)

  tjruwase

  authored
  c1b206c

  Copy full SHA for c1b206c

Commits on Aug 22, 2021

• Fix curriculum learning example config

  Show description for 424cbae
  conglongli

  authored
  424cbae

  Copy full SHA for 424cbae

Commits on Aug 17, 2021

• DeepSpeed MoE Usage Example (#127)

  Show description for 448e191
  

  3 peopleauthored
  448e191

  Copy full SHA for 448e191

Commits on Aug 16, 2021

• Curriculum learning examples (#126)

  conglongli

  authored
  ca278ba

  Copy full SHA for ca278ba

Commits on May 24, 2021

• DS inference examples (#53) (#111)

  Show description for 25d73cf
  

  4 peopleauthored
  25d73cf

  Copy full SHA for 25d73cf

Commits on Apr 29, 2021

• Z3 arg update (#105)

  jeffra

  authored
  1273725

  Copy full SHA for 1273725

Commits on Apr 21, 2021

• 1-bit LAMB optimizer example scripts (#97)

  Show description for f94591e
  conglongli

  authored
  f94591e

  Copy full SHA for f94591e

Commits on Apr 19, 2021

• Add Megatron clarification (#99)

  awan-10

  authored
  d7e23dd

  Copy full SHA for d7e23dd

• ZeRO-Infinity examples (#98)

  Show description for bdf8e59
  

  3 peopleauthored
  bdf8e59

  Copy full SHA for bdf8e59

Commits on Mar 16, 2021

• 1-bit Adam v2 example scripts (#89)

  Show description for 590364d
  conglongli

  authored
  590364d

  Copy full SHA for 590364d

Commits on Mar 10, 2021

• missed PR merge after Init rename (#93)

  

  Shaden Smith

  authored
  20ea07a

  Copy full SHA for 20ea07a

Commits on Mar 8, 2021

• Megatron + ZeRO-3 (#91)

  Show description for 2cd968f
  

  4 peopleauthored
  2cd968f

  Copy full SHA for 2cd968f

Commits on Feb 4, 2021

• Megatron 3D parallelism example (#82)

  

  Shaden Smith

  authored
  1bee84f

  Copy full SHA for 1bee84f

Commits on Feb 1, 2021

• Fix transformer kernel call parameters (#81)

  Show description for fde14be
  RezaYazdaniAminabadi

  authored
  fde14be

  Copy full SHA for fde14be

Commits on Jan 29, 2021

• [mpu] typos (#80)

  Show description for cadc355
  stas00

  authored
  cadc355

  Copy full SHA for cadc355

Commits on Jan 15, 2021

• Add deepspeed for the glue finetuning tasks & bert-large scripts (#77)

  Show description for 400cd1b
  RezaYazdaniAminabadi

  authored
  400cd1b

  Copy full SHA for 400cd1b

Commits on Jan 9, 2021

• additional no-decay keys for deepspeed transformer kernel (#75)

  hxbloom

  authored
  2d4282b

  Copy full SHA for 2d4282b

Commits on Jan 4, 2021

• small fix (#73)

  conglongli

  authored
  c3aa269

  Copy full SHA for c3aa269

Commits on Dec 29, 2020

• add local rank explicitly for mpirun (#72)

  Show description for 4fc7848
  

  szhengac

  and

  Shuai Zheng

  authored
  4fc7848

  Copy full SHA for 4fc7848

Commits on Dec 17, 2020

• updates across examples to use deepspeed.init_distributed() (see #608) (#71)

  jeffra

  authored
  78d69cb

  Copy full SHA for 78d69cb

• modify scripts for fixing the deepspeed-transformer interface (#69)

  RezaYazdaniAminabadi

  authored
  abb2706

  Copy full SHA for abb2706

Commits on Dec 10, 2020

• Fix small mistake in mpi script.

  Show description for 35b4582
  awan-10

  authored
  35b4582

  Copy full SHA for 35b4582

Commits on Nov 21, 2020

• config fixes for one bit adam example (#63)

  conglongli

  authored
  a3cfec7

  Copy full SHA for a3cfec7

Commits on Nov 10, 2020

• PLD Client (#61) (#62)

  Show description for fa1d1a7
  

  tjruwase

  and

  minjiaz

  authored
  fa1d1a7

  Copy full SHA for fa1d1a7

Commits on Oct 30, 2020

• move optimizer when deepspeed is enabled for megatron gpt2 pretraining (#60)

  Show description for a79272c
  RezaYazdaniAminabadi

  authored
  a79272c

  Copy full SHA for a79272c

Pagination

Previous

Next