The implementation of SN can synchronize moving_mean and moving_variance across multi GPUs.
from switch_norm import switch_norm
if you use tf.slim, just replace slim.batch_norm with switch_norm. They share alomost the same parameters.
-
Notifications
You must be signed in to change notification settings - Fork 1
tensorflow implementation of Switch Norm - https://arxiv.org/abs/1806.10779
neuleaf/Switchable_Normalization_TF
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
tensorflow implementation of Switch Norm - https://arxiv.org/abs/1806.10779
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published