-
Notifications
You must be signed in to change notification settings - Fork 4.3k
Post Batch Normalization Statistics
yuxiaoguo edited this page Sep 9, 2016
·
18 revisions
Post batch normalization statistics (PBN) is the CNTK version of how to evaluate the population mean and variance of Batch Normalization which could be used in inference Original Paper.
Although the running statistics of mean and variance, in training, could be used in evaluate or test, there are two factor impacting the statistics accuracy:
PBN is called after all other parameters are frozen, normally after the training.