Skip to content

Commit

Permalink
Add tips
Browse files Browse the repository at this point in the history
  • Loading branch information
majianjia authored Jun 23, 2021
1 parent 5a5dee5 commit 30b1ca3
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -183,6 +183,11 @@ x = Dense(32)(x)
x = Relu()(x)
~~~

## Tips - improving accuracy
- Attaching an BatchNormalization after each convolutional layer limit the activation range thus help quantisation. BN add no extra computation in NNoM.
- Dont train too much epoch. Large epoch number increases extreme number in activation -> lower the quantisation resolution.
- Leave enough data for bottleneck - do not compress data at before the output of a model, infomation will be lost when it is quantised.

## Contacts
Jianjia Ma
[email protected]
Expand Down

0 comments on commit 30b1ca3

Please sign in to comment.