Binary Quantization Analysis of Neural Networks Weights on MNIST Dataset

Authors

DOI:

https://doi.org/10.5755/j02.eie.28881

Keywords:

Image classification, Multilayer perceptron, Neural network, Quantization, Source coding

Abstract

This paper considers the design of a binary scalar quantizer of Laplacian source and its application in compressed neural networks. The quantizer performance is investigated in a wide dynamic range of data variances, and for that purpose, we derive novel closed-form expressions. Moreover, we propose two selection criteria for the variance range of interest. Binary quantizers are further implemented for compressing neural network weights and its performance is analysed for a simple classification task. Good matching between theory and experiment is observed and a great possibility for implementation is indicated.

Downloads

Published

2021-08-23

How to Cite

Peric, Z. H., Denic, B. D., Savic, M. S., Vucic, N. J., & Simic, N. B. (2021). Binary Quantization Analysis of Neural Networks Weights on MNIST Dataset. Elektronika Ir Elektrotechnika, 27(4), 55-61. https://doi.org/10.5755/j02.eie.28881

Issue

Section

SIGNAL TECHNOLOGY

Funding data