Derivations of the Enhanced Gradient for the Boltzmann Machine

This technical report is extends the conference paper [1] and the abstract [2] with detailed derivations and proofs. First we recap notation that we use on the Boltzmann machine and its learning. Then we define transformations for the machine where some of its bits are flipped for all samples, and show the equivalence of the transformed model to the original one. Then we show that traditional update rules are not invariant to the transformations, propose a new update rule called theenhanced gradient, and finally show its invariance to the transformations.

Keywords

enhanced gradient, boltzmann machine, sample index

Permanent link to this item

https://urn.fi/URN:NBN:fi:aalto-201704243665

Collections

[report] Perustieteiden korkeakoulu / SCI

Show all metadata

Derivations of the Enhanced Gradient for the Boltzmann Machine

URL

Journal Title

Journal ISSN

Volume Title

Authors

Date

Department

Major/Subject

Mcode

Degree programme

Language

Pages

Series

Abstract

Description

Keywords

Other note

Citation

Permanent link to this item

Collections