greenline
rgstripes
Otto-Bild Stephan Mertens - Publications
Home | Research | Publications | Teaching | Smorgasbord
greenline

Vapnik-Chervonenkis dimension of neural networks with binary weights

Stephan Mertens and Andreas Engel


Abstract

We investigate the VC-dimension of the perceptron and simple two-layer networks like the committee- and the parity-machine with weights restricted to values $\pm1$. For binary inputs, the VC-dimension is determined by atypical pattern sets, i.e. it cannot be found by replica analysis or numerical Monte Carlo sampling. For small systems, exhaustive enumerations yield exact results. For systems that are too large for enumerations, number theoretic arguments give lower bounds for the VC-dimension. For the Ising perceptron, the VC-dimension is probably larger than $N/2$.


BiBTeX Entry

@article{,
   author    = {Stephan Mertens and Andreas Engel},
   title     = {{V}apnik-{C}hervonenkis dimension of neural networks with binary weights},
   journal   = {Phys.~Rev.~E},
   year      = {1997},
   volume    = {55},
   number    = {4},
   pages     = {4478-4488}
}

Download:
vc2.pdf (PDF, 343 k) or vc2.ps.gz (gzip'ed postscript, 998 k)

greenline
rgstripes
top Home | Research | Publications | Teaching | Smorgasbord
greenline

© by Stephan Mertens
URL: http://
updated on Wednesday, November 05th 2003, 14:05:04 CET;