Attributes | Values |
---|
rdf:type
| |
Description
| - Recently, a new so-called energy complexity measure has been introduced and studied for feedforward perceptron networks. This measure is inspired by the fact that biological neurons require more energy to transmit a spike than not to fire and the activity of neurons in the brain is quite sparse, with only about 1% of neurons firing. We investigate the energy complexity for recurrent networks which bounds the number of active neurons at any time instant of a computation. We prove that any deterministic finite automaton with m states can be simulated by a neural network of optimal size s=Theta(sqrt{m}) with time overhead O(s/e) per one input bit, using the energy O(e), for any e=Omega(log s) and e=O(s), which shows the time-energy tradeoff in recurrent networks.
- Recently, a new so-called energy complexity measure has been introduced and studied for feedforward perceptron networks. This measure is inspired by the fact that biological neurons require more energy to transmit a spike than not to fire and the activity of neurons in the brain is quite sparse, with only about 1% of neurons firing. We investigate the energy complexity for recurrent networks which bounds the number of active neurons at any time instant of a computation. We prove that any deterministic finite automaton with m states can be simulated by a neural network of optimal size s=Theta(sqrt{m}) with time overhead O(s/e) per one input bit, using the energy O(e), for any e=Omega(log s) and e=O(s), which shows the time-energy tradeoff in recurrent networks. (en)
|
Title
| - A Low-Energy Implementation of Finite Automata by Optimal-Size Neural Nets
- A Low-Energy Implementation of Finite Automata by Optimal-Size Neural Nets (en)
|
skos:prefLabel
| - A Low-Energy Implementation of Finite Automata by Optimal-Size Neural Nets
- A Low-Energy Implementation of Finite Automata by Optimal-Size Neural Nets (en)
|
skos:notation
| - RIV/67985807:_____/13:00392404!RIV14-GA0-67985807
|
http://linked.open...avai/riv/aktivita
| |
http://linked.open...avai/riv/aktivity
| |
http://linked.open...vai/riv/dodaniDat
| |
http://linked.open...aciTvurceVysledku
| |
http://linked.open.../riv/druhVysledku
| |
http://linked.open...iv/duvernostUdaju
| |
http://linked.open...titaPredkladatele
| |
http://linked.open...dnocenehoVysledku
| |
http://linked.open...ai/riv/idVysledku
| - RIV/67985807:_____/13:00392404
|
http://linked.open...riv/jazykVysledku
| |
http://linked.open.../riv/klicovaSlova
| - neural networks; finite automata; energy complexity; optimal size (en)
|
http://linked.open.../riv/klicoveSlovo
| |
http://linked.open...ontrolniKodProRIV
| |
http://linked.open...v/mistoKonaniAkce
| |
http://linked.open...i/riv/mistoVydani
| |
http://linked.open...i/riv/nazevZdroje
| - Artificial Neural Networks and Machine Learning - ICANN 2013
|
http://linked.open...in/vavai/riv/obor
| |
http://linked.open...ichTvurcuVysledku
| |
http://linked.open...cetTvurcuVysledku
| |
http://linked.open...vavai/riv/projekt
| |
http://linked.open...UplatneniVysledku
| |
http://linked.open...iv/tvurceVysledku
| |
http://linked.open...vavai/riv/typAkce
| |
http://linked.open.../riv/zahajeniAkce
| |
issn
| |
number of pages
| |
http://bibframe.org/vocab/doi
| - 10.1007/978-3-642-40728-4_15
|
http://purl.org/ne...btex#hasPublisher
| |
https://schema.org/isbn
| |