71 citations · 92 across the 8 of their papers we have counts for
9 papers
Simulation Intelligence: Towards a New Generation of Scientific Methods
Alexander Lavin, David Krakauer, Hector Zenil +21
The original "Seven Motifs" set forth a roadmap of essential methods for the field of scientific computing, where a motif is an algorithmic method that captures a pattern of comput…
Fast Stencil-Code Computation on a Wafer-Scale Processor
Kamil Rocki, Dirk Van Essendelft, Ilya Sharapov +7
The performance of CPU-based and GPU-based systems is often low for PDE codes, where large, sparse, and often structured systems of linear equations must be solved. Iterative solve…
Learning to Remember, Forget and Ignore using Attention Control in Memory
T. S. Jayram, Younes Bouhadjar, Ryan L. McAvoy +4
Typical neural networks with external memory do not effectively separate capacity for episodic and working memory as is required for reasoning in humans. Applying knowledge gained…
Utilization of Deep Reinforcement Learning for saccadic-based object visual search
Tomasz Kornuta, Kamil Rocki
The paper focuses on the problem of learning saccades enabling visual object search. The developed system combines reinforcement learning with a neural network for learning to pred…
Surprisal-Driven Zoneout
Kamil Rocki, Tomasz Kornuta, Tegan Maharaj
We propose a novel method of regularization for recurrent neural networks called suprisal-driven zoneout. In this method, states zoneout (maintain their previous value rather than…
Surprisal-Driven Feedback in Recurrent Networks
Kamil M Rocki
Recurrent neural nets are widely used for predicting temporal data. Their inherent deep feedforward structure allows learning complex sequential patterns. It is believed that top-d…
Recurrent Memory Array Structures
Kamil Rocki
The following report introduces ideas augmenting standard Long Short Term Memory (LSTM) architecture with multiple memory cells per hidden unit in order to improve its generalizati…
Towards Machine Intelligence
Kamil Rocki
There exists a theory of a single general-purpose learning algorithm which could explain the principles of its operation. This theory assumes that the brain has some initial rough…
Thinking Required
Kamil Rocki
There exists a theory of a single general-purpose learning algorithm which could explain the principles its operation. It assumes the initial rough architecture, a small library of…