38 citations · 38 across the 7 of their papers we have counts for
9 papers
Towards a Holodeck-style Simulation Game
Ahad Shams, Douglas Summers-Stay, Arpan Tripathi +3
We introduce Infinitia, a simulation game system that uses generative image and language models at play time to reshape all aspects of the setting and NPCs based on a short descrip…
Gluing Neural Networks Symbolically Through Hyperdimensional Computing
Peter Sutor, Dehao Yuan, Douglas Summers-Stay +2
Hyperdimensional Computing affords simple, yet powerful operations to create long Hyperdimensional Vectors (hypervectors) that can efficiently encode information, be used for learn…
Representing Sets as Summed Semantic Vectors
Douglas Summers-Stay, Peter Sutor, Dandan Li
Representing meaning in the form of high dimensional vectors is a common and powerful tool in biologically inspired architectures. While the meaning of a set of concepts can be sum…
A Computational Theory for Life-Long Learning of Semantics
Peter Sutor, Douglas Summers-Stay, Yiannis Aloimonos
Semantic vectors are learned from data to express semantic relationships between elements of information, for the purpose of solving and informing downstream tasks. Other models ex…
Deductive and Analogical Reasoning on a Semantically Embedded Knowledge Graph
Douglas Summers-Stay
Representing knowledge as high-dimensional vectors in a continuous semantic vector space can help overcome the brittleness and incompleteness of traditional knowledge bases. We pre…
Graphcut Texture Synthesis for Single-Image Superresolution
Douglas Summers-Stay
Texture synthesis has proven successful at imitating a wide variety of textures. Adding additional constraints (in the form of a low-resolution version of the texture to be synthes…
Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering
Yash Goyal, Tejas Khot, Douglas Summers-Stay +2
Problems at the intersection of vision and language are of significant importance both as challenging research questions and for the rich set of applications they enable. However,…
Using a Distributional Semantic Vector Space with a Knowledge Base for Reasoning in Uncertain Conditions
Douglas Summers-Stay, Clare Voss, Taylor Cassidy
The inherent inflexibility and incompleteness of commonsense knowledge bases (KB) has limited their usefulness. We describe a system called Displacer for performing KB queries exte…
Yin and Yang: Balancing and Answering Binary Visual Questions
Peng Zhang, Yash Goyal, Douglas Summers-Stay +2
The complex compositional structure of language makes problems at the intersection of vision and language challenging. But language also provides a strong prior that can result in…