565 citations · 604 across the 13 of their papers we have counts for
13 papers
Text to Robotic Assembly of Multi Component Objects using 3D Generative AI and Vision Language Models
Alexander Htet Kyaw, Richa Gupta, Dhruv Shah +8
Advances in 3D generative AI have enabled the creation of physical objects from text prompts, but challenges remain in creating objects involving multiple component types. We prese…
The Theater Stage as Laboratory: Review of Real-Time Comedy LLM Systems for Live Performance
Piotr Wojciech Mirowski, Boyd Branch, Kory Wallace Mathewson
In this position paper, we review the eclectic recent history of academic and artistic works involving computational systems for humor generation, and focus specifically on live pe…
Designing and Evaluating Dialogue LLMs for Co-Creative Improvised Theatre
Boyd Branch, Piotr Mirowski, Kory Mathewson +2
Social robotics researchers are increasingly interested in multi-party trained conversational agents. With a growing demand for real-world evaluations, our study presents Large Lan…
Over-communicate no more: Situated RL agents learn concise communication protocols
Aleksandra Kalinowska, Elnaz Davoodi, Florian Strub +5
While it is known that communication facilitates cooperation in multi-agent settings, it is unclear how to design artificial agents that can learn to effectively and efficiently co…
Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionals
Piotr Mirowski, Kory W. Mathewson, Jaylen Pittman +1
Language models are increasingly attracting interest from writers. However, such models lack long-range semantic coherence, limiting their usefulness for longform creative writing.…
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448
Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…
The ICML 2022 Expressive Vocalizations Workshop and Competition: Recognizing, Generating, and Personalizing Vocal Bursts
Alice Baird, Panagiotis Tzirakis, Gauthier Gidel +7
The ICML Expressive Vocalization (ExVo) Competition is focused on understanding and generating vocal bursts: laughs, gasps, cries, and other non-verbal vocalizations that are centr…
Learning Robust Real-Time Cultural Transmission without Human Data
Cultural General Intelligence Team, Avishkar Bhoopchand, Bethanie Brownfield +16
Cultural transmission is the domain-general social skill that allows agents to acquire and use information from each other in real-time with high fidelity and recall. In humans, it…
Automatic Embedding of Stories Into Collections of Independent Media
Dylan R. Ashley, Vincent Herrmann, Zachary Friggstad +2
We look at how machine learning techniques that derive properties of items in a collection of independent media can be used to automatically embed stories into such collections. To…
Generating Diverse Realistic Laughter for Interactive Art
M. Mehdi Afsar, Eric Park, Étienne Paquette +3
We propose an interactive art project to make those rendered invisible by the COVID-19 crisis and its concomitant solitude reappear through the welcome melody of laughter, and conn…
Collaborative Storytelling with Human Actors and AI Narrators
Boyd Branch, Piotr Mirowski, Kory W. Mathewson
Large language models can be used for collaborative storytelling. In this work we report on using GPT-3 \cite{brown2020language} to co-narrate stories. The AI system must track plo…
Expressivity of Emergent Language is a Trade-off between Contextual Complexity and Unpredictability
Shangmin Guo, Yi Ren, Kory Mathewson +3
Researchers are using deep learning models to explore the emergence of language in various language games, where agents interact and develop an emergent language to solve tasks. We…
Symbolic Behaviour in Artificial Intelligence
Adam Santoro, Andrew Lampinen, Kory Mathewson +2
The ability to use symbols is the pinnacle of human intelligence, but has yet to be fully replicated in machines. Here we argue that the path towards symbolically fluent artificial…