35 citations · 49 across the 3 of their papers we have counts for
6 papers
Semiotically-grounded distant viewing of diagrams: insights from two multimodal corpora
Tuomo Hiippala, John A. Bateman
In this article, we bring together theories of multimodal communication and computational methods to study how primary school science diagrams combine multiple expressive resources…
Foundations of the Socio-physical Model of Activities (SOMA) for Autonomous Robotic Agents
Daniel Beßler, Robert Porzel, Mihai Pomarlan +5
In this paper, we present foundations of the Socio-physical Model of Activities (SOMA). SOMA represents both the physical as well as the social context of everyday activities. Such…
Introducing the diagrammatic semiotic mode
Tuomo Hiippala, John A. Bateman
As the use and diversity of diagrams across many disciplines grows, there is an increasing interest in the diagrams research community concerning how such diversity might be docume…
AI2D-RST: A multimodal corpus of 1000 primary school science diagrams
Tuomo Hiippala, Malihe Alikhani, Jonas Haverinen +6
This article introduces AI2D-RST, a multimodal corpus of 1000 English-language diagrams that represent topics in primary school natural sciences, such as food webs, life cycles, mo…
Application-driven automatic subgrammar extraction
Renate Henschel, John A. Bateman
The space and run-time requirements of broad coverage grammars appear for many applications unreasonably large in relation to the relative simplicity of the task at hand. On the ot…
Some apparently disjoint aims and requirements for grammar development environments: the case of natural language generation
John A. Bateman
Grammar development environments (GDE's) for analysis and for generation have not yet come together. Despite the fact that analysis-oriented GDE's (such as ALEP) may include some p…