11 papers
Hybrid Intelligence in Cartoon Captioning: Evaluating AI as a Creative Writing Partner
Uğur Önal, Sanem Sariel, Metin Sezgin +2
Crafting cartoon captions requires an understanding of humor, context, and the relationship between image and text. Traditionally, illustrators and writers collaborate to strengthe…
UAV-SEAD: State Estimation Anomaly Dataset for UAVs
Aykut Kabaoglu, Sanem Sariel
Accurate state estimation in Unmanned Aerial Vehicles (UAVs) is crucial for ensuring reliable and safe operation, as anomalies occurring during mission execution may induce discrep…
Comparing Human and AI Performance in Visual Storytelling through Creation of Comic Strips: A Case Study
Uğur Önal, Sanem Sariel, Metin Sezgin +1
This article presents a case study comparing the capabilities of humans and artificial intelligence (AI) for visual storytelling. We developed detailed instructions to recreate a t…
Real-Time Manipulation Action Recognition with a Factorized Graph Sequence Encoder
Enes Erdogan, Eren Erdal Aksoy, Sanem Sariel
Recognition of human manipulation actions in real-time is essential for safe and effective human-robot interaction and collaboration. The challenge lies in developing a model that…
Multimodal Detection and Identification of Robot Manipulation Failures
Arda Inceoglu, Eren Erdal Aksoy, Sanem Sariel
An autonomous service robot should be able to interact with its environment safely and robustly without requiring human assistance. Unstructured environments are challenging for ro…
Learning Failure Prevention Skills for Safe Robot Manipulation
Abdullah Cihan Ak, Eren Erdal Aksoy, Sanem Sariel
Robots are more capable of achieving manipulation tasks for everyday activities than before. But the safety of manipulation skills that robots employ is still an open problem. Cons…
CLUE-AI: A Convolutional Three-stream Anomaly Identification Framework for Robot Manipulation
Dogan Altan, Sanem Sariel
Robot safety has been a prominent research topic in recent years since robots are more involved in daily tasks. It is crucial to devise the required safety mechanisms to enable ser…
A Variational Graph Autoencoder for Manipulation Action Recognition and Prediction
Gamze Akyol, Sanem Sariel, Eren Erdal Aksoy
Despite decades of research, understanding human manipulation activities is, and has always been, one of the most attractive and challenging research topics in computer vision and…
Two-stage training algorithm for AI robot soccer
Taeyoung Kim, Luiz Felipe Vecchietti, Kyujin Choi +2
In multi-agent reinforcement learning, the cooperative learning behavior of agents is very important. In the field of heterogeneous multi-agent reinforcement learning, cooperative…
FINO-Net: A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detection
Arda Inceoglu, Eren Erdal Aksoy, Abdullah Cihan Ak +1
Safe manipulation in unstructured environments for service robots is a challenging problem. A failure detection system is needed to monitor and detect unintended outcomes. We propo…
What went wrong?: Identification of Everyday Object Manipulation Anomalies
Dogan Altan, Sanem Sariel
Extending the abilities of service robots is important for expanding what they can achieve in everyday manipulation tasks. On the other hand, it is also essential to ensure them to…