3 papers
cs.HC2024
AutoJournaling: A Context-Aware Journaling System Leveraging MLLMs on Smartphone Screenshots
Tianyi Zhang, Shiquan Zhang, Le Fang +3
Journaling offers significant benefits, including fostering self-reflection, enhancing writing skills, and aiding in mood monitoring. However, many people abandon the practice beca…
cs.HC2024
ScreenTK: Seamless Detection of Time-Killing Moments Using Continuous Mobile Screen Text and On-Device LLMs
Le Fang, Shiquan Zhang, Hong Jia +2
Smartphones have become essential to people's digital lives, providing a continuous stream of information and connectivity. However, this constant flow can lead to moments where us…
cs.HC2024
Enabling On-Device LLMs Personalization with Smartphone Sensing
Shiquan Zhang, Ying Ma, Le Fang +3
This demo presents a novel end-to-end framework that combines on-device large language models (LLMs) with smartphone sensing technologies to achieve context-aware and personalized…