センサを使って学習者の心的状態 (興味・認知負荷・理解に対する確信度) を推定し学習者に合わせた情報を提示する電子教科書「HyperMind」を開発しています。最適化されたインタラクションを通じて、学習者はより没頭して、興味深く教科書を読み進めることができます。
Online Demo at Augmented Humans 2021
関連する対外発表
- Pramod Vadiraja, Andreas Dengel and Shoya Ishimaru. “Text Summary Augmentation for Intelligent Reading Assistant”. In Proceedings of the 2nd Augmented Humans International Conference (AHs '21), pp. 319–321, 2021. BibTeX PDF
- Shoya Ishimaru, Syed Saqib Bukhari, Carina Heisel, Nicolas Großmann, Pascal Klein, Jochen Kuhn and Andreas Dengel. “Augmented Learning on Anticipating Textbooks with Eye Tracking”. In Positive Learning in the Age of Information (PLATO), pp. 387–398, 2018. BibTeX
- Shoya Ishimaru, Ko Watanabe, Nicolas Großmann, Carina Heisel, Pascal Klein, Yutaka Arakawa, Jochen Kuhn and Andreas Dengel. “HyperMind Builder: Pervasive User Interface to Create Intelligent Interactive Documents”. In Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication (UbiComp '18 Adjunct), pp. 357–360, 2018. BibTeX PDF
- Shoya Ishimaru, Soumy Jacob, Apurba Roy, Syed Saqib Bukhari, Carina Heisel, Nicolas Großmann, Michael Thees, Jochen Kuhn and Andreas Dengel. “Cognitive State Measurement on Learning Materials by Utilizing Eye Tracker and Thermal Camera”. In Proceedings of the 14th IAPR International Conference on Document Analysis and Recognition (ICDAR HDI '17), pp. 32–36, 2017. BibTeX PDF
- Shoya Ishimaru, Syed Saqib Bukhari, Carina Heisel, Jochen Kuhn and Andreas Dengel. “Towards an Intelligent Textbook: Eye Gaze Based Attention Extraction on Materials for Learning and Instruction in Physics”. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication (UbiComp '16 Adjunct), pp. 1041–1045, 2016. BibTeX PDF