ProfDrShoya Ishimaru

Shoya Ishimaru

Shoya Ishimaru is a Project Professor at Osaka Metropolitan University and the CEO of Affectify Inc. He formally worked as a Junior Professor (PI) at the University of Kaiserslautern, a Senior Researcher at the German Research Center for Artificial Intelligence (DFKI), and a Co-Founder CRO at Alphaben. He received his PhD in Engineering at the University of Kaiserslautern and the title of MITOU Super Creator by the Ministry of Economy, Trade, and Industry in Japan. His research interest is to invent new technologies augmenting human intellect [Google Scholar].

Academic Work Experience

2023-*    Project Professor, Osaka Metropolitan University
2014-*    Researcher, Keio Media Design Research Institute
2022-2023 Visiting Associate Professor, Osaka Metropolitan University
2021-2023 Junior Professor (PI), University of Kaiserslautern
2016-2022 Visiting Researcher, Osaka Prefecture University
2016-2019 Research Associate, University of Kaiserslautern

Industrial Work Experience

2023-*    Co-Founder & Chief Executive Officer (CEO), Affectify Inc.
2021-2023 Co-Founder & Chief Research Officer (CRO), Alphaben GbR
2019-2023 Senior Researcher, German Research Center for Artificial Intelligence (DFKI)
2016-2019 Researcher, German Research Center for Artificial Intelligence (DFKI)

Internship, Part-Time Job, and Service

2020-*    Mentor (PM), Mitou Junior
2013-2015 Engineering mentor, Life is Tech, Inc.
     2015 Engineering Internship, Recruit Holdings Co.
     2014 Engineering Internship, Livesense Inc.
     2014 Engineering Internship, Cookpad Inc.
2012-2013 Software Engineer, Campus. Inc.
     2012 Part-time Software Engineer, Paperboy&co. Inc
     2012 Engineering Internship, Hatena Co.


2016-2019 PhD in Engineering, University of Kaiserslautern
“Meta-Augmented Human: From Physical to Cognitive Towards Affective State Recognition”, Reviewers: Prof. Andreas Dengel, Prof. Paul Lukowicz, and Prof. Koichi Kise
2014-2016 Master of Engineering, Graduate School of Engineering, Osaka Prefecture University
“Eyewear Computing for Cognitive Activity Recognition”, Reviewers: Prof. Koichi Kise, Prof. Tomoharu Nakashima, and Prof. Hisao Ishibuchi
2010-2014 Bachelor of Engineering, Osaka Prefecture University
“Activity Recognition with Google Glass: Combining Head Motion and Eye Blink Frequency”, Reviewers: Prof. Koichi Kise and Prof. Kai Kunze
Visiting University of La Rochelle (2015.09-10), University of Kaiserslautern (2013.10-2014.03)

Master Thesis Supervision

2023 Javier Alberto Carrasco Melo, "Automatic classification of difficulty of text from eye gaze and physiological measure of L2 English Speakers"
2023 Rashmi Alur Ramachandra, "User Stress Levels Detection by Physiological Sensing and Deep Learning"
2023 Tanuja Sathyanarayana, "Using Deep Neutral Networks to Predict Engagement in Online Meeting Based on Facial Expression"
2022 Ali Mert İnal, "Effect of Conversational Agents on Learning and Cognitive Load"
2022 Andreas Rohde, "Identifying Confidence and Correctness in Problem-Solving of Graphing Tasks with Eye tracking and Smartpad Data"
2021 Prerna Garg, "A Survey and Evaluation of Sensor Based Multimodal Physiological Datasets for Stress Detection"
2021 Pramod Vadiraja, "Leveraging Machine Learning to Improve Comprehension by Content Personalization Based on the Cognitive State of the Reader"
2020 Arka Sinha, "Object Recognition on Learning Materials with Deep Neural Networks for Document Understanding"
2020 Ann-Sophie Steinert, "Preference-Aware Learning Material with Document Layout Optimization"
2020 Emil Baitemirov, "Automated Detection of Mind Wandering while Reading and Listening Music"
2019 Jan Holub, "Estimating Cognitive Load Using Deep Learning Methods"
2019 Jayasankar Santhosh, "Objective Readability Measurement of Unknown Documents by Generating Artificial Eye Movements"
2018 Iuliia Brishtel, "Mental Workload When Reading From Different Media"
2018 Soumy Jacob, "Predicting Human Perception while Reading using Eye Tracking and Other Metrics"
2018 Jawad Hussain, "Investigating Reading and Skimming Classifier and Its Application in Gaze Oriented Reading"

Bachelor Thesis Supervision

2018 Ann-Sophie Steinert, "Investigation of the Relationship between Reading Order and Reading Behaviour on a Textbook using Eye Tracking"


2022 WS Neurocognitive Computing
2019-22 SS Collaborative Intelligence (Co-lecturing with Prof. Dengel)


2020-2023 Key Researcher, DFG ANR JST International Call on Artificial Intelligence
2020-2022 Co-Investigator, JSPS Fostering Joint International Research (B)
2020-2022 Co-Investigator, JSPS Grant-in-Aid for Scientific Research (B)
2017-2019 Co-Investigator, JSPS Grant-in-Aid for Scientific Research (C)
2017-2019 Representative, JSPS Grant-in-Aid for Young Scientists (B)
     2015 Creator, IPA MITOU Exploratory IT Human Resources Project


2022.09 Co-Organizer for LeCycl 2022
2022.03 Program Committee for Augmented Humans 2022
2021.02 Program Committee for Augmented Humans 2021
2020.03 Program Co-Chair for Augmented Humans 2020
2019.09 Co-Organizer for EyeWild 2019
2019.03 Program Committee for PerPersuasion 2019
2018.10 Program Committee for READ 2018
2015.03 Co-Organizer for Application Developer Festival 2015
Reviewing IMWUT, IEEE Pervasive, IEEE Access, IJDAR, Sensors, Mathematics, IPSJ, CHI, ISWC, IUI, AHs, MobileHCI

Awards and Honorable Activities

2020.04 Best Presentation at Asian CHI Symposium 2020
2019.10 2nd Place at Learning Innovation Grand Prix
2019.05 PhD with an award summa cum laude (with highest praise)
2018.10 Poster Track Honorable Mention at UbiComp/ISWC 2018
2017.07 Gave a talk at TEDxNagouaU
2016.06 Certificated as Super Creator by METI and IPA Japan
2015.11 President's Honor in Osaka Prefecture University
2015.11 Semifinal stage of MashupAwards11
2015.09 Best Presentation Award at Poster Presentation in Osaka Prefecture University:
2015.08 Champion at 2Weeks US Workshop 2015 by Recruit Holdings Co.
2015.07 Champion at JINS MEME HACKATHON Powered by Mashup Awards
2015.04 Best 3 at Japan preliminary round at Imagine Cup 2015 Innovation Path
2014.06 Best Presentation Award at MIRU2014 Young Researchers' Program
2014.06 Audience Award at MIRU2014 Young Researchers' Program
2013.05 3rd place at Super Hackathon 2013 in Osaka
2012.12 Champion at Kyoto Hackathon
2012.11 President's Honor in Osaka Prefecture University
2012.11 Semifinal stage of MashupAwards8
2012.08 Champion at Prototyping Lab, KLab Inc
2012.06 Final stage of Mock App Planning Contest, CyberAgent Inc
2012.01 Champion at Tech-Tokyo, Application Development Contest for Students



Download CV