Overview of the Project
Our projects aim to unveil the cognitive processes in program comprehension as the unique higher cognitive function.
It is mainly consisted of three approaches: brain activity analysis, gaze behavior analysis, and modeling.
As the new projects, we are introducing other modalities, including ECG (not EEG).
Please stay tuned!!
Brain Activity Analysis
We are aiming to unveil the mechanism of neural processing during program comprehension with an fMRI scanner.
We are modeling the process of program comprehension.
Currently, we are using existing attention models for source code like code2vec, etc.
We will evaluate the validity of models through comparison with the gaze behavior of human subjects.
Gaze Behavior Analysis
We are conducting experiments with an eye tracker to elucidate attended components in source code.
brain activity analysis (brain decoding)
machine learning for codes (graph representation learning),
contrasting gaze behavior and
gaze behavior analysis, contrasting gaze behavior and
machine learning (compositionality aware model)
brain activity analysis
gaze behavior and/or ECG
Outline of NAIST Summer School 2018
0. Laptops will be prepared (except for the case you have Matlab in your system).