The proposal, by its nature, is expected to achieve a broad societal impact. The computational frameworks are geared specifically toward proliferating AI technology into our daily life. These developments of human-centered analytics will also help transform the current status-quo in numerous behavior studies by providing a quantification of important internal human states and traits from the angle of computational modeling of measurable multimodal sensory. We imagine such an effort can not only provide a usable tool to expedite the research process but also even to accelerate the scientific discovery in the future. Furthermore, the multimodal signal learning methods help drive and mitigate the current proliferation bottleneck in deploying AI technology rapidly into life.

The database is an open platform of our proposed AI algorithms at the end of the project. With this project, our goal is to bring multimodal signal-based machine intelligence into life, we will accelerate the growth of such a human-centered computing community by organizing source codes with publications and release educational materials for public engagement. Specifically, we will build a paper with code on gitlab and gather state-of-the-art tools used for multimodal data processing and model training as pipelines which can accelerate the diverse AI applications in the whole community. This will come in a form of a platform (website).