Chi-Chun Lee (Jeremy) | BIIC Lab - NTHU | 人本訊號運算研究室

HOME

professor

Chi-Chun Lee

(Jeremy)

李祈均

Professor / Associate Chair
Department of Electrical Engineering,
National Tsing Hua University (NTHU), TAIWAN.

Joint Appointment:
§ Academia Sinica - Research Fellow
　▪ Research Center for Information Technology Innovation
§ NTHU - Director
　▪ NVIDIA Cooperation．
　　National Tsing Hua University Joint Innovation Center
§ NTHU - Professor
　▪ Institute of Communication Engineering (ICE)
　▪ College of Semiconductor Research (COSR)
　▪ Biomed AI PhD program (BAI)
　▪ International Intercollegiate PhD Program (IPHD)
　▪ Precision Medicine Ph.D. Program (PMED)

CONTACT

cclee@ee.nthu.edu.tw

Jeremy@Linkedin

Room 868, Delta Hall, NTHU

BIOGRAPHY

PUBLICATION

Chi-Chun Lee (Jeremy) is a Professor and Associate Chair at the Department of Electrical Engineering of the National Tsing Hua University (NTHU), Taiwan, as well as the Director of NVIDIA Corporation · National Tsing Hua University Joint Innovation Center. He received his B.S. degree (magna cum laude), and Ph.D. degree in Electrical Engineering under supervision of Prof. Shri Narayanan from the University of Southern California (USC), USA in 2007 and 2012. He was a data scientist at id:a lab at the ID Analytics in 2013. He is the director of the BIIC lab at NTHU and the director of the NVIDIA-NTHU Innovation Center (2024- ). He also serves as a technical consultant for E.Sun Bank (玉山銀行) (2020-2022) and Allianz Taiwan (安聯人壽) (2021-2023)

His research interests are in speech and language, affective computing, health analytics, and behavior signal processing. He is an IEEE senior member and a ACM and ISCA member. He is an associate editor for the IEEE Transaction on Affective Computing (2020-), the IEEE Transaction on Multimedia (2019-2020), the Journal of Computer Speech and Language (2021-), APSIPA Transactions on Signal and Information Processing (2022-2024). He is a TPC member for APSIPA IVM and MLDA committee. He serves as an general chair for IEEE ASRU 2023, an area chair for INTERSPEECH 2016, 2018, 2019, senior program committee for ACII 2017, 2019, publicity chair for ACM ICMI 2018, late breaking result chair for ACM ICMI 2023, sponsorship and special session chair for ISCSLP 2018, 2020, and a guest editor in Journal of Computer Speech and Language on special issue of Speech and Language Processing for Behavioral and Mental Health. He led a team to the 1st place in Emotion Challenge in INTERSPEECH 2009, and with his students won the 1st place in Styrian Dialect and Baby Sound subchallenge in INTERSPEECH 2019. He is a coauthor on the best paper award/finalist in INTERSPEECH 2008, INTERSPEECH 2010, IEEE EMBC 2018, INTERSPEECH 2018, IEEE EMBC 2019, APSIPA ASC 2019, IEEE EMBC 2020, and the most cited paper published in 2013 in Journal of Speech Communication.

He is a member of Tau Beta Pi, Eta Kappa Nu, and Sigma Xi. He is the recipient of the 112 National Science and Technology Council's Outstanding Research Award (2023) (國家科學與技術委員會：傑出研究獎), the 8th Foundation of Outstanding Scholar's Young Innovator Award (2021) (傑出人才基金會：年輕學者創新獎), the 109 CIEE Outstanding Young Electrical Engineer Award (2020) (中國電機工程學會：優秀青年電機工程師獎), the 2023 IICM K. T. Li Cornerstone Award (2024) and 2020 Young Researcher Award (2020) (中華民國資訊學會：2023 李國鼎磐石獎＆ 2020 李國鼎青年研究獎), the 2024 NTHU Tsing Hua Talent Development Fund Outstanding Research Award (2024) (國立清華大學：傑出人才發展基金－傑出研究獎), the 2020 & 2022 NTHU Industry Collaboration Excellence Award (2021, 2023) (國立清華大學：產學合作績優獎), the 112 NTHU Outstanding Industry Collaboration Award (2023) (國立清華大學：傑出產學研究獎), the 2018 & 2019 MOST Futuretek Breakthrough Award (科技部：未來科技突破獎), the 2019 & 2021 Merry Electroacoustics Thesis Award, the MediaTek Geniusforhome Special Prize Award (top 10 team), and the USC Annenberg Fellowship (2007-2009). His team is selected as one of the 40 Taiwan Tech Star to exhibit in 2019 CES Eureka Park. He is the PI of the MOST AI Grant, and he cofounds the startup AHEAD Medicine. His lab's research has been featured in Discovery, Scientific America, Business Today, Technews, Digitimes, and major news outlet in Taiwan.

13 ‧ Jun ‧ 2023

An Engineering View on Emotions and Speech: From Analysis and Predictive Models to Responsible Human-Centered Applications

27 ‧ Oct ‧ 2021

Deep Representation Learning for Affective Speech Signal Analysis and Processing: Preventing unwanted signal disparities

06 ‧ Sep ‧ 2015

An analysis of the relationship between signal-derived vocal arousal score and human emotion production and perception

01 ‧ Mar ‧ 2014

Computing vocal entrainment: A signal-derived PCA-based quantification scheme with application to affect analysis in married couple interactions

03 ‧ Dec ‧ 2012

Using measures of vocal entrainment to inform outcome-related behaviors in marital conflicts

03 ‧ Sep ‧ 2012

Based on isolated saliency or causal integration? toward a better understanding of human annotation process using multiple instance learning and sequential probability ratio test

01 ‧ Nov ‧ 2011

Emotion recognition using a hierarchical binary decision tree approach

09 ‧ Oct ‧ 2011

Affective state recognition in married couples' interactions using PCA-based vocal entrainment measures with multiple instance learning

27 ‧ Aug ‧ 2011

An Analysis of PCA-based Vocal Entrainment Measures in Married Couples' Affective Spoken Interactions

26 ‧ Sep ‧ 2010

Quantification of prosodic entrainment in affective spontaneous spoken interactions of married couples

14 ‧ Mar ‧ 2010

Predicting interruptions in dyadic spoken interactions

06 ‧ Sep ‧ 2009

Modeling mutual influence of interlocutor emotion states in dyadic spoken interactions

06 ‧ Sep ‧ 2009

Emotion recognition using a hierarchical binary decision tree approach

22 ‧ Sep ‧ 2008

An analysis of multimodal cues of interruption in dyadic spoken interactions

DOWNLOAD

Chi-Chun Lee (Jeremy)'s CV

Publication & Resources

Awards & Honors

2020 IEEE Senior Member (2020)
112 National Science and Technology Council: Outstanding Research Award (2024)
8th Foundation of Outstanding Scholar: Young Innovator Award (2020)
109 Chinese Institute of Electrical Engineering: Outstanding Young Electrical Engineer Award (2020)
2023 Institute of Information & Computing Machinery: K.T. Li Cornerstone Award (2024)
2020 Institute of Information & Computing Machinery: K.T. Li Young Researcher Award (2021)
2024 National Tsing Hua University: Tsing Hua Talent Development Fund Outstanding Research Award (2024)
112 National Tsing Hua University: Outstanding Industry-University Research Award (2023)
2022 National Tsing Hua University: Industry Collaboration Excellence Award (2023)
2020 National Tsing Hua University: Industry Collaboration Excellence Award (2021)
2019 Ministry of Science and Technology: Future Tech Award (2019)
2018 Ministry of Science and Technology: Future Tech Award (2018)
2021 Merry Incorporated: Electroacoustics Thesis Award – Bronze Award (2021)
2019 Merry Incorporated: Electroacoustics Thesis Award – Bronze Award (2019)
2018 MediaTek: Geniusforhome Special Prize Award - Top 10 (2018)
2019 Taiwan Tech Star @ CES Eureka Park (2019)
Most Cited Journal published in 2014 up to 2016 (Journal of Speech Communication)
2007 Magna Cum Laude (2007)
Annenberg Fellowship, University of Southern California (2007-2009)
Undergraduate Dean’s List (2003 – 2007)
2022 ACLCLP Ph.D. and Master's Thesis Award
2020 IEEE EMBC Best Paper (Top 15 Finalists)
2019 APSIPA ASC Best Regular Paper Award
2019 IEEE EMBC Best Paper (Asia Pacific Region)
2018 Interspeech Best Paper Award Candidate (Top 12)
2018 IEEE EMBC Best Paper (Top 15 Finalists)
2010 Interspeech Best Paper Award (Top 3)
2008 Interspeech Student Best Paper Award Candidate (Top 12)
2017 ROCLING Student Best Paper Award Candidate
2019 Interspeech ComParE series Stefan Steidl Computational Paralinguistics Award (Styrian Dialect Sub-Challenge Prize, Baby Sound Sub-Challenge Prize)
2009 Interspeech Emotion Challenge Winner (Classifier Challenge)
Honors Societies: Sigma Xi, Phi Kappa Phi, Tau Beta Pi, Eta Kappa Nu

INVITED TALKS

(update: Oct 2024)

ORGANIZATION

TOPIC

PLACE

DATE

國立清華大學＆日本東北大學 
Trustworthy AI for Responsible Human-centered Applications
NTHU, Hsinchu
2024/11/15
MBI Symposium 
Trustworthy Technology Toward Computing Human’s States and Traits
CMU, Taichung
2024/10/19
國立清華大學｜智慧感知聯網研究中心 
Speech Technology andAffective Computing: from scientific exploration to responsible AI application
NTHU, Hsinchu
2024/07/18
國立臺北醫學大學｜A.I. For ALL 論壇 
A.I. in Life: WHAT'S NEXT?
TMU, Taipei
2024/06/19
國立臺灣大學｜數位社會與健康研討會 
語音科技與情感運算：從科學探索邁向負責任的AI應用
NTU, Taipei
2024/06/03
TAAI 人工智慧論壇 2024 
Privacy-Enhanced Learning for Clinical Health Applications
CGU, Taoyuan
2024/05/24
AIRC at AIST 
Trustworthy Speech-centric AI Technolgy
Tokyo, Japan
2024/03/08
NVIDIA 
Human-centered Machine Intelligence
Hsinchu
2023/11/15

國立新竹中學 
你生氣了嗎？電腦感知情緒的發展與未來
Hsinchu
2023/11/08
智慧感知聯網中心國際交流 
Human-centered Machine Intelligence
UNSW, Australia
2023/10/30
清華大學師資培育中心教師研習營 
AI 時代，語音情緒辨識中的關鍵課題
NTHU, Hsinchu
2023/10/19
國立科學工藝博物館及國家實驗研究院，教師研習活動 
AI 時代，語音情緒辨識的關鍵課題
Kaohsiung
2023/07/26
University of South California 
Affective Speech Modeling in The AI Era
USC
2023/06/29
國家實驗研究院｜精準醫療主題論壇 
深度學習 x 結構與非結構化醫療資料
NTHU
2023/02/16
臺北醫學大學醫學 資訊研究所 
Trustworthy AI: Data, User, and Model
Taipei
2022/11/10
KUIS AI Center at Koç University 
Affective speech modeling and analysis: robustness, generalization, usability
Virtual
2022/11/08

臺中榮民總醫院健康大數據國際研討會 
A Privacy-aware Learning Paradigm Clinical AI
Virtual
2022/09/16
Nvidia 
Deep Learning for Affective Speech Modeling
Virtual
2022/08/09
工研院 台大國發所 
Speech Affective Technology: Progress and Next Step
Virtual
2022/07/28
台灣兒童青少年精神醫學會 
人本人工智慧於兒童青少年精神醫療的運用
Virtual
2022/06/12
台大心理系 
Toward Trustworthy SER
Taipei
2022/04/06
科學人雜誌 
情感怎運算？
Virtual
2022/03/02
陽交大理律學堂 
AI 技術與醫療健康應用
Hsinchu
2022/02/09
東吳大學巨量資料管理學院 (Keynote) 
可信賴人本 AI 運算
Taipei
2021/12/17

台大竹北生醫 (NTUH - Hsinchu) 
Speech Technology for Health Application
Hsinchu
2021/12/10
Bilateral Workshop between Tohoku University and National Tsing Hua University 
Articulatory Phonetic Analysis for Autism
Virtual
2021/11/23
威盛電子 Via Tech 
Multimodal Machine Intelligence for Into-Life AI Technology
Xindian, New Taipei
2021/09/08
Google AI Boot Camp 
Emotion Recognition from Physiology
Virtual
2021/07/08
SNL Japan 
Deep Learning Methods for Speech Emotion Recognition
Virtual
2021/06/13
鴻海 Next Forum 
多模態機器智能於人本運算
Virtual
2021/06/06
高雄榮總 
Multimodal-AI for Health Applications
Virtual
2021/05/07
Apple Inc. 
Computing in-Conversation Behavior Signals for Severity and Differential Diagnosis of ASD
Virtual
2021/03/24

APSIPA ASC (Overview Talk) 
Enabling in-to-life Emotion-AI technology: robustness, scalability, and trustworthiness
Virtual
2020/12/02
Mackay Hospital 
Human-enabled AI: Mechanistically Translating Human Experience into Scalable Decision Analytics
Mackay, Taipei
2020/11/22
人本智能科技論壇 
建構深度模型感知情緒項度與個人特質
SCU, Taiwan
2020/11/07
國衛院(NHRI) 
From variables to deep representations: the key in driving AI-assistive solution for healthcare
Miaoli, Taiwan
2020/10/17
Nvidia GTC 
Emotion sensing with multimodal behavior AI and its applications
Virtual
2020/10/06
調查局 
人工智慧於人類行為與情緒之分析決策應用
Taipei, Taiwan
2020/09/14
台灣金融研訓院 
HR-Tech 實驗專案-AI視頻面試的應用
芬恩特創新聚落
2020/07/22
驊訊電子 
Learning Intelligent Human-Centered Analytics From Multimodal Signals
Taipei, Taiwan
2020/02/06

AIRC at AIST 
Multimodal learning for intelligent human-centered analytics
Tokyo, Japan
2020/01/14
NTHU-EE Tohoku Univ. GSIS Bilateral Workshop 
Speech Analytics for Emotion, Interaction, and Mental Health
NTHU
2019/11/22
臺中榮民總醫院-108 年度健保資料研究四院聯合成果發表會 (Keynote) 
Multimodal Health Analytics Learning for Clinical Applications
台中榮總
2019/11/05
Taiwan-Canada Bilateral Workshop 
Multimodal Learning for Clinical Health Applications
Toronto, Canada
2019/10/30
中央研究院資訊科學所 
Human-Centered AI：Enabling Machines to Sense and Interpret Us
中研院
2019/10/01
人工智慧輔助醫療與倫理、法律、社會:挑戰與因應 
以人為本的人工智能: 讓機器感知並解釋我們
臺大醫院
2019/09/21
AU Optics (友達光電) 
AI 驅使下世代決策應用 : 機器智能與人類行為
Hsinchu, Taiwan
2019/08/15
United Chinese School Committees Association of Malaysia 
Human-Centered AI：Enabling Machines to Sense and Interpret Us
Kuala Lumpur, Malaysia
2019/05/26

老年精神醫學會年會 
AI for behavior computing
NTU
2019/03/10
人工智慧學校 
AI-enabled decision analytics in our daily life
Hsinchu, Taiwan
2019/03/09
NVIDIA deep learning community 
Behavioral Informatics and Interaction Computation Lab
君品飯店
2019/01/17
人工智慧學校 
深度學習應用於醫療行為、政治媒體與電影分析
中研院
2018/12/08
International Symposium on Affective Science and Application (Keynote) 
Advancing emotion AI sensing technology by learning to integrate neuroperceptual information
NCCU
2018/12/10
社政資料治理論壇 
深度學習應用於醫療行為、政治媒體與電影分析
NTU
2018/11/27
Bilateral Workshop between NTHU and Tohoku University GSIS 
Joint neuroperceptual and expressive acoustics modeling for deep vocal emotion decoding
Sendai, Japan
2018/11/16
AI 工作坊：社科院人工智慧初探講座 
Human-Centered AI: Learning Human-centered  Analytics from Multimodal Data
CCU
2018/11/10

台灣精神醫學會 (Keynote) 
AI for Behavior Computing:  Case Studies in Healthcare Applications
CMU
2018/11/03
ACM AVEC 2018 (Keynote) 
Interpersonal Behavior Modeling for Personality, Affect, and Mental States Recognition and Analysis
Seoul, Korea
2018/10/22
人工智慧學校 
AI for Personality, Emotion and Mental States Recognition
Hsinchu, Taiwan
2018/10/06
陽明醫工 
AI for Human-Centered Behavior Analytics: Health Applications
NYMU
2018/09/27
台大醫院精神部 
AI for Human-Centered Behavior Analytics: Health Applications
NTU
2018/09/17
台灣電通 
Sensing and Interpreting Human with AI
台灣電通
2018/08/29
宏盟媒體集團 PHD AI 雲講堂 
情緒運算於數位行銷之應用
三創中心
2018/08/20
人工智慧學校 
Behavior Computing for Emotion and Personality
中研院
2018/08/10

AI MEETUP TAIPEI 
AI for Personality, Emotion and Mental States Recognition
NTU
2018/08/09
APPIER 
Learning Human-Centered Analytics from Multimodal Data: Case Studies in Health Applications
Appier
2018/08/09
林口長庚胸腔內科暨清華大學電機系智慧醫療論壇 
Advancing Clinical Decisions beyond Status-quo with Learnable Analytics
林口長庚紀念醫院
2018/08/04
瑞昱半導體 
Learning Intelligent Human-centered Analytics from Multimodal Behavior Signals
瑞昱
2018/08/02
自強基金會 
語音處理與情緒辨識
NTHU
2018/07/30
IEEE ICME Workshop on Media Analytics for Societal Trend 
A Pilot Study in Deriving Political Stance Representation with User's Profile and Social Media Posting
San Diego, USA
2018/07/23
Rework in Healthcare 
人工智慧醫療診斷分析與應用
Hong Kong
2018/06/08
Artificial intelligence based assistive diagnose and treatment for Autism spectrum disorder 
Behavioral Signal Processing: Multimodal Behavior Computing for Autism Spectrum Disorder
Duke Kunshan University
2018/05/24

台大腦心所 
Learning from Measurable Signals to Compute Human Emotion
臺大醫院
2018/05/01
工研院產業學院 (12小時課程) 
人工智慧於人類行為與情緒之分析決策應用
ITRI
2018/04/23
資策會數位教育研究所 (14小時課程) 
人工智慧醫療診斷分析與應用
台北資策會
2018/03/17
中國醫藥大學 
機器智能與人類行為於醫療應用
中國醫藥大學
2018/04/10
林口長庚醫院巨量資料及統計中心 
機器智能與人類行為於醫療應用
林口長庚紀念醫院
2018/03/27
台灣人智慧學校 
機器智能與人類行為於醫療應用
中研院
2018/03/10
臺灣認知神經科學學會年會 (TSCN) 
A Perspective on using Machine Learning in fMRI Data Modeling:  Human face processing and beyond
中國醫藥大學
2018/01/20
圖書資訊學專題計畫成果發表暨研究發展趨勢研討會 keynote 
大數據分析於資訊行為之研究趨勢
台北科技部院區
2017/12/08

台灣資料科學協會:一日課程 
Emotion-AI: 運用人工智慧實現情緒辨識
中研院
2017/12/16
台灣人工智慧年會 
機器智能與人類行為: 跨領域決策分析於醫療應用
中研院
2017/11/09
Affectiva inc. 
Computational Exploration of Human Emotion Recognition
Boston, USA
2017/10/23
兩岸清華學術交流 
機器智能決策分析於醫療應用
蘇州，中國
2017/10/15
Bilateral Workshop between NTHU and Tohoku University GSIS 
Computing Human Behavior Health Analytics from Speech, Video, and Language
Hsinchu, Taiwan
2017/10/13
大數據於資訊行為分析與應用研討會 keynote 
大數據時代的人類資訊行為研究現況與趨勢
NCCU
2017/09/30
台灣生醫電子工程協會年會 
Behavior Computing for Health Applications
新竹喜來登
2017/04/28
中華民國臨床心理年會 
Deriving Human Behavior Analytics using Audio- Video Data: Recent work in Autism Spectrum Disorder (ASD)
台大
2017/04/23

廣達電腦 
人類行為訊號處理: 新興跨學科(醫療、教育) 研究應用實例分享
廣達
2017/03/30
台中榮總醫學研究部 Big Data 專題演講 
Behavioral Signal Processing: Enabling behavior analytics for Applications in Health and Education
台中榮總
2017/02/22
經濟部 Mix Taiwan 創意 X 技術-知識分享沙龍 
新興人工智慧跨領域研究實例分享
台北、經濟部線上直播
2017/01/18
台灣資料科學協會:一日課程 
人類行為大數據分析:資料科學如何應用在教育及醫療領域
中研院
2017/01/15
台大公衛健康與虛擬社群工作坊 
人類行為訊號處理: 跨學科(教育、醫療)人類行為量化分析之決策工具
台大公衛
2017/12/16
中華民國精算學會年會 
人類行為訊號處理:全新跨學科(教育、醫療)人類行為量化分析之決策工具
世貿會場
2016/11/30
Information Retrieval Workshop 
Exploration in Human Affect Modeling: Engineering Advancements and Next Steps
中研院
2016/11/24
台灣資料科學協會：一日課程 
人類行為大數據分析:資料科學如何應用在教育及醫療領域
中研院
2016/10/30

Bilateral Workshop between NTHU and Tohoku University GSIS 
Deriving Human Behavior Analytics using AudioVideo Data: Challenges and Opportunities
Sendai, Japan
2016/10/25
台灣資料科學年會 
人類行為大數據分析:資料科學如何應用在教育及醫療領域
中研院
2016/07/14
Lorentz Workshop on Interdisciplinary Insights into Small Group and Team Dynamics 
Behavioral Signal Processing
Lorentz Center, Leiden, Netherland
2016/06/29
Speech Processing Workshop (SWS) 
A window into you: BSP effort for quantifying human behaviors across domains of health, education, and psychology
NTU
2016/03/18
Bilateral Workshop between NTHU and Tohoku University GSIS 
Cross-corpora Prosody-based Emotional Arousal Indicator and its Analysis in Affective Human Production-Perception Interplay
Hsinchu, Taiwan
2015/10/28
Taiwan-Japan Symposium on Psychological, Physiological, and Electro-Acoustics 
Prosody-based Emotional Arousal Indicator and its Analysis in Affective Production-Perception Interplay
NTHU
2015/10/23
Bilateral Workshop between NTHU and Tohoku University GSIS 
Behavioral Signal Processing: An interdisciplinary effort in modeling human behaviors with applications in domains of behavior science
Sendai, Japan
2014/10/21
Speech Processing Workshop (SWS) 
Understanding Dyadic Human Spoken Interactions Using Speech Processing Techniques: Case studies in Autism Spectrum Disorder (ASD) and behavioral Couple Therapy
台北大學
2014/08/01

BIICERS