Skip to main content

Ke-Han Lu

Hi, I am Ke-Han Lu. I am a first-year Ph.D. student at National Taiwan University, Supervised by Prof. Hung-Yi Lee. My research interest are in the area of automatic speech recognition and speech/text fundation models.

Publications​

  1. DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment
    Ke-Han Lu, Zhehuai Chen, Szu-Wei Fu, He Huang, Boris Ginsburg, Yu-Chiang Frank Wang, Hung-yi Lee, 
    InterSpeech 2024
  2. HypR: A comprehensive study for ASR hypothesis revising with a reference corpus
    Yi-Wei Wang, Ke-Han Lu, Kuan-Yu Chen, 
    InterSpeech 2024, Paper, GitHub
  3. Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speech
    Chien-yu Huang, Ke-Han Lu, Shih-Heng Wang, Chi-Yuan Hsiao, Chun-Yi Kuan, Haibin Wu, Siddhant Arora, Kai-Wei Chang, Jiatong Shi, Yifan Peng, Roshan Sharma, Shinji Watanabe, Bhiksha Ramakrishnan, Shady Shehata, Hung-yi Lee, 
    ICASSP 2024, Paper, GitHub
  4. A Context-aware Knowledge Transferring Strategy for CTC-based ASR
    Ke-Han Lu, Kuan-Yu Chen, 
    IEEE SLT 2022, Paper, GitHub
  5. Non-autoregressive ASR Modeling using Pre-trained Language Models for Chinese Speech Recognition
    Fu-Hao Yu, Kuan-Yu Chen, Ke-Han Lu, 
    IEEE/ACM Transactions on Audio, Speech, and Language Processing, Paper
  6. A Transformer-based Cross-modal Fusion Model with Adversarial Training for VQA Challenge 2021
    Ke-Han Lu, Bo-Han Fang, Kuan-Yu Chen, 
    Poster spotlight, VQA workshop, CVPR 2021, Paper, Video, LeaderBoard
  7. ntust-nlp-2 at ROCLING-2021 Shared Task: BERT-based semantic analyzer with word-level information
    Ke-Han Lu, Kuan-Yu Chen, 
    ROCLING 2021: Conference on Computational Linguistics and Speech Processing, Paper
  8. A Preliminary Study of Formosa Speech Recognition Challenge 2020 – Taiwanese ASR
    Fu-Hao Yu, Ke-Han Lu, Yi-Wei Wang, Wei-Zhe Chang, Wei-Kai Huang, Kuan-Yu Chen, 
    International Journal of Computational Linguistics and Chinese Language Processing, Paper

Education​

  • National Taiwan University
    • Ph.D. in Communication Engineering
      • Feb 2024 - Present
  • National Taiwan University of Science and Technology
    • M.S. in Computer Science and Information Engineering
      • Sep 2020 - Feb 2023
    • B.S. in Computer Science and Information Engineering
      • Sep 2016 - Jun 2020

Award​

  • NSTC Graduate Research Fellowship（NSTC-GRF）