Woomin Song
Graduate student at KAIST
KAIST AI
woominsong0 [AT] gmail.com / woomin.song [AT] kaist.ac.kr
About
I am a Ph.D. student at Algorithmic Intelligence Laboratory (ALIN-LAB), advised by Prof. Jinwoo Shin at Korea Advanced Institute of Science and Technology (KAIST). I received my B.S. in Electrical Engineering / Computer Science (double major) / Mathematics (minor) at KAIST in 2022.
My research aims to build efficient machine learning systems, with a primary focus on large language models (LLMs). I am particularly interested in reducing the inference cost of LLMs. Currently, I am working on architectural modification techniques to adapt existing pre-trained models for improved computational efficiency.
Publications
Hierarchical Context Merging: Better Long Context Understanding for Pretrained LLMs
Woomin Song*, Seunghyuk Oh*, Sangwoo Mo, Jaehyung Kim, Sukmin Yun, Jung-Woo Ha, Jinwoo Shin
International Conference on Learning Representations (ICLR), 2024
Semi-supervised Tabular Classification via In-context Learning of Large Language Models
Jaehyun Nam, Woomin Song, Seong Hyeon Park, Jihoon Tack, Sukmin Yun, Jaehyung Kim, Jinwoo Shin
ICML Workshop on Efficient Systems for Foundation Models (ICMLW-ES-FoMo), 2023
Hierarchical Context Merging: Better Long Context Understanding for Pretrained LLMs
Woomin Song*, Seunghyuk Oh*, Sangwoo Mo, Jaehyung Kim, Sukmin Yun, Jung-Woo Ha, Jinwoo Shin
International Conference on Learning Representations (ICLR), 2024
Semi-supervised Tabular Classification via In-context Learning of Large Language Models
Jaehyun Nam, Woomin Song, Seong Hyeon Park, Jihoon Tack, Sukmin Yun, Jaehyung Kim, Jinwoo Shin
ICML Workshop on Efficient Systems for Foundation Models (ICMLW-ES-FoMo), 2023
Education
M.S./Ph.D. in Artificial IntelligenceSep. 2022 - Present
Korea Advanced Institute of Science and Technology (KAIST)
B.S. in Electrical Engineering, Computer Science and Mathematics (minor)Mar. 2018 - Aug. 2022
Korea Advanced Institute of Science and Technology (KAIST)
GPA: 4.20/4.3 (Summa Cum Laude)
Experience
AI Research InternAug. 2021 - Feb. 2022
Laon PeopleHonors & Awards
Recipient, National Presidental Scholarship for Science
Dean's List, KAIST College of Engineering (2019F, 2020S, 2020F)
Recipient, Korea Foundation for Advanced Studies (KFAS) Undergrad Scholarship
Recipient, KAIST Alumni Association Scholarship
Recipient, KAIST Presidental Fellowship
Recipient, National Science and Engineering Undergraduate Scholarship