Woomin Song
Graduate student at KAIST
KAIST AI
woominsong0 [AT] gmail.com / woomin.song [AT] kaist.ac.kr
About
I am a Ph.D. student at KAIST advised by Prof. Jinwoo Shin. Formerly, I was an Applied Scientist Intern at Amazon AGI. I received my B.S. in Electrical Engineering / Computer Science (double major) / Mathematics (minor) at KAIST in 2022.
My research aims to build efficient machine learning systems, with a primary focus on large language models (LLMs). I am particularly interested in reducing the inference cost of LLMs. Currently, I am working on architectural modification techniques to adapt existing pre-trained models for improved computational efficiency.
Publications
ExComm: Exploration-Stage Communication for Error-Resilient Agentic Test-Time Scaling
Woomin Song, Beomjun Kim, Daewon Choi, Sai Muralidhar Jayanthi, Saket Dingliwal, Jinwoo Shin, Aram Galstyan
Preprint
IdleSpec: Exploiting Idle-time via Speculative Planning for LLM Agents
Daewon Choi, Kyunghyun Park, Woomin Song, Saket Dingliwal, Sai Muralidhar Jayanthi, Jinwoo Shin, Aram Galstyan
Preprint
RoboAlign: Reinforcement Learning for Action-Aligned Multimodal Large Language Models
Dongyoung Kim, Sumin Park, Woomin Song, Seungku Kim, Taeyoung Kim, Huiwon Jang, Jaehyung Kim, Younggyo Seo, Jinwoo Shin
Preprint
SGD-KV: Summarization Guided KV Cache Compression
Zeyu Liu, Woomin Song,Xuandi Fu, Sai Muralidhar Jayanthi, Vivek Govindan, Aram Galstyan, Sravan Babu Bodapati, Srikanth Ronanki
NeurIPS 2025 Workshop on Efficient Reasoning
Compress, Gather, and Recompute: REFORMing Long-Context Processing in Transformers
Woomin Song, Sai Muralidhar Jayanthi, Srikanth Ronanki, Kanthashree Mysore Sathyendra, Jinwoo Shin, Aram Galstyan, Shubham Katiyar, Sravan Babu Bodapati
NeurIPS 2025
Accelerated Test-Time Scaling with Model-Free Speculative Sampling
Woomin Song, Saket Dingliwal, Sai Muralidhar Jayanthi, Bhavana Ganesh, Jinwoo Shin, Aram Galstyan, Sravan Babu Bodapati
EMNLP 2025, Oral Presentation
Think Clearly: Improving Reasoning via Redundant Token Pruning
Daewon Choi, Jimin Lee, Jihoon Tack, Woomin Song, Saket Dingliwal, Sai Muralidhar Jayanthi, Bhavana Ganesh, Jinwoo Shin, Aram Galstyan, Sravan Babu Bodapati
EMNLP 2025 (Findings)
Mamba Drafters for Speculative Decoding
Daewon Choi, Seunghyuk Oh, Saket Dingliwal, Jihoon Tack, Kyuyoung Kim, Woomin Song, Seojin Kim, Insu Han, Jinwoo Shin, Aram Galstyan, Shubham Katiyar, Sravan Babu Bodapati
EMNLP 2025 (Findings)
Sparsified State-Space Models are Efficient Highway Networks
Woomin Song, Jihoon Tack, Sangwoo Mo, Seunghyuk Oh, Jinwoo Shin
TMLR 2025
NeurIPS Workshop on Efficient Natural Language and Speech Processing (ENLSP-IV), 2024, Oral Presentation
Hierarchical Context Merging: Better Long Context Understanding for Pretrained LLMs
Woomin Song*, Seunghyuk Oh*, Sangwoo Mo, Jaehyung Kim, Sukmin Yun, Jung-Woo Ha, Jinwoo Shin
ICLR 2024
Tabular Transfer Learning via Prompting LLMs
Jaehyun Nam, Woomin Song, Seong Hyeon Park, Jihoon Tack, Sukmin Yun, Jaehyung Kim, Kyu Hwan Oh Jinwoo Shin
COLM 2024
ExComm: Exploration-Stage Communication for Error-Resilient Agentic Test-Time Scaling
Woomin Song, Beomjun Kim, Daewon Choi, Sai Muralidhar Jayanthi, Saket Dingliwal, Jinwoo Shin, Aram Galstyan
Preprint
IdleSpec: Exploiting Idle-time via Speculative Planning for LLM Agents
Daewon Choi, Kyunghyun Park, Woomin Song, Saket Dingliwal, Sai Muralidhar Jayanthi, Jinwoo Shin, Aram Galstyan
Preprint
RoboAlign: Reinforcement Learning for Action-Aligned Multimodal Large Language Models
Dongyoung Kim, Sumin Park, Woomin Song, Seungku Kim, Taeyoung Kim, Huiwon Jang, Jaehyung Kim, Younggyo Seo, Jinwoo Shin
Preprint
SGD-KV: Summarization Guided KV Cache Compression
Zeyu Liu, Woomin Song,Xuandi Fu, Sai Muralidhar Jayanthi, Vivek Govindan, Aram Galstyan, Sravan Babu Bodapati, Srikanth Ronanki
NeurIPS 2025 Workshop on Efficient Reasoning
Compress, Gather, and Recompute: REFORMing Long-Context Processing in Transformers
Woomin Song, Sai Muralidhar Jayanthi, Srikanth Ronanki, Kanthashree Mysore Sathyendra, Jinwoo Shin, Aram Galstyan, Shubham Katiyar, Sravan Babu Bodapati
NeurIPS 2025
Accelerated Test-Time Scaling with Model-Free Speculative Sampling
Woomin Song, Saket Dingliwal, Sai Muralidhar Jayanthi, Bhavana Ganesh, Jinwoo Shin, Aram Galstyan, Sravan Babu Bodapati
EMNLP 2025, Oral Presentation
Think Clearly: Improving Reasoning via Redundant Token Pruning
Daewon Choi, Jimin Lee, Jihoon Tack, Woomin Song, Saket Dingliwal, Sai Muralidhar Jayanthi, Bhavana Ganesh, Jinwoo Shin, Aram Galstyan, Sravan Babu Bodapati
EMNLP 2025 (Findings)
Mamba Drafters for Speculative Decoding
Daewon Choi, Seunghyuk Oh, Saket Dingliwal, Jihoon Tack, Kyuyoung Kim, Woomin Song, Seojin Kim, Insu Han, Jinwoo Shin, Aram Galstyan, Shubham Katiyar, Sravan Babu Bodapati
EMNLP 2025 (Findings)
Sparsified State-Space Models are Efficient Highway Networks
Woomin Song, Jihoon Tack, Sangwoo Mo, Seunghyuk Oh, Jinwoo Shin
TMLR 2025
NeurIPS Workshop on Efficient Natural Language and Speech Processing (ENLSP-IV), 2024, Oral Presentation
Hierarchical Context Merging: Better Long Context Understanding for Pretrained LLMs
Woomin Song*, Seunghyuk Oh*, Sangwoo Mo, Jaehyung Kim, Sukmin Yun, Jung-Woo Ha, Jinwoo Shin
ICLR 2024
Tabular Transfer Learning via Prompting LLMs
Jaehyun Nam, Woomin Song, Seong Hyeon Park, Jihoon Tack, Sukmin Yun, Jaehyung Kim, Kyu Hwan Oh Jinwoo Shin
COLM 2024
Education
M.S./Ph.D. in Artificial IntelligenceSep. 2022 - Present
Korea Advanced Institute of Science and Technology (KAIST)
B.S. in Electrical Engineering, Computer Science and Mathematics (minor)Mar. 2018 - Aug. 2022
Korea Advanced Institute of Science and Technology (KAIST)
GPA: 4.20/4.3 (Summa Cum Laude)
Experience
Honors & Awards
Recipient, National Presidental Scholarship for Science
Dean's List, KAIST College of Engineering (2019F, 2020S, 2020F)
Recipient, Korea Foundation for Advanced Studies (KFAS) Undergrad Scholarship
Recipient, KAIST Alumni Association Scholarship
Recipient, KAIST Presidental Fellowship
Recipient, National Science and Engineering Undergraduate Scholarship