Sukwon Yun

Ph.D. Student, UNC Chapel Hill

swyun@cs.unc.edu

Bio

I am a first-year Ph.D. student in the UNITES Lab at University of North Carolina, Chapel Hill, where I am fortunate to be advised by Prof. Tianlong Chen. Prior to UNC, I obtained an M.S. in ISysE at KAIST, advised by Prof. Chanyoung Park. During my Master's, I was honored with the Best Paper Award at the ICML WCB 2023 and spent wonderful time in Tokyo as a visiting researcher at Tokyo Tech, working with Prof. Tsuyoshi Murata and, Dr. Xin Liu.

My current research intersts ile in AI4Science and Multi-Agent LLMs. Specifically, I am interested in (A) addressing the inductive bias-key to the success-of LLMs, GNNs, and MoE with their (B) application in the field of Computational Biology. Additionally, I have recently been focusing on (C) communication strategies among Multi-Agent LLMs to achieve collaborative synergy.

News

  • Oct., 2024     Two preprints released; Check out AgentPrune (Multi-agent Communication Pruning), and PortLLM (Training-free Personalized LLM).
  • Sep., 2024     A paper got accepted at NeurIPS 2024 as Spotlight Presentation - Flexible Modality Learning.
  • Sep., 2024     A paper got accepted at EMNLP 2024 Findings - LLM + KG for AD.
  • Aug., 2024     Our paper, “Subgraph Federated Learning for Local Generalization” won the Best Paper Award at KDD 2024 workshop on Federated Learning for Data Mining and Graph Analytics!
  • Jul., 2024     A paper got accepted at KDD 2024 workshop on Federated Learning for Data Mining and Graph Analytics.
  • Jul., 2024     A paper got accepted at ECCV 2024 - Multiplexed Immunofluorescence Image Analysis.
  • Apr., 2024     A paper got accepted at Briefings in Bioinformatics 2024 - Single-cell Imputation + FP.
  • Apr., 2024     A paper got accepted at WWW 2024 Workshop on Data-centric Artificial Intelligence (DCAI).
  • Mar., 2024     I will be joining UNITES Lab@UNC Chapel Hill this Fall as a Ph.D. Student!
  • Jan., 2024     A paper got accepted at PAKDD 2024 - Feature + Structure Noise in Graph.
  • Oct., 2023     I served as a session chair in the Knowledge Representation 3 session at CIKM 2023.
  • Aug., 2023     Two papers got accepted at CIKM 2023.
  • Jul., 2023     Our paper, “Single-cell RNA-seq data imputation using Feature Propagation” won the Best Paper Award at ICML 2023 Workshop on Computational Biology!
  • Jun., 2023     A paper got accepted for a contributed talk at ICML 2023 Workshop on Computational Biology. Excited to give a talk at Honolulu, Hawai’i!
  • Apr., 2023     A paper got accepted at SIGIR 2023.
  • Aug., 2022     A paper got accepted at CIKM 2022.
  • Jul., 2022     I will be joining Tokyo Tech this Fall-Winter as a visting researcher under supervision of Prof. Tsuyoshi Murata. Looking forward to it!
  • Aug., 2021     I joined DSAIL@KAIST as a Master Student!

    • Publications

    Most recent publications on Google Scholar.
    * indicates equal contribution.

    PortLLM: Personalizing Evolving Large Language Models with Training-Free and Portable Model Patches

    Rana Muhammad Shahroz Khan, Pingzhi Li*, Sukwon Yun*, Zhenyu Wang, Shahriar Nirjon, Chau-Wai Wong, Tianlong Chen

    arXiv 2024

    Paper

    Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems

    Guibin Zhang, Yanwei Yue, Zhixun Li, Sukwon Yun, Guancheng Wan, Kun Wang, Dawei Cheng, Jeffrey Xu Yu, Tianlong Chen

    arXiv 2024

    Paper Code

    Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Experts

    Sukwon Yun, Inyoung Choi, Jie Peng, Yangfan Wu, Jingxuan Bao, Qiyiwen Zhang, Jiayi Xin, Qi Long, Tianlong Chen

    NeurIPS 2024 (Spotlight)

    Paper Code

    DALK: Dynamic Co-Augmentation of LLMs and KG to answer Alzheimer's Disease Questions with Scientific Literature

    Dawei Li, Shu Yang, Zhen Tan, Jae Young Baik, Sukwon Yun, Joseph Lee, Aaron Chacko, Bojian Hou, Duy Duong-Tran, Ying Ding, Huan Liu, Li Shen, Tianlong Chen

    EMNLP 2024 Findings

    Paper Code

    Subgraph Federated Learning for Local Generalization

    Sungwon Kim, Yoonho Lee, Yunhak Oh, Namkyeong Lee, Sukwon Yun, Junseok Lee, Sein Kim, Carl Yang, Chanyoung Park

    KDD 2024 Workshop on Federated Learning for Data Mining and Graph Analytics (FedKDD) (Best Paper Award)

    Paper

    Mew: Multiplexed Immunofluorescence Image Analysis through an Efficient Multiplex Network

    Sukwon Yun, Jie Peng, Alexandro Trevino, Chanyoung Park, Tianlong Chen

    ECCV 2024

    Paper Code

    Single-cell RNA Sequencing Data Imputation Using Bi-level Feature Propagation

    Junseok Lee*, Sukwon Yun*, Yeongmin Kim, Tianlong Chen, Manolis Kellis, Chanyoung Park

    Briefings in Bioinformatics 2024

    Paper Code

    Noise Robust Graph Learning under Feature-Dependent Graph-Noise

    Yeonjun In, Kanghoon Yoon, Sukwon Yun, Kibum Kim, Sungchul Kim, Chanyoung Park

    WWW 2024 Workshop on Data-centric Artificial Intelligence (DCAI) (Oral)

    Paper

    DEGNN: Dual Experts Graph Neural Network Handling Both Edge and Node Feature Noise

    Tai Hasegawa, Sukwon Yun, Xin Liu, Yin Jun Phua, Tsuyoshi Murata

    PAKDD 2024

    Paper Code

    MUSE: Music Recommender System with Shuffle Play Recommendation Enhancement

    Yunhak Oh*, Sukwon Yun*, Dongmin Hyun, Sein Kim, Chanyoung Park

    CIKM 2023

    Paper Code

    S-Mixup: Structural Mixup for Graph Neural Networks

    Junghurn Kim*, Sukwon Yun*, Chanyoung Park

    CIKM 2023 Short

    Paper Code

    Single-cell RNA-seq data imputation using Feature Propagation

    Sukwon Yun*, Junseok Lee*, Chanyoung Park

    ICML 2023 Workshop on Computational Biology (Best Paper Award)

    Paper Code

    MELT: Mutual Enhancement of Long-Tailed User and Item for Sequential Recommendation

    Kibum Kim, Dongmin Hyun, Sukwon Yun, Chanyoung Park

    SIGIR 2023

    Paper Code

    LTE4G: Long-Tail Experts for Graph Neural Networks

    Sukwon Yun, Kibum Kim, Kanghoon Yoon, Chanyoung Park

    CIKM 2022

    Paper Code

    PortLLM: Personalizing Evolving Large Language Models with Training-Free and Portable Model Patches

    Rana Muhammad Shahroz Khan, Pingzhi Li*, Sukwon Yun*, Zhenyu Wang, Shahriar Nirjon, Chau-Wai Wong, Tianlong Chen

    arXiv 2024

    Paper

    Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems

    Guibin Zhang, Yanwei Yue, Zhixun Li, Sukwon Yun, Guancheng Wan, Kun Wang, Dawei Cheng, Jeffrey Xu Yu, Tianlong Chen

    arXiv 2024

    Paper Code

    Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Experts

    Sukwon Yun, Inyoung Choi, Jie Peng, Yangfan Wu, Jingxuan Bao, Qiyiwen Zhang, Jiayi Xin, Qi Long, Tianlong Chen

    NeurIPS 2024 (Spotlight)

    Paper Code

    DALK: Dynamic Co-Augmentation of LLMs and KG to answer Alzheimer's Disease Questions with Scientific Literature

    Dawei Li, Shu Yang, Zhen Tan, Jae Young Baik, Sukwon Yun, Joseph Lee, Aaron Chacko, Bojian Hou, Duy Duong-Tran, Ying Ding, Huan Liu, Li Shen, Tianlong Chen

    EMNLP 2024 Findings

    Paper Code

    Subgraph Federated Learning for Local Generalization

    Sungwon Kim, Yoonho Lee, Yunhak Oh, Namkyeong Lee, Sukwon Yun, Junseok Lee, Sein Kim, Carl Yang, Chanyoung Park

    KDD 2024 Workshop on Federated Learning for Data Mining and Graph Analytics (FedKDD) (Best Paper Award)

    Paper

    Mew: Multiplexed Immunofluorescence Image Analysis through an Efficient Multiplex Network

    Sukwon Yun, Jie Peng, Alexandro Trevino, Chanyoung Park, Tianlong Chen

    ECCV 2024

    Paper Code

    Single-cell RNA Sequencing Data Imputation Using Bi-level Feature Propagation

    Junseok Lee*, Sukwon Yun*, Yeongmin Kim, Tianlong Chen, Manolis Kellis, Chanyoung Park

    Briefings in Bioinformatics 2024

    Paper Code

    Noise Robust Graph Learning under Feature-Dependent Graph-Noise

    Yeonjun In, Kanghoon Yoon, Sukwon Yun, Kibum Kim, Sungchul Kim, Chanyoung Park

    WWW 2024 Workshop on Data-centric Artificial Intelligence (DCAI) (Oral)

    Paper

    DEGNN: Dual Experts Graph Neural Network Handling Both Edge and Node Feature Noise

    Tai Hasegawa, Sukwon Yun, Xin Liu, Yin Jun Phua, Tsuyoshi Murata

    PAKDD 2024

    Paper Code

    MUSE: Music Recommender System with Shuffle Play Recommendation Enhancement

    Yunhak Oh*, Sukwon Yun*, Dongmin Hyun, Sein Kim, Chanyoung Park

    CIKM 2023

    Paper Code

    S-Mixup: Structural Mixup for Graph Neural Networks

    Junghurn Kim*, Sukwon Yun*, Chanyoung Park

    CIKM 2023 Short

    Paper Code

    Single-cell RNA-seq data imputation using Feature Propagation

    Sukwon Yun*, Junseok Lee*, Chanyoung Park

    ICML 2023 Workshop on Computational Biology (Best Paper Award)

    Paper Code

    MELT: Mutual Enhancement of Long-Tailed User and Item for Sequential Recommendation

    Kibum Kim, Dongmin Hyun, Sukwon Yun, Chanyoung Park

    SIGIR 2023

    Paper Code

    LTE4G: Long-Tail Experts for Graph Neural Networks

    Sukwon Yun, Kibum Kim, Kanghoon Yoon, Chanyoung Park

    CIKM 2022

    Paper Code

    Mentee

    Haiyun Lyu (UNC), Sep 2024 -
    Howard Huang (UCLA), Aug 2024 -
    Hongxuan Li (Duke University), May 2024 -

    Vitæ

    Full CV in PDF.

    Sukwon Yun
    swyun@cs.unc.edu