Publications

Parallel Sequence Modeling via Generalized Spatial Propagation Network

Hongjun Wang, Wonmin Byeon, Jiarui Xu, Jinwei Gu, Ka Chun Cheung, Xiaolong Wang, Kai Han, Jan Kautz, Sifei Liu | CVPR

[arxiv] [website]

Hymba: A Hybrid-head Architecture for Small Language Models

Xin Dong, Yonggan Fu, Shizhe Diao, Wonmin Byeon, Zijia Chen, Ameya Sunil Mahabaleshwarkar, Shih-Yang Liu, Matthijs Van Keirsbilck, Min-Hung Chen, Yoshi Suhara, Yingyan Lin, Jan Kautz, Pavlo Molchanov | ICLR 2025

[arxiv] [code] [HF models] [blog]

Token-Efficient Long Video Understanding for Multimodal LLMs

Jindong Jiang*, Xiuyu Li*, Zhijian Liu, Muyang Li, Guo Chen, Zhiqi Li, De-An Huang, Guilin Liu, Zhiding Yu, Kurt Keutzer, Sungjin Ahn, Jan Kautz, Hongxu Yin, Yao Lu, Song Han, Wonmin Byeon | arXiv

[arxiv] [website]

Feature-based Graph Attention Networks Improve Online Continual Learning

Adjovi Sim, Zhengkui Wang, Aik Beng Ng, Shalini De Mello, Simon See, Wonmin Byeon | arXiv

[arxiv]

An Empirical Study of Mamba-based Language Models

Roger Waleffe, Wonmin Byeon, Duncan Riach, Brandon Norick, Vijay Korthikanti, Tri Dao, Albert Gu, Ali Hatamizadeh, Sudhakar Singh, Deepak Narayanan, Garvit Kulshreshtha, Vartika Singh, Jared Casper, Jan Kautz, Mohammad Shoeybi, Bryan Catanzaro | arXiv

[arxiv] [talk] [code] [checkpoints]

MTVG: Multi-text Video Generation with Text-to-Video Models

Gyeongrok Oh, Jaehwan Jeong, Sieun Kim, Wonmin Byeon, Jinkyu Kim, Sungwoong Kim, Hyeokmin Kwon, Sangpil Kim | ECCV 2024

[arxiv]

RegionGPT: Towards Region Understanding Vision Language Model

Qiushan Guo, Shalini De Mello, Hongxu Yin, Wonmin Byeon, Ka Chun Cheung, Yizhou Yu, Ping Luo, Sifei Liu | CVPR 2024

[arxiv]

Robust Sound-Guided Image Manipulation

Seung Hyun Lee, Chanyoung Kim, Wonmin Byeon , Gyeongrok Oh, Jooyoung Lee, Sang Ho Yoon, Jinkyu Kim, Sangpil Kim | Neural Networks

[arxiv] [paper]

Convolutional State Space Models for Long-Range Spatiotemporal Modeling

Jimmy T.H. Smith, Shalini De Mello, Jan Kautz, Scott W. Linderman, Wonmin Byeon | NeurIPS 2023

[arxiv]

The Power of Sound (TPoS): Audio Reactive Video Generation with Stable Diffusion

Yujin Jeong, Wonjeong Ryoo, Seunghyun Lee, Dabin Seo, Wonmin Byeon, Sangpil Kim, Jinkyu Kim | ICCV 2023

[arxiv] [website]

Heterogeneous Continual Learning

Divyam Madaan, Hongxu Yin, Wonmin Byeon, Jan Kautz, Pavlo Molchanov | CVPR 2023 Highlight

[paper] [talk]

Open-vocabulary panoptic segmentation with text-to-image diffusion models

Jiarui Xu, Sifei Liu, Arash Vahdat, Wonmin Byeon, Xiaolong Wang, Shalini De Mello | CVPR 2023 Highlight

[arxiv] [project page] [code] [demo] [talk]

Scaling-up Diverse Orthogonal Convolutional Networks with a Paraunitary Framework

Jiahao Su, Wonmin Byeon, Furong Huang | ICML 2022

[arxiv] [ICML talk]

Sound-Guided Semantic Video Generation

Seung Hyun Lee, Gyeongrok Oh, Wonmin Byeon, Jihyun Bae, Chanyoung Kim, Won Jeong Ryoo, Sang Ho Yoon, Jinkyu Kim, Sangpil Kim | ECCV 2022

[arxiv]

Physics Informed RNN-DCT Networks for Time-Dependent Partial Differential Equations

Benjamin Wu* · Oliver Hennigh · Jan Kautz · Sanjay Choudhry · Wonmin Byeon* | (*) equal contributions | ICCS 2022

[arxiv]

Displacement-Invariant Cost Computation for Efficient Stereo Matching

Yiran Zhong, Charles Loop, Wonmin Byeon, Stan Birchfield, Yuchao Dai, Kaihao Zhang, Alexey Kamenev, Thomas Breuel, Hongdong Li, Jan Kautz | IJCV 2022

[paper] [arxiv]

GroupViT: Semantic Segmentation Emerges from Text Supervision

Jiarui Xu, Shalini De Mello, Sifei Liu, Wonmin Byeon, Thomas Breuel, Jan Kautz, Xiaolong Wang | CVPR 2022

[arxiv] [video] [project page]

Sound-Guided Semantic Image Manipulation

Seung Hyun Lee, Wonseok Roh, Wonmin Byeon, Sang Ho Yoon, Chan Young Kim, Jinkyu Kim, Sangpil Kim | CVPR 2022

[arxiv] [project page]

Coupled Segmentation and Edge Learning via Dynamic Graph Propagation

Zhiding Yu, Rui Huang, Wonmin Byeon, Sifei Liu, Guilin Liu, Thomas Breuel, Anima Anandkumar, Jan Kautz | NeurIPS 2021

[paper]

NVIDIA SimNet: an AI-accelerated multi-physics simulation framework

Oliver Hennigh, Susheela Narasimhan, Mohammad Amin Nabian, Akshay Subramaniam, Kaustubh Tangsali, Zhiwei Fang, Max Rietmann, Wonmin Byeon, Sanjay Choudhry | ICCS 2021

[arxiv] [paper] [code]