SNU Biointelligence Lab

Research

Our research focuses on “biointelligence” i.e. the study of artificial intelligence on the basis of biological and bio-inspired information technologies, and its application to real world problems.

2026 23 2025 25 2024 17 2023 16 2022 18 2021 16

Preprint

RefineGround: From Noisy Similarity to Discriminative Grounding for Zero-shot Video Moment Retrieval
RefineGround: From Noisy Similarity to Discriminative Grounding for Zero-shot Video Moment Retrieval
Jangha Lee, Junbin Xiao, Junghyun Kim, Byoung-Tak Zhang, Minjoon Jung
preprint
Disentangling Spurious Correlations in Vision-Language-Action Models via Predicting Domain-Invariant Latent Lookahead
Disentangling Spurious Correlations in Vision-Language-Action Models via Predicting Domain-Invariant Latent Lookahead
Junghyun Kim, Ngseo Kim, Chungwoo Lee, Seoyeon Lee, Woo-Jeong Baek, Adam Zhou, Chip Huyen, Jun Ki Lee, Gi-Cheon Kang, Byoung-Tak Zhang
preprint
Habilis-β: A Fast-Motion and Long-Lasting On-Device Vision-Language-Action Model
Habilis-β: A Fast-Motion and Long-Lasting On-Device Vision-Language-Action Model
Jesoon Kang, Taegeon Park, Jisu An, Soo Min Kimm, Jaejoon Kim, …, Soyoung Lee, Jun Ki Lee, Seung-Joon Yi, Byoung-Tak Zhang, Theo Taeyeong Kim
preprint
Paper
Home
EvoGround: Self-Evolving Video Agents for Video Temporal Grounding
EvoGround: Self-Evolving Video Agents for Video Temporal Grounding
Minjoon Jung, Byoung-Tak Zhang, Lorenzo Torresani
preprint
Paper
Home
PHASOR: Phase-Anchored Universal Action Representations for Humanoid Embodiments
PHASOR: Phase-Anchored Universal Action Representations for Humanoid Embodiments
Kihyun Kim, Chaeyun Kim, Jongho Shin, Taeyoun Kwon, Junghyun Kim, Mijin Koo, Haon Park
preprint
Paper
Back to the Familiar Future: Failure Recovery for VLA Policies via Pre-Imagined Milestone Selection
Back to the Familiar Future: Failure Recovery for VLA Policies via Pre-Imagined Milestone Selection
Suyeon Shin, Juwon Kim, Hyeonbin Park, Hyunseo Kim, Hyundo Lee, Hyung-Sin Kim, Byoung-Tak Zhang
preprint
Paper
Variational Online Mirror Descent for Robust Learning in Schrödinger Bridge
Variational Online Mirror Descent for Robust Learning in Schrödinger Bridge
Dong-Sig Han, Jaein Kim, Hee Bin Yoo, Byoung-Tak Zhang
preprint
Paper
Exploring Ordinal Bias in Action Recognition for Instructional Videos
Exploring Ordinal Bias in Action Recognition for Instructional Videos
Joochan Kim, Minjoon Jung, Byoung-Tak Zhang
preprint
Paper
OBSER: Object-Based Sub-Environment Recognition for Zero-Shot Environmental Inference
OBSER: Object-Based Sub-Environment Recognition for Zero-Shot Environmental Inference
Won-Seok Choi, Dong-Sig Han, Suhyung Choi, Hyeonseo Yang, Byoung-Tak Zhang
preprint
Paper
Instruction-tuned Self-Questioning Framework for Multimodal Reasoning
Instruction-tuned Self-Questioning Framework for Multimodal Reasoning
Youwon Jang, Yu-Jung Heo, Jaeseok Kim, Minsu Lee, Du-Seong Chang, Byoung-Tak Zhang
preprint
Paper
Locality-aware Concept Bottleneck Model
Locality-aware Concept Bottleneck Model
Sujin Jeon, Hyundo Lee, Eungseo Kim, Sanghack Lee, Byoung-Tak Zhang, Inwoo Hwang
preprint
Paper
Active Neural 3D Reconstruction with Colorized Surface Voxel-Based View Selection
Active Neural 3D Reconstruction with Colorized Surface Voxel-Based View Selection
Hyunseo Kim, Hyeonseo Yang, Taekyung Kim, Yoonsung Kim, Jin-Hwa Kim, Byoung-Tak Zhang
preprint
Paper
L-SA: Learning Under-Explored Targets in Multi-Target Reinforcement Learning
L-SA: Learning Under-Explored Targets in Multi-Target Reinforcement Learning
Kibeom Kim, Hyundo Lee, Min Whoo Lee, Moonheon Lee, Minsu Lee, Byoung-Tak Zhang
preprint
Paper
SGRAM: Improving Scene Graph Parsing via Abstract Meaning Representation
SGRAM: Improving Scene Graph Parsing via Abstract Meaning Representation
Woo Suk Choi, Yu-Jung Heo, Byoung-Tak Zhang
preprint
Paper
Learning to Write with Coherence From Negative Examples
Learning to Write with Coherence From Negative Examples
Seonil Son, Jaeseo Lim, Youwon Jang, Jaeyoung Lee, Byoung-Tak Zhang
preprint
Paper
Cross-Modal Alignment Learning of Vision-Language Conceptual Systems
Cross-Modal Alignment Learning of Vision-Language Conceptual Systems
Taehyeong Kim, Hyeonseop Song, Byoung-Tak Zhang
preprint
Paper
Learning task-agnostic representation via toddler-inspired learning
Learning task-agnostic representation via toddler-inspired learning
Kwanyoung Park, Junseok Park, Hyunseok Oh, Byoung-Tak Zhang, Youngki Lee
preprint
Paper
Mounting Video Metadata on Transformer-based Language Model for Open-ended Video Question Answering
Mounting Video Metadata on Transformer-based Language Model for Open-ended Video Question Answering
Donggeon Lee, Seongho Choi, Youwon Jang, Byoung-Tak Zhang
preprint
Paper
Pattern Denoising in Molecular Associative Memory using Pairwise Markov Random Field Models
Pattern Denoising in Molecular Associative Memory using Pairwise Markov Random Field Models
Dharani Punithan, Byoung-Tak Zhang
preprint
Paper

2026

Kinematics-Driven Gaussian Shape Deformation for Blurry Monocular Dynamic Scenes
Kinematics-Driven Gaussian Shape Deformation for Blurry Monocular Dynamic Scenes
Yeon-Ji Song, Kiyoung Kwon, Junoh Lee, Jin-Hwa Kim, Byoung-Tak Zhang
ICML 2026
Paper
Poster
ESPADA: Execution Speedup via Semantics Aware Demonstration Data Downsampling for Imitation Learning
ESPADA: Execution Speedup via Semantics Aware Demonstration Data Downsampling for Imitation Learning
Byungju Kim, Jinu Pahk, Chungwoo Lee, Jaejoon Kim, Jangha Lee, Theo Taeyeong Kim, Kyuhwan Shim, Jun Ki Lee, Byoung-Tak Zhang
IEEE Robotics and Automation Letters
Forwarded to publisher on June 12, 2026
Paper
Learning Coordinate-based Convolutional Kernels for Continuous SE 3 Equivariant and Efficient Point Cloud Analysis
Learning Coordinate-based Convolutional Kernels for Continuous SE(3) Equivariant and Efficient Point Cloud Analysis
Jaein Kim, Hee Bin Yoo, Dong-Sig Han, Byoung-Tak Zhang
CVPR 2026
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026, pp. 9986-9995
Paper
Supplement
arXiv
Hybrid State Representation for Video Procedure Planning
Hybrid State Representation for Video Procedure Planning
Woo Suk Choi, Youwon Jang, Minsu Lee, Byoung-Tak Zhang
WACV 2026
Paper
PeriUn: Enhancing Unlearning by Selectively Forgetting Peripheral Samples
PeriUn: Enhancing Unlearning by Selectively Forgetting Peripheral Samples
Hee Bin Yoo, Dong-Sig Han, Jaein Kim, Byoung-Tak Zhang
AAAI 2026
Paper
Confidence Controls Deep Metric Learning
Confidence Controls Deep Metric Learning
Jinhee Park, Hee Bin Yoo, Byoung-Tak Zhang, Junseok Kwon
Machine Learning
Paper
Climb With SHERPA: Heuristic-Guided Reinforcement Learning via Segmented Experience Relay
Climb With SHERPA: Heuristic-Guided Reinforcement Learning via Segmented Experience Relay
Minji Kim, Ganghun Lee, Minsu Lee, Byoung-Tak Zhang
IEEE Robotics and Automation Letters
Paper
One-Shot 3-D Affordance Learning for Multi-Stage Robotic Manipulation
One-Shot 3-D Affordance Learning for Multi-Stage Robotic Manipulation
Hyunseo Kim, Yeon-Ji Song, Minsu Lee, Byoung-Tak Zhang
IEEE Access
Paper
CraftGround: A High-Performance Reinforcement Learning Environment Based on Minecraft
CraftGround: A High-Performance Reinforcement Learning Environment Based on Minecraft
Hyeonseo Yang, Minsu Lee, Byoung-Tak Zhang
IEEE Access
Paper
Voronoi-Based Second-Order Descriptor with Whitened Metric in LiDAR Place Recognition
Voronoi-Based Second-Order Descriptor with Whitened Metric in LiDAR Place Recognition
Jaein Kim, Hee Bin Yoo, Dong-Sig Han, Byoung-Tak Zhang
ICRA 2026
Paper
ECAHD: Efficient Collision-Aware Hierarchical Diffusion Navigation
ECAHD: Efficient Collision-Aware Hierarchical Diffusion Navigation
Jinu Pahk, Theo Taeyeong Kim, Jun Ki Lee, Byoung-Tak Zhang
ICRA 2026
Conference
Making Your Action Policies Interpretable: Mixtures of Action Queries
Making Your Action Policies Interpretable: Mixtures of Action Queries
Suhyung Choi, Youngseok Joo, Hyundo Lee, Kyuhwan Shim, Kisung Shin, Chungwoo Lee, Minjeong Gu, Jun Ki Lee, Byoung-Tak Zhang
ICML 2026 AI4GOOD Workshop
Paper
Deep Neural Networks as Finite-Step Hopfield Dynamics
Deep Neural Networks as Finite-Step Hopfield Dynamics
Wooyul Jung, Hochan Bang, Hee Bin Yoo, Byoung-Tak Zhang
ICLR 2026 NFAM Workshop
Paper
Can Embodied Agents Remember What You Said Evaluating Dialogue-Grounded Embodied Memory in 3D Environments
Can Embodied Agents Remember What You Said? Evaluating Dialogue-Grounded Embodied Memory in 3D Environments
Seongjun Jeong, Junghyun Kim, Gi-Cheon Kang, Byoung-Tak Zhang
CVPR 2026 Workshop on 3D-LLM/VLA
Workshop
Towards Spatially Consistent Image Generation: On Incorporating Intrinsic Scene Properties into Diffusion Models
Towards Spatially Consistent Image Generation: On Incorporating Intrinsic Scene Properties into Diffusion Models
Hyundo Lee, Suhyung Choi, Inwoo Hwang, Byoung-Tak Zhang
AAAI 2026
Paper
Neural Collapse-Informed Initialization with Perturbation Injection in Classification-based Metric Learning
Neural Collapse-Informed Initialization with Perturbation Injection in Classification-based Metric Learning
Jinhee Park, Hee Bin Yoo, Minjun Kim, Byoung-Tak Zhang, Junseok Kwon
AAAI 2026
Paper
Communicating Unexpectedness for Out-of-Distribution Multi-Agent Reinforcement Learning
Communicating Unexpectedness for Out-of-Distribution Multi-Agent Reinforcement Learning
Min Whoo Lee, Yunsu Lee, Kibeom Kim, Soo Wung Shin, Jun Ki Lee, Minsu Lee, Byoung-Tak Zhang
IEEE Access
Paper

2025

From Sparse to Dense: Toddler-Inspired Reward Transition in Goal-Oriented Reinforcement Learning
From Sparse to Dense: Toddler-Inspired Reward Transition in Goal-Oriented Reinforcement Learning
Junseok Park, Hyeonseo Yang, Min Whoo Lee, Won-Seok Choi, Minsu Lee, Byoung-Tak Zhang
IEEE Transactions on Cognitive and Developmental Systems
Paper
CDIS: Cross-Dimensional Class-Agnostic 3D Instance Segmentation via 2D Mask Tracking and 3D-2D Projection Merging
CDIS: Cross-Dimensional Class-Agnostic 3D Instance Segmentation via 2D Mask Tracking and 3D-2D Projection Merging
Juno Kim, Hye-Jung Yoon, Yesol Park, Byoung-Tak Zhang
IROS 2025
Paper
DA-Fusion: Deformable Attention-Based RGB-D Fusion Transformer for Unseen Object Instance Segmentation
DA-Fusion: Deformable Attention-Based RGB-D Fusion Transformer for Unseen Object Instance Segmentation
Yesol Park, Hye-Jung Yoon, Juno Kim, Byoung-Tak Zhang
ICRA 2025
Paper
Rethinking Metric Learning: Enhancing Generalization to Unseen Classes
Rethinking Metric Learning: Enhancing Generalization to Unseen Classes
Jinhee Park, Hee Bin Yoo, Byoung-Tak Zhang, Junseok Kwon
IEEE Access
Paper
Confidence-guided Refinement Reasoning for Zero-shot Question Answering
Confidence-guided Refinement Reasoning for Zero-shot Question Answering
Youwon Jang, Woo Suk Choi, Minjoon Jung, Minsu Lee, Byoung-Tak Zhang
EMNLP 2025
Paper
Shaping Latent Geometry with Noise-Injected Hopfield Dynamics
Shaping Latent Geometry with Noise-Injected Hopfield Dynamics
Wooyul Jung, Youngseok Joo, Dohyun Yu, Suhyung Choi, Byoung-Tak Zhang
NeurIPS 2025 Workshop on Symmetry and Geometry in Neural Representations
Paper
The Losing Winner: An LLM Agent that Predicts the Market but Loses Money
The Losing Winner: An LLM Agent that Predicts the Market but Loses Money
Youwon Jang, Joochan Kim, Byoung-Tak Zhang
NeurIPS 2025 Workshop on Generative AI in Finance
Paper
How Classifier Features Transfer to Downstream: An Asymptotic Analysis in a Two-Layer Model
How Classifier Features Transfer to Downstream: An Asymptotic Analysis in a Two-Layer Model
Hee Bin Yoo, Sungyoon Lee, Cheongjae Jang, Dong-Sig Han, Jaein Kim, Seunghyeon Lim, Byoung-Tak Zhang
NeurIPS 2025
Paper
OCK: Unsupervised Dynamic Video Prediction with Object-Centric Kinematics
OCK: Unsupervised Dynamic Video Prediction with Object-Centric Kinematics
Yeon-Ji Song, Jaein Kim, Suhyung Choi, Jin-Hwa Kim, Byoung-Tak Zhang
ICCV 2025
Paper
DBMovi-GS: Motion-aware Dynamic View Synthesis from Blurry Monocular Video via Sparse-Controlled Gaussian Splatting
DBMovi-GS: Motion-aware Dynamic View Synthesis from Blurry Monocular Video via Sparse-Controlled Gaussian Splatting
Yeon-Ji Song, Jaein Kim, Byungju Kim, Byoung-Tak Zhang
CVPR 2025 NFBCC Workshop
Paper
EgoExo-Con: Exploring View-Invariant Video Temporal Understanding
EgoExo-Con: Exploring View-Invariant Video Temporal Understanding
Minjoon Jung, Junbin Xiao, Junghyun Kim, Byoung-Tak Zhang, Angela Yao
NeurIPS 2025 Workshop on Multimodal Algorithmic Reasoning
Paper
Home
Continual Vision-and-Language Navigation
Continual Vision-and-Language Navigation
Seongjun Jeong, Gi-Cheon Kang, Seongho Choi, Joochan Kim, Byoung-Tak Zhang
BMVC 2025
Paper
INQUIRER: Harnessing internal knowledge graphs for video question generation
INQUIRER: Harnessing internal knowledge graphs for video question generation
Woo Suk Choi, Youwon Jang, Minsu Lee, Byoung-Tak Zhang
Knowledge-Based Systems 2025
Paper
CLIP-RT: Learning Language-Conditioned Robotic Policies from Natural Language Supervision
CLIP-RT: Learning Language-Conditioned Robotic Policies from Natural Language Supervision
Gi-Cheon Kang, Junghyun Kim, Kyuhwan Shim, Jun Ki Lee, Byoung-Tak Zhang
RSS 2025
Home
Paper
Mixture of Action Expert Embeddings: Multi-Task ACT
Mixture of Action Expert Embeddings: Multi-Task ACT
Suhyung Choi, Youngseok Joo, Jun Ki Lee, Byoung-Tak Zhang
AAAI 2025 GenPlan Workshop
Paper
On the Consistency of Video Large Language Models in Temporal Comprehension
On the Consistency of Video Large Language Models in Temporal Comprehension
Minjoon Jung, Junbin Xiao, Byoung-Tak Zhang, Angela Yao
CVPR 2025
Paper
Socratic planner: Inquiry-based zero-shot planning for embodied instruction following
Socratic planner: Inquiry-based zero-shot planning for embodied instruction following
Suyeon Shin, Sujin Jeon, Jyunghyun Kim, Gi-Cheon Kang, Byoung-Tak Zhang
ICRA 2025
Paper
Truncated Gaussian Policy for Debiased Continuous Control
Truncated Gaussian Policy for Debiased Continuous Control
Ganghun Lee, Minji Kim, Minsu Lee, Byoung-Tak Zhang
AAAI 2025
Paper
Background-aware moment detection for video moment retrieval
Background-aware moment detection for video moment retrieval
Minjoon Jung, Youwon Jang, Seongho Choi, Joochan Kim, Jin-Hwa Kim, Byoung-Tak Zhang
WACV 2025
Paper
Relaxed HLP: A Metric for Flexible High-Level Plan Evaluation in Embodied Environments
Relaxed HLP: A Metric for Flexible High-Level Plan Evaluation in Embodied Environments
Suyeon Shin, Byoung-Tak Zhang
BigComp 2025
Paper

2024

CogME: A Cognition-Inspired Multi-Dimensional Evaluation Metric for Story Understanding
CogME: A Cognition-Inspired Multi-Dimensional Evaluation Metric for Story Understanding
Minjung Shin, Seongho Choi, Yu-Jung Heo, Minsu Lee, Byoung-Tak Zhang, Jeh-Kwang Ryu
CogSci 2024
Paper
Continuous SO 3 Equivariant Convolution for 3D Point Cloud Analysis
Continuous SO(3) Equivariant Convolution for 3D Point Cloud Analysis
Jaein Kim, Hee Bin Yoo, Dong-Sig Han, Yeon-Ji Song, Byoung-Tak Zhang
ECCV 2024
Paper
DUEL: Duplicate Elimination on Active Memory for Self-Supervised Class-Imbalanced Learning
DUEL: Duplicate Elimination on Active Memory for Self-Supervised Class-Imbalanced Learning
Won-Seok Choi, Hyundo Lee, Dong-Sig Han, Junseok Park, Heeyeon Koo, Byoung-Tak Zhang
AAAI 2024
Paper
Efficient Monte Carlo Tree Search via On-the-Fly State-Conditioned Action Abstraction
Efficient Monte Carlo Tree Search via On-the-Fly State-Conditioned Action Abstraction
Yunhyeok Kwak, Inwoo Hwang, Dooyoung Kim, Sanghack Lee, Byoung-Tak Zhang
UAI 2024
Paper
Fine-Grained Causal Dynamics Learning with Quantization for Improving Robustness in Reinforcement Learning
Fine-Grained Causal Dynamics Learning with Quantization for Improving Robustness in Reinforcement Learning
Inwoo Hwang, Yunhyeok Kwak, Suhyung Choi, Byoung-Tak Zhang, Sanghack Lee
ICML 2024
Paper
HAPFI: History-Aware Planning based on Fused Information
HAPFI: History-Aware Planning based on Fused Information
Sujin Jeon, Suyeon Shin, Byoung-Tak Zhang
ICRA 2024
Paper
Multi-Object RANSAC: Efficient Plane Clustering Method in a Clutter
Multi-Object RANSAC: Efficient Plane Clustering Method in a Clutter
Seunghyeon Lim, Youngjae Yoo, Jun Ki Lee, Byoung-Tak Zhang
ICRA 2024
Paper
OV-MAP : Open-Vocabulary Zero-Shot 3D Instance Segmentation Map for Robots
OV-MAP : Open-Vocabulary Zero-Shot 3D Instance Segmentation Map for Robots
Hye-Jung Yoon, Juno Kim, Yesol Park, Byoung-Tak Zhang
IROS 2024
Paper
PGA: Personalizing Grasping Agents with Single Human-Robot Interaction
PGA: Personalizing Grasping Agents with Single Human-Robot Interaction
Junghyun Kim, Gi-Cheon Kang, Jaein Kim, Seoyun Yang, Minjoon Jung, Byoung-Tak Zhang
IROS 2024
Paper
PROGrasp: Pragmatic Human-Robot Communication for Object Grasping
PROGrasp: Pragmatic Human-Robot Communication for Object Grasping
Gi-Cheon Kang, Junghyun Kim, Jaein Kim, Byoung-Tak Zhang
ICRA 2024
Paper
Seg2Grasp: A Robust Modular Suction Grasping in Bin Picking
Seg2Grasp: A Robust Modular Suction Grasping in Bin Picking
Hye-Jung Yoon, Juno Kim, Yesol Park, Jun-Ki Lee, Byoung-Tak Zhang
IROS 2024
Paper
Unveiling the Significance of Toddler-Inspired Reward Transition in Goal-Oriented Reinforcement Learning
Unveiling the Significance of Toddler-Inspired Reward Transition in Goal-Oriented Reinforcement Learning
Junseok Park, Yoonsung Kim, Hee Bin Yoo, Min Whoo Lee, Kibeom Kim, Won-Seok Choi, Minsu Lee, Byoung-Tak Zhang
AAAI 2024
Paper
Decomposing the Configuration of an Articulated Object via Graph Neural Network
Decomposing the Configuration of an Articulated Object via Graph Neural Network
Seunghyeon Lim, Kisung Shin, Nakul Gopalan, Jun Ki Lee, Byoung-Tak Zhang
CoRL 2024 LFDM Workshop
Paper
Zero-Shot Vision-and-Language Navigation with Collision Mitigation in Continuous Environment
Zero-Shot Vision-and-Language Navigation with Collision Mitigation in Continuous Environment
Seongjun Jeong, Gi-Cheon Kang, Joochan Kim, Byoung-Tak Zhang
CVPR 2024 Embodied AI Workshop
Paper
Can Video Large Language Models Comprehend Language in Videos
Can Video Large Language Models Comprehend Language in Videos?
Minjoon Jung, Junbin Xiao, Byoung-Tak Zhang, Angela Yao
NeurIPS 2024 Video-Language Models Workshop
Paper
Visual Hindsight Self-Imitation Learning for Interactive Navigation
Visual Hindsight Self-Imitation Learning for Interactive Navigation
Kibeom Kim, Moonheun Lee, Min Whoo Lee, Kisung Shin, Minsu Lee, Byoung-Tak Zhang
IEEE Access
Paper

2023

Domain Adapted Broiler Density Map Estimation Using Negative-Patch Data Augmentation
Domain Adapted Broiler Density Map Estimation Using Negative-Patch Data Augmentation
Taehyung Kim, Daehyun Lee, Wansoo Kim, Byoung-Tak Zhang
Biosystems Engineering 231
Paper
Video Turing Test: A First Step Towards Human-Level AI
Video Turing Test: A First Step Towards Human-Level AI
Minsu Lee, Yu-Jung Heo, Seongho Choi, Wooseok Choi, Byoung-Tak Zhang
AI Magazine 44 (4)
Paper
EXOT: Exit-Aware Object Tracker for Safe Robotic Manipulation of Moving Object
EXOT: Exit-Aware Object Tracker for Safe Robotic Manipulation of Moving Object
Hyunseo Kim, Hye-Jung Yoon, Minji Kim, Dong-Sig Han, Byoung-Tak Zhang
ICRA 2023
Paper
GVCCI: Lifelong Learning of Visual Grounding for Language-Guided Robotic Manipulation
GVCCI: Lifelong Learning of Visual Grounding for Language-Guided Robotic Manipulation
Junghyun Kim, Gi-Cheon Kang, Jaein Kim, Suyeon Shin, Byoung-Tak Zhang
IROS 2023
Paper
Learning Geometry-Aware Representations by Sketching
Learning Geometry-Aware Representations by Sketching
Hyundo Lee, Inwoo Hwang, Hyunsung Go, Won-Seok Choi, Kibeom Kim, Byoung-Tak Zhang
CVPR 2023
Paper
Neural Collage Transfer: Artistic Reconstruction via Material Manipulation
Neural Collage Transfer: Artistic Reconstruction via Material Manipulation
Ganghun Lee, Minji Kim, Yunsu Lee, Minsu Lee, Byoung-Tak Zhang
ICCV 2023
Paper
On Discovery of Local Independence over Continuous Variables via Neural Contextual Decomposition
On Discovery of Local Independence over Continuous Variables via Neural Contextual Decomposition
Inwoo Hwang, Yunhyeok Kwak, Yeon-Ji Song, Byoung-Tak Zhang, Sanghack Lee
CLeaR 2023
Paper
Robust Map Fusion with Visual Attention Utilizing Multi-Agent Rendezvous
Robust Map Fusion with Visual Attention Utilizing Multi-Agent Rendezvous
Jaein Kim, Dong-Sig Han, Byoung-Tak Zhang
ICRA 2023
Paper
The Dialog Must Go On: Improving Visual Dialog via Generative Self-Training
The Dialog Must Go On: Improving Visual Dialog via Generative Self-Training
Gi-Cheon Kang, Sungdong Kim, Jin-Hwa Kim, Donghyun Kwak, Byoung-Tak Zhang
CVPR 2023
Paper
Causal Dynamics Learning with Quantized Local Independence Discovery
Causal Dynamics Learning with Quantized Local Independence Discovery
Inwoo Hwang, Yunhyeok Kwak, Suhyung Choi, Byoung-Tak Zhang, Sanghack Lee
ICML 2023 Workshop on Spurious Correlations, Invariance, and Stability
Paper
H2RL: Transferring Heuristic Knowledge to a Reinforcement Learning Agent for Solving the Online 3D Bin Packing Problem
H2RL: Transferring Heuristic Knowledge to a Reinforcement Learning Agent for Solving the Online 3D Bin Packing Problem
Minji Kim, Ganghun Lee, Minsu Lee, Byoung-Tak Zhang
ICRA 2023 Workshop on Transferability in Robotics
Paper
Instruction-Tuned Self-Questioning Framework for Multimodal Reasoning
Instruction-Tuned Self-Questioning Framework for Multimodal Reasoning
Youwon Jang, Yu-Jung Heo, Jaeseok Kim, Minsu Lee, Du-Seong Chang, Byoung-Tak Zhang
ICCV 2023 CLVL Workshop
Page
Learning Object Motion and Appearance Dynamics with Object-Centric Representations
Learning Object Motion and Appearance Dynamics with Object-Centric Representations
Yeon-Ji Song, Hyunseo Kim, Suhyung Choi, Jin-Hwa Kim, Byoung-Tak Zhang
NeurIPS 2023 Workshop on Causal Representation Learning
Paper
Quantized Local Independence Discovery for Fine-Grained Causal Dynamics Learning in Reinforcement Learning
Quantized Local Independence Discovery for Fine-Grained Causal Dynamics Learning in Reinforcement Learning
Inwoo Hwang, Yunhyeok Kwak, Suhyung Choi, Byoung-Tak Zhang, Sanghack Lee
NeurIPS 2023 GenPlan Workshop
Paper
Visual Perception-Based Assistive Mobile Robot System for Manipulation Tasks
Visual Perception-Based Assistive Mobile Robot System for Manipulation Tasks
Hye-Jung Yoon, Juno Kim, Yesol Park, Byoung-Tak Zhang
ICRA 2023 Workshop on Assistive Manipulation
Page

2022

Team Tidyboy at the WRS 2020: A Modular Software Framework for Home-Service Robots
Team Tidyboy at the WRS 2020: A Modular Software Framework for Home-Service Robots
Tae-Woong Kang, Dong-Woon Song, Jae-Bong Lee, Jun-Young Kim, Choong-Yeon Lee, …, Minji Kim, Hyeon-Jun Cho, Byoung-Tak Zhang, Jae-Bok Song, Seung-Jun Lee
Advanced Robotics 36 (16)
Paper
From Scratch to Sketch: Deep Decoupled Hierarchical Reinforcement Learning for Robotic Sketching Agent
From Scratch to Sketch: Deep Decoupled Hierarchical Reinforcement Learning for Robotic Sketching Agent
Ganghun Lee, Minji Kim, Minsu Lee, Byoung-Tak Zhang
ICRA 2022
Paper
Hypergraph Transformer: Weakly-Supervised Multi-hop Reasoning for Knowledge-Based Visual Question Answering
Hypergraph Transformer: Weakly-Supervised Multi-hop Reasoning for Knowledge-Based Visual Question Answering
Yu-Jung Heo, Eunsol Kim, Wooseok Choi, Byoung-Tak Zhang
ACL 2022
Paper
Modal-Specific Pseudo Query Generation for Video Corpus Moment Retrieval
Modal-Specific Pseudo Query Generation for Video Corpus Moment Retrieval
Minjoon Jung, Seongho Choi, Joochan Kim, Jin-Hwa Kim, Byoung-Tak Zhang
EMNLP 2022
Paper
PDF
PlaceNet: Neural Spatial Representation Learning with Multimodal Attention
PlaceNet: Neural Spatial Representation Learning with Multimodal Attention
Choong-Yeon Lee, Youngjae Yoo, Byoung-Tak Zhang
IJCAI 2022
Paper
Robust Imitation via Mirror-Descent Inverse Reinforcement Learning
Robust Imitation via Mirror-Descent Inverse Reinforcement Learning
Dong-Sig Han, Hyunseo Kim, Hyundo Lee, Je-Hwan Ryu, Byoung-Tak Zhang
NeurIPS 2022
Paper
SelecMix: Debiased Learning by Contradicting-Pair Sampling
SelecMix: Debiased Learning by Contradicting-Pair Sampling
Inwoo Hwang, Sangjun Lee, Yunhyeok Kwak, Seong Joon Oh, Damien Teney, Jin-Hwa Kim, Byoung-Tak Zhang
NeurIPS 2022
Paper
Smooth-Swap: A Simple Enhancement for Face-Swapping with Smoothness
Smooth-Swap: A Simple Enhancement for Face-Swapping with Smoothness
Ji-Seob Kim, Ji-Hoon Lee, Byoung-Tak Zhang
CVPR 2022
Paper
DUEL: Adaptive Duplicate Elimination on Working Memory for Self-Supervised Learning
DUEL: Adaptive Duplicate Elimination on Working Memory for Self-Supervised Learning
Won-Seok Choi, Dong-Sig Han, Hyundo Lee, Junseok Park, Byoung-Tak Zhang
NeurIPS 2022 Workshop on Self-Supervised Learning: Theory and Practice
Paper
Generative Self-Training Improves Pre-training for Visual Dialog
Generative Self-Training Improves Pre-training for Visual Dialog
Gi-Cheon Kang, Sungdong Kim, Jin-Hwa Kim, Donghyun Kwak, Byoung-Tak Zhang
ICML 2022 Workshop on Pre-training
Paper
Improving Robustness to Texture Bias via Shape-Focused Augmentation
Improving Robustness to Texture Bias via Shape-Focused Augmentation
Sangjun Lee, Inwoo Hwang, Gi-Cheon Kang, Byoung-Tak Zhang
CVPR 2022 Human-Centered Intelligent Services Workshop
Paper
Language-Agnostic Semantic-Consistent Text-to-Image Generation
Language-Agnostic Semantic-Consistent Text-to-Image Generation
Seongjun Jung, Wooseok Choi, Seongho Choi, Byoung-Tak Zhang
ACL 2022 Workshop on Multilingual Multimodal Learning
Paper
On the Importance of Critical Period in Multi-Stage Reinforcement Learning
On the Importance of Critical Period in Multi-Stage Reinforcement Learning
Junseok Park, Inwoo Hwang, Min Whoo Lee, Hyunseok Oh, Minsu Lee, Youngki Lee, Byoung-Tak Zhang
ICML 2022 Workshop on Complex Feedback in Online Learning
Paper
Scene Graph Parsing via Abstract Meaning Representation in Pre-trained Language Models
Scene Graph Parsing via Abstract Meaning Representation in Pre-trained Language Models
Wooseok Choi, Yu-Jung Heo, Dharani Perumal, Byoung-Tak Zhang
NAACL 2022 DLG4NLP Workshop
Paper
SelecMix: Debiased Learning by Mixing-Up Contradicting Pairs
SelecMix: Debiased Learning by Mixing-Up Contradicting Pairs
Inwoo Hwang, Sangjun Lee, Yunhyeok Kwak, Seong Joon Oh, Damien Teney, Jin-Hwa Kim, Byoung-Tak Zhang
ICML 2022 Workshop on Spurious Correlations, Invariance and Stability
Paper

2021

Leveraging node neighborhoods and egograph topology for better bot detection in social graphs
Leveraging node neighborhoods and egograph topology for better bot detection in social graphs
Björn Bebensee, Nagmat Nazarov, Byoung-Tak Zhang
Social Network Analysis and Mining
Paper
RoboCup Home 2021 Domestic Standard Platform League Winner
RoboCup@Home 2021 Domestic Standard Platform League Winner
Dongwoon Song, Taewoong Kang, Jae-Bong Yi, Joonyoung Kim, Taeyang Kim, …, Minji Kim, Hyun-Jun Jo, Byoung-Tak Zhang, Jae-Bok Song, Seung-Joon Yi
RoboCup 2021
Paper
M2FN: Multi-Step Modality Fusion for Advertisement Image Assessment
M2FN: Multi-Step Modality Fusion for Advertisement Image Assessment
Kyunghwa Park, Jeongwoo Ha, Jeonghun Lee, Sunyoung Kwon, Kyungmin Kim, Byoung-Tak Zhang
Applied Soft Computing 105
Paper
DramaQA: Character-Centered Video Story Understanding with Hierarchical QA
DramaQA: Character-Centered Video Story Understanding with Hierarchical QA
Seongho Choi, Kyungwoon On, Yu-Jung Heo, Ahjeong Seo, Yuwon Jang, Minsu Lee, Byoung-Tak Zhang
AAAI 2021
Paper
Attend What You Need: Motion-Appearance Synergistic Networks for Video Question Answering
Attend What You Need: Motion-Appearance Synergistic Networks for Video Question Answering
Ahjeong Seo, Gi-Cheon Kang, Joonhan Park, Byoung-Tak Zhang
ACL 2021
Paper
Co-Attentional Transformers for Story-Based Video Understanding
Co-Attentional Transformers for Story-Based Video Understanding
Björn Bebensee, Byoung-Tak Zhang
ICASSP 2021
Paper
Devil s Advocate: Novel Boosting Ensemble Method from Psychological Findings for Text Classification
Devil's Advocate: Novel Boosting Ensemble Method from Psychological Findings for Text Classification
Huiyeol Jo, Jaeseo Lim, Byoung-Tak Zhang
EMNLP 2021
Paper
Goal-Aware Cross-Entropy for Multi-Target Reinforcement Learning
Goal-Aware Cross-Entropy for Multi-Target Reinforcement Learning
Kibeom Kim, Min Whoo Lee, Yoonsung Kim, Je-Hwan Ryu, Minsu Lee, Byoung-Tak Zhang
NeurIPS 2021
Paper
Message Passing Adaptive Resonance Theory for Online Active Semi-Supervised Learning
Message Passing Adaptive Resonance Theory for Online Active Semi-Supervised Learning
Tae-Hyung Kim, Injun Hwang, Hyundo Lee, Hyunseo Kim, Won-Seok Choi, Joseph J. Lim, Byoung-Tak Zhang
ICML 2021
Paper
Multimodal Anomaly Detection based on Deep Auto-Encoder for Object Slip Perception of Mobile Manipulation Robots
Multimodal Anomaly Detection based on Deep Auto-Encoder for Object Slip Perception of Mobile Manipulation Robots
Youngjae Yoo, Choong-Yeon Lee, Byoung-Tak Zhang
ICRA 2021
Paper
Passive Versus Active: Frameworks of Active Learning for Linking Humans to Machines
Passive Versus Active: Frameworks of Active Learning for Linking Humans to Machines
Jaeseo Lim, Huiyeol Jo, Byoung-Tak Zhang, Jooyong Park
CogSci 2021
Paper
Reasoning Visual Dialog with Sparse Graph Learning and Knowledge Transfer
Reasoning Visual Dialog with Sparse Graph Learning and Knowledge Transfer
Gi-Cheon Kang, Junseok Park, Hwaran Lee, Byoung-Tak Zhang, Jin-Hwa Kim
EMNLP 2021
Paper
Toddler-Guidance Learning: Impacts of Critical Period on Multimodal AI Agents
Toddler-Guidance Learning: Impacts of Critical Period on Multimodal AI Agents
Junseok Park, Kwanyoung Park, Hyunseok Oh, Ganghun Lee, Minsu Lee, Youngki Lee, Byoung-Tak Zhang
ICMI 2021
Paper
Toward a Human-Level Video Understanding Intelligence
Toward a Human-Level Video Understanding Intelligence
Yu-Jung Heo, Minsu Lee, Seongho Choi, Woo Suk Choi, Minjung Shin, Minjoon Jung, Jeh-Kwang Ryu, Byoung-Tak Zhang
AAAI FSS 2021
Paper

2020

Cut-Based Graph Learning Networks to Discover Compositional Structure of Sequential Video Data
Cut-Based Graph Learning Networks to Discover Compositional Structure of Sequential Video Data
Kyoung-Woon On, Eun-Sol Kim, Yu-Jung Heo, Byoung-Tak Zhang
AAAI 2020
Paper
Hypergraph Attention Networks for Multimodal Learning
Hypergraph Attention Networks for Multimodal Learning
Eun-Sol Kim, Woo-Young Kang, Kyoung-Woon On, Yu-Jung Heo, Byoung-Tak Zhang
CVPR 2020
Paper
Label Propagation Adaptive Resonance Theory for Semi-Supervised Continuous Learning
Label Propagation Adaptive Resonance Theory for Semi-Supervised Continuous Learning
Taehyeong Kim, Injune Hwang, Gi-Cheon Kang, Won-Seok Choi, Hyunseo Kim, Byoung-Tak Zhang
ICASSP 2020
Paper
Hierarchical Color Learning in Convolutional Neural Networks
Hierarchical Color Learning in Convolutional Neural Networks
Chris Hickey, Byoung-Tak Zhang
CVPR 2020 Workshops
Paper
Effect of Active Pre-Learning Activities on Humans and Machines
Effect of Active Pre-Learning Activities on Humans and Machines
Jaeseo Lim, Hwiyeol Jo, Byoung-Tak Zhang, Jooyong Park
CogSci 2020
Paper
Visual Perception Framework for an Intelligent Mobile Robot
Visual Perception Framework for an Intelligent Mobile Robot
Chung-Yeon Lee, Hyundo Lee, Injune Hwang, Byoung-Tak Zhang
UR 2020
Paper