Adversarial alignment and graph fusion via information bottleneck for multimodal emotion recognition in conversations

By Shou, Yuntao and Meng, Tao and Ai, Wei and Zhang, Fuchen and Yin, Nan and Li, Keqin. [paper link]

This is an official implementation of 'Adversarial alignment and graph fusion via information bottleneck for multimodal emotion recognition in conversations' 🔥. Any problems, please contact [email protected]. If you find this repository useful to your research or work, it is really appreciated to star this repository ❤️.

🚀 Installation

Python 3.8.5
torch 1.7.1
CUDA 11.3
torch-geometric 1.7.2

Training

python train.py --base-model 'GRU' --dropout 0.5 --lr 0.0001 --batch-size 16 --graph_type='hyper' --epochs=0 --graph_construct='direct' --multi_modal --mm_fusion_mthd='concat_DHT' --modals='avl' --Dataset='IEMOCAP'

If our work is helpful to you, please cite:

@article{shou2024adversarial,
  title={Adversarial alignment and graph fusion via information bottleneck for multimodal emotion recognition in conversations},
  author={Shou, Yuntao and Meng, Tao and Ai, Wei and Zhang, Fuchen and Yin, Nan and Li, Keqin},
  journal={Information Fusion},
  volume={112},
  pages={102590},
  year={2024},
  publisher={Elsevier}
}

Star History