ACM MM 2021: 'Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection'
-
Updated
Oct 23, 2023 - Python
#
audio-visual
Here are 34 public repositories matching this topic...
This repo contains the official PyTorch implementation of: Diverse and Aligned Audio-to-Video Generation via Text-to-Video Model Adaptation
deep-learning pytorch audio-visual diffusion-models ai-art audio-to-video generative-ai video-synthesis modelscope
-
Updated
Feb 13, 2025 - Python
Implementation of "EPIC-Fusion: Audio-Visual Temporal Binding for Egocentric Action Recognition, ICCV, 2019" in PyTorch
-
Updated
Jan 25, 2021 - Python
Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
-
Updated
Feb 6, 2025 - Python
Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
-
Updated
Jan 29, 2024 - Python
[CVPR 2023] Collecting Cross-Modal Presence-Absence Evidence for Weakly-Supervised Audio-Visual Event Perception
-
Updated
Jun 17, 2023 - Python
Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scoring" in CVPR23
-
Updated
Jun 20, 2023 - Python
Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"
-
Updated
Oct 11, 2024 - Python
Official Implementation of "Open-Vocabulary Audio-Visual Semantic Segmentation" [ACM MM 2024 Oral].
deep-learning transformer video-processing semantic-segmentation sound-localization audio-visual open-vocabulary
-
Updated
Nov 2, 2024 - Python
[ECCV 2022] Joint-Modal Label Denoising for Weakly-Supervised Audio-Visual Video Parsing
-
Updated
Jul 15, 2022 - Python
-
Updated
May 4, 2020 - Python
Transformer-based online speech recognition system with TensorFlow 2
python online deep-learning tensorflow transformer speech-recognition audio-visual-speech-recognition speech-recognizer multimodal multimodal-deep-learning mahcine-learning audio-visual tensorflow2 live-caption taris
-
Updated
Jan 22, 2021 - Python
Code for CVPR 2021 paper Exploring Heterogeneous Clues for Weakly-Supervised Audio-Visual Video Parsing
-
Updated
Dec 29, 2021 - Python
Audio-visual diarization pipeline used for creating VoxConverse dataset
-
Updated
Jun 6, 2025 - Python
Official source code of the INTERSPEECH 2023 paper: "Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Model" (AVLIT)
lightweight pytorch multi-modal iterative speech-separation speech-enhancement audio-visual pytorch-lightning
-
Updated
Sep 1, 2023 - Python
Audio-Visual Generalized Zero-Shot Learning using Large Pre-Trained Models
learning clip clap zero-shot-learning audio-visual generalized-zero-shot-learning gzsl zsl audio-visual-learning audio-visual-generalized-zero-shot-learning
-
Updated
Apr 15, 2024 - Python
Code for InterSpeech 2024 Paper: LipGER: Visually-Conditioned Generative Error Correction for Robust Automatic Speech Recognition
-
Updated
Jul 16, 2024 - Python
Towards Audio-Visual Saliency Prediction for Omnidirectional Video with Spatial Audio
-
Updated
Dec 28, 2021 - Python
Accepted by TMM 2022
-
Updated
Aug 18, 2022 - Python
Code and datasets for 'Move2Hear: Active Audio-Visual Source Separation' (ICCV 2021)
-
Updated
Jan 17, 2023 - Python
Improve this page
Add a description, image, and links to the audio-visual topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the audio-visual topic, visit your repo's landing page and select "manage topics."