dFCExpert: Learning Dynamic Functional Connectivity Patterns With Modularity and State Experts

Characterizing brain dynamic functional connectivity (dFC) patterns from functional Magnetic Resonance Imaging (fMRI) data is of paramount importance in imaging neuroscience and medicine. Recently, graph neural network (GNN) models, combined with transformers or recurrent neural networks (RNNs), have shown great potential for modeling the dFC patterns. However, these methods face challenges in characterizing the modularity organization of brain networks and capturing varying dFC state patterns. To address these limitations, we propose dFCExpert, a novel method designed to learn robust representations of dFC patterns from fMRI data with modularity experts and state experts. Specifically, the modularity experts optimize multiple experts to characterize the brain modularity organization during graph feature learning process by combining GNN and mixture of experts (MoE), with each expert focusing on brain network nodes within the same functional network module. The state experts aggregate temporal dFC features into a set of distinct connectivity states using a soft prototype clustering method, providing insight into how these states support diverse brain functions and vary across brain conditions. Experiments on three large-scale fMRI datasets have demonstrated the superiority of our method over existing alternatives. The learned dFC representations not only enhance interpretability but also hold promise for advancing our understanding of brain function across a range of conditions, including brain development, sex differences, and Autism Spectrum Disorder. Our implementation is publicly available at https://github.com/MLDataAnalytics/dFCExperts.