Arrêt de service programmé du vendredi 10 juin 16h jusqu’au lundi 13 juin 9h. Pour en savoir plus
Accéder directement au contenu Accéder directement à la navigation
Communication dans un congrès

Topological Gradient-based Competitive Learning

Abstract : Topological learning is a wide research area aiming at uncovering the mutual spatial relationships between the elements of a set. Some of the most common and oldest approaches involve the use of unsupervised competitive neural networks. However, these methods are not based on gradient optimization which has been proven to provide striking results in feature extraction also in unsupervised learning. Unfortunately, by focusing mostly on algorithmic efficiency and accuracy, deep clustering techniques are composed of overly complex feature extractors, while using trivial algorithms in their top layer. The aim of this work is to present a novel comprehensive theory aspiring at bridging competitive learning with gradient-based learning, thus allowing the use of extremely powerful deep neural networks for feature extraction and projection combined with the remarkable flexibility and expressiveness of competitive learning. In this paper we fully demonstrate the theoretical equivalence of two novel gradient-based competitive layers. Preliminary experiments show how the dual approach, trained on the transpose of the input matrix i.e. X-T, lead to faster convergence rate and higher training accuracy both in low and high-dimensional scenarios.
Type de document :
Communication dans un congrès
Liste complète des métadonnées
Contributeur : Louise Dessaivre Connectez-vous pour contacter le contributeur
Soumis le : mardi 5 avril 2022 - 16:25:06
Dernière modification le : mercredi 6 avril 2022 - 03:13:48

Lien texte intégral




Pietro Barbiero, Gabriele Ciravegna, Vincenzo Randazzo, Eros Pasero, Giansalvo Cirrincione. Topological Gradient-based Competitive Learning. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), Jul 2021, Shenzhen, China. ⟨10.1109/IJCNN52387.2021.9533411⟩. ⟨hal-03631429⟩



Consultations de la notice