Computer Science > Machine Learning
[Submitted on 10 Nov 2014 (this version), latest version 9 Sep 2019 (v3)]
Title:Similarity Learning for High-Dimensional Sparse Data
View PDFAbstract:A good measure of similarity between data points is crucial to the performance of many machine learning, data mining and information retrieval tasks. Metric and similarity learning methods have emerged as a powerful way to automatically learn them from data, but they do not scale well with the feature dimensionality. In this paper, we propose a similarity learning method that can efficiently deal with high-dimensional sparse data. This is done by assuming that the similarity parameters are decomposable as a convex combination of rank-one matrices with a specific sparsity structure, together with the use of an approximate Frank-Wolfe procedure to learn these parameters based on relative similarity constraints on the training data. Our algorithm greedily incorporates one pair of features at a time into the similarity, providing an efficient way to control the number of active features and thus reduce overfitting. It enjoys strong convergence guarantees and its time and memory complexity depends on the sparsity of the data instead of the dimension of the feature space. Our experiments on real-world high-dimensional datasets demonstrate its potential for classification, dimensionality reduction and data exploration.
Submission history
From: Aurélien Bellet [view email][v1] Mon, 10 Nov 2014 10:40:47 UTC (843 KB)
[v2] Wed, 21 Oct 2015 13:45:00 UTC (870 KB)
[v3] Mon, 9 Sep 2019 16:53:40 UTC (870 KB)
Current browse context:
cs.LG
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
IArxiv Recommender
(What is IArxiv?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.