0

Topological Quality of Subsets via Persistence Matching Diagrams

A novel topological method using morphisms between persistence modules evaluates training dataset quality relative to full datasets to explain poor model performance.

Year
2023
Venue
arXiv 2023
Authors
3
Hosting
Abstract onlyARXIV-DEFAULT

Cite

Notes

Only stored in your browser.

Attribution

Abstract & full text
arxiv.org/abs/2306.02411v3ARXIV-DEFAULT
TL;DR
Semantic Scholar
Attribution policy →

Abstract

Data quality is crucial for the successful training, generalization and performance of machine learning models. We propose to measure the quality of a subset concerning the dataset it represents, using topological data analysis techniques. Specifically, we define the persistence matching diagram, a topological invariant derived from combining embeddings with persistent homology. We provide an algorithm to compute it using minimum spanning trees. Also, the invariant allows us to understand whether the subset ``represents well" the clusters from the larger dataset or not, and we also use it to estimate bounds for the Hausdorff distance between the subset and the complete dataset. In particular, this approach enables us to explain why the chosen subset is likely to result in poor performance of a supervised learning model.

Authors

3