arXiv

A Spectral Framework for Multi-Scale Nonlinear Dimensionality Reduction

Zeyang Huang, Angelos Chatzimparmpas, Thomas Höllt, and Takanori Fujiwara

Comparison of data structure, UMAP, and our spectral decomposition snapshots on three datasets. As the number of used spectral modes S increases, low-frequency snapshots recover coarse organization first and then add finer detail toward the full-spectrum embedding.

Dimensionality reduction (DR) is characterized by two longstanding trade-offs. First, there is a global–local preservation tension: methods such as t-SNE and UMAP prioritize local neighborhood preservation, yet may distort global manifold structure, while methods such as Laplacian Eigenmaps preserve global geometry but often yield limited local separation. Second, there is a gap between expressiveness and analytical transparency: many nonlinear DR methods produce embeddings without an explicit connection to the underlying high-dimensional structure, limiting insight into the embedding process. In this paper, we introduce a spectral framework for nonlinear DR that addresses these challenges. Our approach embeds high-dimensional data using a spectral basis combined with cross-entropy optimization, enabling multi-scale representations that bridge global and local structure. Leveraging linear spectral decomposition, the framework further supports analysis of embeddings through a graph-frequency perspective, enabling examination of how spectral modes influence the resulting embedding. We complement this analysis with glyph-based scatterplot augmentations for visual exploration. Quantitative evaluations and case studies demonstrate that our framework improves manifold continuity while enabling deeper analysis of embedding structure through spectral mode contributions


More Information

Gallery

Citation

Zeyang Huang, Angelos Chatzimparmpas, Thomas Höllt, and Takanori Fujiwara, A Spectral Framework for Multi-Scale Nonlinear Dimensionality Reduction, arXiv, 2026.

BibTex

@journal{bib:huang:2026,
    author       = { Huang, Zeyang and Chatzimparmpas, Angelos and Höllt, Thomas and Fujiwara, Takanori },    
    title        = { A Spectral Framework for Multi-Scale Nonlinear Dimensionality Reduction },
    journal      = { arXiv },
    year         = { 2026 },
    doi          = { 10.48550/arXiv.2604.02535 },
    url          = { https://publications.graphics.tudelft.nl/papers/844 },
}