Tag
Researchers have developed a bio-inspired algorithm called Spi-Fly, which mimics fruit fly olfactory systems using sparse coding to enable fast learning and prevent catastrophic forgetting in electronic noses.
Shruti Joshi invites attendees to a poster session at UncertaintyInAI to discuss research on improving Sparse Autoencoder (SAE) architectures for better out-of-distribution generalization.
This paper presents a hybrid amortized inference method that accelerates hierarchical sparse predictive coding by combining a fast initial estimate with corrective refinement steps, achieving better efficiency than pure iterative or amortized approaches.
The author shares their work on reducing the cost of multi-vector retrieval by using k-means as top-1 sparse coding. Omar Khattab adds that late-interaction sparse retrieval with neuron-level inverted indexing on unsupervised sparse autoencoders works well.
This paper proposes Single-stage Sparse Retrieval (SSR), which replaces K-means clustering with sparse autoencoders and inverted indexing, achieving 15x faster indexing and halved retrieval latency while improving accuracy on the BEIR benchmark.