Tag
This paper compares the geometric structures induced by deep learning vector embeddings (CamemBERT) and lexical co-occurrence graph models on the French 'Great National Debate' corpus, finding similar local topology but distinct global organization, highlighting complementarity between the two approaches.
The paper provides a geometric interpretation of last-layer model stealing attacks on transformers using exterior differential systems, showing that recovery of the projection matrix is governed by the polar space of a quadric. It also characterizes an identifiability wall below the last layer, revealing what can and cannot be extracted.
This paper introduces a probabilistic polygonal representation for plane curves using Gaussian Mixture Models, preserving local tangent, normal, and arc length while encoding uncertainty in the normal direction. The framework applies to various plane curves and supports uncertainty-aware geometric modeling for CAD, robotics, and trajectory planning.
edulab adds analytic geometry problem type, supports random problem generation, dynamic geometry board (2D Canvas drawing curves, moving lines, moving points, vectors, etc.) and KaTeX step-by-step parsing. It is an update to the open-source education skill tool.
A critique of the AI tutor Koji, highlighting flaws in its math teaching approach, such as allowing students to fumble without guidance and missing key conceptual explanations.
A pictorial introduction to differential geometry, showing how Maxwell's equations emerge from geometric concepts, based on a 2017 arXiv paper.
This paper investigates why LLMs fail at basic multi-operand addition by probing residual-stream activations, revealing geometric structures called Iso-Raw-Sum Trajectories (IRSTs) and explaining off-by-one errors as geometric slippages due to noisy latent carry representations.
Geomatic is a command-driven geometry studio that leverages automatic differentiation for interactive geometric operations.
This paper introduces LOES (Layer-wise Optimal Embedding Selection) and GeoReg (Geometric Regularization Loss), methods that select and fuse task-relevant intermediate layers from deep models to improve transfer learning performance, demonstrating consistent gains across architectures and modalities.
A webpage presenting known optimal packings of unit squares into a larger square, with interactive SVG diagrams for various numbers of squares.
A digital reproduction of Oliver Byrne's 1847 colorful edition of Euclid's Elements, featuring interactive diagrams, posters, and puzzles.
This paper introduces the Representation Gap, a metric for neural network generalization error with better asymptotic dynamics. Using a geometric perspective and optimal quantization theory, the authors show it is governed by the intrinsic dimension of the task, and verify this empirically on synthetic and realistic datasets.
OpenAI claims its unreleased reasoning model has solved the 80-year-old planar unit distance problem in mathematics, producing an original proof that outperforms traditional grid-based arrangements.
StampFormer is a physics-guided deep learning framework that fuses geometry and material properties to predict FEA outcomes for sheet metal stamping in under a second, achieving high fidelity with less than 8.5% relative error.
This paper investigates whether fMRI representations from different subjects' visual cortices can be aligned using unsupervised geometric methods, finding evidence for approximately isometric structure across individuals, extending the Platonic Representation Hypothesis to human brains.
This paper uses shape analysis tools to characterize how different data augmentation strategies reshape the geometry of neural network representations, finding that augmentation strength and type lead to distinct, well-behaved trajectories in shape space.
This paper introduces a unified geometric framework showing that weighted InfoNCE objectives can be interpreted as Distance Geometry Problems, providing exact characterizations of optimal embeddings for supervised and weakly supervised contrastive learning methods and revealing when such embeddings are geometrically realizable, degenerate, or inconsistent.
The article presents an elegant geometric proof for Buffon's Needle problem by extending the concept to curved 'noodles' and using a circle to determine the probability constant, avoiding complex integrals.
Researchers introduce GeoRepEval, a framework to evaluate LLM robustness across equivalent geometric problem representations (Euclidean, coordinate, vector). Testing 11 LLMs on 158 geometry problems, they find accuracy gaps up to 14 percentage points based solely on representation choice, with vector formulations being a consistent failure point.
RDP-LoRA uses geometric trajectory analysis and the Ramer-Douglas-Peucker algorithm to automatically select the most impactful layers for parameter-efficient fine-tuning, outperforming full-layer and random LoRA baselines.