Picture for Zhenisbek Assylbekov

Zhenisbek Assylbekov

Gradient Descent Fails to Learn High-frequency Functions and Modular Arithmetic

Add code
Oct 19, 2023
Viaarxiv icon

Intractability of Learning the Discrete Logarithm with Gradient-Based Methods

Add code
Oct 02, 2023
Viaarxiv icon

Long-Tail Theory under Gaussian Mixtures

Add code
Jul 24, 2023
Viaarxiv icon

From Hyperbolic Geometry Back to Word Embeddings

Add code
Apr 26, 2022
Figure 1 for From Hyperbolic Geometry Back to Word Embeddings
Figure 2 for From Hyperbolic Geometry Back to Word Embeddings
Figure 3 for From Hyperbolic Geometry Back to Word Embeddings
Viaarxiv icon

Speeding Up Entmax

Add code
Nov 15, 2021
Figure 1 for Speeding Up Entmax
Figure 2 for Speeding Up Entmax
Figure 3 for Speeding Up Entmax
Figure 4 for Speeding Up Entmax
Viaarxiv icon

The Rediscovery Hypothesis: Language Models Need to Meet Linguistics

Add code
Mar 02, 2021
Figure 1 for The Rediscovery Hypothesis: Language Models Need to Meet Linguistics
Figure 2 for The Rediscovery Hypothesis: Language Models Need to Meet Linguistics
Figure 3 for The Rediscovery Hypothesis: Language Models Need to Meet Linguistics
Figure 4 for The Rediscovery Hypothesis: Language Models Need to Meet Linguistics
Viaarxiv icon

Binarized PMI Matrix: Bridging Word Embeddings and Hyperbolic Spaces

Add code
Feb 27, 2020
Figure 1 for Binarized PMI Matrix: Bridging Word Embeddings and Hyperbolic Spaces
Figure 2 for Binarized PMI Matrix: Bridging Word Embeddings and Hyperbolic Spaces
Figure 3 for Binarized PMI Matrix: Bridging Word Embeddings and Hyperbolic Spaces
Figure 4 for Binarized PMI Matrix: Bridging Word Embeddings and Hyperbolic Spaces
Viaarxiv icon

Semantics- and Syntax-related Subvectors in the Skip-gram Embeddings

Add code
Dec 23, 2019
Figure 1 for Semantics- and Syntax-related Subvectors in the Skip-gram Embeddings
Figure 2 for Semantics- and Syntax-related Subvectors in the Skip-gram Embeddings
Figure 3 for Semantics- and Syntax-related Subvectors in the Skip-gram Embeddings
Figure 4 for Semantics- and Syntax-related Subvectors in the Skip-gram Embeddings
Viaarxiv icon

A Critique of the Smooth Inverse Frequency Sentence Embeddings

Add code
Sep 30, 2019
Figure 1 for A Critique of the Smooth Inverse Frequency Sentence Embeddings
Figure 2 for A Critique of the Smooth Inverse Frequency Sentence Embeddings
Viaarxiv icon

Low-Rank Approximation of Matrices for PMI-based Word Embeddings

Add code
Sep 21, 2019
Figure 1 for Low-Rank Approximation of Matrices for PMI-based Word Embeddings
Figure 2 for Low-Rank Approximation of Matrices for PMI-based Word Embeddings
Figure 3 for Low-Rank Approximation of Matrices for PMI-based Word Embeddings
Figure 4 for Low-Rank Approximation of Matrices for PMI-based Word Embeddings
Viaarxiv icon