Picture for Guy Dar

Guy Dar

In-context Learning and Gradient Descent Revisited

Add code
Nov 18, 2023
Viaarxiv icon

Analyzing Transformers in Embedding Space

Add code
Sep 06, 2022
Figure 1 for Analyzing Transformers in Embedding Space
Figure 2 for Analyzing Transformers in Embedding Space
Figure 3 for Analyzing Transformers in Embedding Space
Figure 4 for Analyzing Transformers in Embedding Space
Viaarxiv icon

LM-Debugger: An Interactive Tool for Inspection and Intervention in Transformer-Based Language Models

Add code
Apr 26, 2022
Figure 1 for LM-Debugger: An Interactive Tool for Inspection and Intervention in Transformer-Based Language Models
Figure 2 for LM-Debugger: An Interactive Tool for Inspection and Intervention in Transformer-Based Language Models
Figure 3 for LM-Debugger: An Interactive Tool for Inspection and Intervention in Transformer-Based Language Models
Figure 4 for LM-Debugger: An Interactive Tool for Inspection and Intervention in Transformer-Based Language Models
Viaarxiv icon

Memory-efficient Transformers via Top-$k$ Attention

Add code
Jun 13, 2021
Figure 1 for Memory-efficient Transformers via Top-$k$ Attention
Figure 2 for Memory-efficient Transformers via Top-$k$ Attention
Figure 3 for Memory-efficient Transformers via Top-$k$ Attention
Figure 4 for Memory-efficient Transformers via Top-$k$ Attention
Viaarxiv icon