Picture for Xin Men

Xin Men

Exploring Context Window of Large Language Models via Decomposed Positional Vectors

Add code
May 28, 2024
Viaarxiv icon

Base of RoPE Bounds Context Length

Add code
May 23, 2024
Viaarxiv icon

ShortGPT: Layers in Large Language Models are More Redundant Than You Expect

Add code
Mar 07, 2024
Viaarxiv icon

Baichuan 2: Open Large-scale Language Models

Add code
Sep 20, 2023
Viaarxiv icon