Texonom
Texonom
/
Engineering
Engineering
/Data Engineering/Artificial Intelligence/AI Object/NLP/Language Model/Language Model Context/
Contextual Compression
Search

Contextual Compression

Creator
Creator
Seonglae Cho
Created
Created
2024 Jan 9 1:44
Editor
Editor
Seonglae Cho
Edited
Edited
2025 Jan 12 15:48
Refs
Refs
Prompt Learning
LM Context Extending

Prompt compression, Context compression

Contextual Compressions
LLMLingua
QFS
Selective Context
PRCA
RECOMP
SuRe
Filter-Ranker
SAMSUM/XSUM
Dynamic Token Pruning
KV Cache Compression
Ranked Recursive Summarization
 
 
Represent Compressions
Infini Transformer
Activation Beacon
AutoCompressors
LCIRC
 
 
 
arxiv.org
https://arxiv.org/pdf/2312.10997v1.pdf
Contextual compression | 🦜️🔗 Langchain
One challenge with retrieval is that usually you don't know the specific queries your document storage system will face when you ingest data into the system. This means that the information most relevant to a query may be buried in a document with a lot of irrelevant text. Passing that full document through your application can lead to more expensive LLM calls and poorer responses.
Contextual compression | 🦜️🔗 Langchain
https://python.langchain.com/docs/modules/data_connection/retrievers/contextual_compression
Contextual compression | 🦜️🔗 Langchain
 
 

Recommendations

Texonom
Texonom
/
Engineering
Engineering
/Data Engineering/Artificial Intelligence/AI Object/NLP/Language Model/Language Model Context/
Contextual Compression
Copyright Seonglae Cho