A surprisingly effective way to estimate token importance in LLM prompts
You can find a live version of the demo here
pip install -r requirements.txt
OPENAI_API_KEY=<KEY> streamlit run app.pyFor more information, refer to the blog post
-
Notifications
You must be signed in to change notification settings - Fork 0
Streamlit demo for A surprisingly effective way to estimate token importances in LLM prompts
License
Watchfulio/heatmap-demo
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Streamlit demo for A surprisingly effective way to estimate token importances in LLM prompts