8000 Releases Β· karakeep-app/karakeep Β· GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Releases: karakeep-app/karakeep

0.24.1

28 Apr 08:21
@MohamedBassem MohamedBassem
v0.24.1
5912277
Compare
Choose a tag to compare
0.24.1 Latest
Latest

This is a hotfix release for 0.24.0.

🐞 Fixes

  • Reverts the smart list expansion in list: and is:inlist qualifiers as it can cause Karakeep's server to OOM (#1321).
  • Adds missing translations for the new features released in 0.24.0.
Assets 2
Loading

0.24.0

27 Apr 18:55
@MohamedBassem MohamedBassem
v0.24.0
6178736
Compare
Choose a tag to compare
0.24.0

0.24.0 – Riding the MCP hype

Welcome to the 0.24.0 release of Karakeep! This release packs a ton of new stuff (we're back to shipping folks!). This release introduces a new MCP server for interacting with Karakeep through LLMs, a new rule generic rule engine for more control over organizing your bookmarks, new search qualifiers for feeds and bookmark age, overdue edit dialog for bookmark details, some UI polishing and more! This release also welcomes a TON of new contributors, @brandonw3612, @yorch, @Summon528, @dotvhs, @YTKme, @hasansino, @gomnitrix, @adripo, @meysam81, @SteffoSpieler, @jkywalker (And I probably missed some).

If you enjoy using Karakeep, consider supporting the project here β˜•οΈ or via GitHub here.

New Features πŸš€

✨ MCP Server ✨

Unless you've been living under a rock recently, you've heard about the recent explosion of MCP servers all over the internet.
We're not going to miss the hype. This release ships a new MCP server (docs) that allows you to interact with your Karakeep instance and bookmarks through extrenal LLMs.
You can ask the LLM to summarize your bookmarks, search the web and send what it finds to Karakeep, or archive your recent chat as a text note in karakeep.
It can create new lists, attach tags and more to help you organize your bookmarks.

CleanShot 2025-04-27 at 7β€― 39 35@2x

More demos in the screenshot section.

Generic Rule Engine βš™οΈ

Karakeep was born because I don't want to spend time organizing what I hoard. I just throw stuff in there and karakeep's tagging and search will help me retrieve it later.
However, turns out that not everyone is in the same camp. If you're one of those people who enjoy organizing their bookmarks, this feature is for you.
This release introduces a new generic rule engine that allows you to define arbitrary processing rules for organizing your bookmarks.

Some examples:

  1. If a bookmark is added, and it's coming from youtube, tag it with "#youtube" and "#video".
  2. If a bookmark is favourited, download an offline archive for it.
  3. If the tag "#fashion" is added to a bookmark, and this bookmark is an image, then add it my "Inspiration" list (You're better off using a smart list for this though).

CleanShot 2025-04-27 at 7β€― 35 55@2x

⚠️ The firefox extension is back under a new name (Action Required) ⚠️

After the rebranding unfortunatly we couldn't get the old Firefox extension back, so we had to publish a new one (link).
If you're using the old "firefox" extension, you MUST migrate to the new one manually otherwise you won't be getting future updates.

And more!

  • gpt-4.1-mini is the new default text model: The default OpenAI text model changed to the new 4.1-mini. It's slightly more expensive than 4o-mini, but is supposed to be much smarter. The image model remains as 4o-mini as 4.1-mini is more expensive for images.
  • New Search & Smart list Qualifiers:
    • New β€œage:” search qualifier to show bookmarks older or newer than a given duration (by @brandonw3612).
    • New "feed:" search qualifier to find bookmarks imported from certain RSS feeds.
    • You can find the full query language here.
  • Edit Bookmark Details: You can now edit almost all the details of bookmarks. The URL, summary, creation date, everything. This is obviously very overdue.
  • List Merging: You can now merge lists together thanks to @gomnitrix.
  • Import Tab Session Manager Sessions: Bulk-import your Chrome/Firefox Tab Session Manager session files as Karakeep bookmarks by @yorch.
  • Configuring other AI providers: We added documentations for how to configure other AI providers beside OpenAI (link). This includes providers like Google AI Studio, OpenRouter, Perplexity, etc.
  • Karakeep on TrueNAS: People using TrueNAS can now find Karakeep in TrueNAS' app store thanks to @stavros-k.

UX Improvements ✨

  • Some UI polish
    – Reduced shadows, lighter font weights, smaller editor box following the suggestions of @dotvhs in #1261!
    – Removed focus rings where they don't matter much, fix popovers to the emoji picker (by @Mxrk), and list items in the sidebar now get truncated if they're long.
    – Fixed margins of the β€œNew List” button, and fixed spinner visibility during AI summarization
  • Cached content is now called β€œReader Mode” content.
  • There's now a nice looking "No bookmarks" banner for search and empty smart lists.
  • Lists now can have a short description beside their name (by @ekambains).
  • A new monochrome icon for android builds by @SteffoSpieler.
  • Copy link button now gets greyed out when on a non-secure context by @ekambains.
  • The github link in the sidebar now works correctly for people on the nightly build thanks to @hasansino.

For Developers πŸ› οΈ

  • Added includeContent to the API endpoints that return bookmarks (Listing, search, etc) to control whether the endpoint should include the content of the bookmark (which can be huge or not).
    • ⚠️ For backward compatibility, this defaults to true, but starting from the next release, this will default to false. So if your tool relies on the content of the bookmarks, start passing this to true now.
  • The API docs have a new look. The new look also fixes the enum-like requests types (like the one in createBookmark).

Fixes πŸ›

  • Smart lists in search: Smart lists are now correctly resolved in the search qualifiers list: and is:inlist.
  • A much faster homepage loading times: If you've been a user for the SingleFile extension, Karakeep's homepage might have started getting slower recently. The UI was accidently downloading a big chunk of the archive in the homepage when it's not needed. This is now fixed.
  • Faster Imports: Importing bookmarks used to be extremely slow, now it's done with much higher parallelism and should be significantly faster.
  • Dark-mode icons for the firefox extension @L-K-M
  • Fixed the list getting opened when editing it from the sidebar.
  • Added a new INFERENCE_OUTPUT_SCHEMA configuration to restore support for models that only works with JSON mode (instead of the newer structured output mode).
  • Passwords stored in the database are now salted. For backward compatibility, existing users will continue using an empty salt until they change their password.
  • Karakeep now closes the browser after it's done crawling in "on demand" mode by @Summon528.
  • Fixed a bug in content extraction that might result in a suboptimal "cached content" being shown.
  • Triggering a search re-index now drops all the documents first to avoid dangling documents.

Community Projects πŸ’‘

Github 2 Karakeep Importer

By @hasansino

Exports your github stars automatically to Karakeep! Get it here.

Screenshots πŸ“Έ

MCP Demo

CleanShot 2025-04-27 at 6β€― 57 47
CleanShot 2025-04-27 at 6β€― 59 25
CleanShot 2025-04-27 at 7β€― 08 38

The new "No Bookmarks banner"

CleanShot 2025-04-27 at 7β€― 41 54@2x

Bookmark Editing Dialog

CleanShot 2025-04-27 at 7β€― 42 52@2x

Upgrading πŸ“¦

If you’re using KARAKEEP_VERSION=release:

docker compose pull && docker compose up -d

If you pin to a specific version, update KARAKEEP_VERSION, then:

docker compose pull && docker compose up -d

All Commits

Read more

Contributors

yorch, dotvhs, and 16 other contributors
Loading
8 Join discussion

0.23.2

06 Apr 07:14
@MohamedBassem MohamedBassem
v0.23.2
27324a9
Compare
Choose a tag to compare
0.23.2

This is a dummy release to retrigger the generation of the ARM builds. Refer to the releases notes of 0.23.1 instead.

Loading

0.23.1

05 Apr 15:37
@MohamedBassem MohamedBassem
v0.23.1
16866d8
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
0.23.1

0.23.1 (Hoarder is rebranding to Karakeep)

This is not a typical release. Hoarder is rebranding to Karakeep. For context about the rebranding, check out the reddit announcement here.

The name Karakeep is inspired by the Arabic word "ΩƒΨ±Ψ§ΩƒΩŠΨ¨" (karakeeb), a colloquial term commonly used to refer to miscellaneous clutter, odds and ends, or items that may seem disorganized but often hold personal value or hidden usefulness. It evokes the image of a messy drawer or forgotten box, full of stuff you can't quite throw awayβ€”because somehow, it matters (or more likely, because you're a hoarder!).

However, we also have a couple of new contributors to this minor version. Welcome @ekambains, @Summon528, @jaworek, @jferch, @denysdovhan to the contributors list!

If you enjoy using Karakeep, consider supporting the project here β˜•οΈ or via GitHub here.

New Features πŸš€

  • Well, we're rebranding!
    • This release shows a banner in the admin panel about the rebranding. It's still unclear whether I'll be able to continue updating the hoarder docker image after the repo name change, so I wanted what might potentially be the last stable release on this image to inform the people about the change in the image name. If it turns out that I can continue updating the image, I'll drop the banner.
    • Please note that the new docker image will not yet be available until I execute the repo transfer.
  • You can now store the assets in a separate directory by setting the ASSETS_DIR env variable. This allows people to offload the assets that can potentially grow larger into a network-mounted directory for example.
  • Hoarder now stores and indexes the author and publisher attributes of links. In a future release, we'll start showing them in the UI. (by @erik-nilcoast).

UX Improvements ✨

  • Clicking view original now opens in a blank tab (by @ekambains).
  • Link to Github release page in web sidebar (by @aworek).
  • Drop the font weight from sidebar items which makes the sidebar slightly nicer.

Fixes πŸ›

  • Fixes issue where hoarder was running out of memory when uploading a large archive with SingleFile.
  • Added a configurable crawler screenshot time CRAWLER_SCREENSHOT_TIMEOUT_SEC (by @Summon528)

Upgrading πŸ“¦

To upgrade:

  • If you're using HOARDER_VERSION=release, run docker compose pull && docker compose up -d.
  • If you're pinning it to a specific version, upgrade the version and then run docker compose pull && docker compose up -d.

All Commits

Contributors

MohamedBassem, denysdovhan, and 6 other contributors
Loading
7 Join discussion

0.23.0

22 Mar 17:18
@MohamedBassem MohamedBassem
v0.23.0
a384860
Compare
Choose a tag to compare
0.23.0

0.23.0

Welcome to the 0.23.0 release of Hoarder! This release brings quality of life improvements, bug fixes, and introduces several new features, including the long awaited safari extension, PDF screenshotting, bulk tag deletion, and an assets management page! We welcome new contributor @Kaio-Cesar, @erik-nilcoast, @mos3abof, @halkeye, @saadmanfarhad, and @lexafaxine (and as usual, many more translators on Weblate!).

If you enjoy using Hoarder, consider supporting the project here β˜•οΈ or via GitHub here.

New Features πŸš€

  • Safari Extension: The long awaited safari extension is now finally in TestFlight.
  • PDF Screenshot Generation and Display (by @AhmadMuj): Hoarder can now generate screenshots for PDF files and display them, making it easier to preview and identify saved PDFs.
  • Bulk Tag Deletion (by @lexafaxine): You can now delete multiple tags at once, simplifying tag management.
  • Asset Management Page: A new settings page allows you to manage your assets and find the ones eating most of your storage.
  • "AI Tagged" Webhook Trigger: You can now configure webhooks to trigger when AI automatically tags a bookmark.
  • YTDLP Command Line Arguments: youtube-dl library supports a ton of configuration and flags. This release allows you to configure the flags that gets passed to the YTDLP binary for better control on video downloads. (by @erik-nilcoast)

UX Improvements ✨

  • Import/Export Page got redesigned to look slightly nicer.
  • The web UI now displays statistics for your lists directly in the sidebar.
  • Merged background jobs stats and admin actions in the admin panel. Also the stats show more workers that were previously missing.
  • Multiple new languages got enabled (Arabic, Slovak, Portuguese (Brazil), Slovenian & Vietnamese). Some of those languages are AI translated, please help us enhance them over at weblate.

For Developers πŸ› οΈ

  • Bookmark Summarization: The API now exposes a way to trigger bookmark summarization. (by @erik-nilcoast)
  • User Stats Endpoints: Added new endpoints to retrieve user information and statistics. This is used by the new homepage widget support implemented by @vhsdream.
  • We now have a new CONTRIBUTING.md.
  • Added instructions for setting up the Node.js environment for development (by @mos3abof)

Fixes πŸ›

  • Fixed an issue that was preventing the use of LLM providers like gemini and preplexity. If you're running ollama, you might need to upgrade your server to a newer version. If the model you're using doesn't support structured outputs, set INFERENCE_SUPPORTS_STRUCTURED_OUTPUT=false.
  • Fixed an issue where shared links on mobile were incorrectly stored as text (undergoing apple's review).
  • Fixed webhook events being sent regardless of user-selected operations.
  • Fixed an issue were RSS feed ingestion was failing for some feeds.
  • You can now access the lists from the PWA, which was missing before.
  • Hardened the getBookmarks endpoint against inconsistent bookmarks.
  • Fixed an issue in mobile to correctly set a dark theme classname to update the header text color. (by @saadmanfarhad).
  • Fixed corepack issues in the CI and docker build, and in the Linux installation script.
  • Added a custom fetch wrapper for Ollama inference that prevents timeouts for slow ollama instances (by @halkeye)
  • Added an environment variable to configure OAuth timeouts. (by @Kaio-Cesar)

Community Projects πŸ’‘

Hoarder Random Bookmark

By @treyg

Sends random bookmarks from your Hoarder account to your email, Discord or exposes your hoarder bookmarks over RSS. Get it here.

Homepage Widget

By @vhsdream

Homepage now has a Hoarder widget that exposes stats about your bookmarks. Get it here.

Screenshots πŸ“Έ

The new Asset Management Page

Screenshot 2025-03-22 at 5 08 12β€―PM

The redesigned Import/Export page

Screenshot 2025-03-22 at 5 08 26β€―PM

Upgrading πŸ“¦

To upgrade:

  • If you're using HOARDER_VERSION=release, run docker compose pull && docker compose up -d.
  • If you're pinning it to a specific version, upgrade the version and then run docker compose pull && docker compose up -d.

All Commits

Contributors

halkeye, mos3abof, and 9 other contributors
Loading
1 Join discussion

0.22.0

02 Feb 17:40
@MohamedBassem MohamedBassem
v0.22.0
ed8fd79
Compare
Choose a tag to compare
0.22.0

0.22.0

Welcome to the 0.22.0 release of Hoarder! This is a lightweight release given the recent events. This release introduces Webhook support, SingleFile support, bookmark sorting, and a lot of fixes! As usual, welcoming our new contributors @hanguofeng, @dakshpareek, @danielvigaru, @techtrd & @meysam81 (and a lot more translators on weblate)!

If you enjoy using Hoarder, consider supporting the project here β˜•οΈ or via GitHub here.

New Features πŸš€

  • Webhook support (by @hanguofeng): Hoarder can now be configured to send webhooks whenever a new bookmark is created/edited. You can use that to trigger further automation/actions in external apps.
  • SingleFile Support: Hoarder now supports being a destination for the SingleFile extension. This allows you to store content from websites that requires authentication for example which wasn't possible before. Read more about how to configure it here.
    • This is an experimental feature and is meant to be a stopgap until native support for it in the extension is added.
    • Currently, screenshotting for websites archived this way is not supported. We're planning to add it in a future release.
  • Summarization Prompt Customization: Similar to the tagging prompts, you can now customize the summarization prompt with your own custom rules in the "AI Settings" page.
  • Bookmark Sorting (by @dakshpareek): You can now sort your bookmark grid by newest/oldest.

UX Improvements ✨

  • You can now search by bookmark types with the new search qualifiers is:link, is:text or is:media.
  • Smart list dialog now contains a link to the query language documentation and also shows the parsed query as you write it.
  • @danielvigaru fixed the margins of the lists page in the mobile app.

For Developers πŸ› οΈ

  • Hoarder now tracks bookmark modification times and exposes it in themodifiedAt field in the bookmark schema. This can be useful that uses the API for syncing changes.
  • @techtrd landed a bunch of improvements to the kubernetes documentation and templates! Check it out at this link.

Fixes πŸ›

  • Mobile image uploads has been broken for a while (I'm sorry!). This is now fixed and pending google/apple's review for the release (it's a client side bug).
  • Installing hoarder on ubuntu/LXC containers got broken last week due to one un pinned linter dependency. This is now fixed.
  • Background job timeouts sometimes used to result into duplicate full page archives (which eats a ton of storage). This should be now fixed.
  • Mobile app sign in page used to sometimes flicker rapidly if you enter it with the keyboard open (I hate mobile app development!). This is now fixed.
  • Search queries for tags/lists that starts with "and"/"or" (such as #android) where not getting correctly parsed. This is now fixed.
  • The highlight feature from last release was making it hard to copy content from articles you saved. This is now fixed.
  • You no longer need to set NEXTAUTH_URL_INTERNAL as it's now baked into the docker image.
  • Doing a bulk action with 150+ bookmarks selected no longer fails.
  • The url qualifier in search now also matches the source URLs of assets (e.g. when you clip a quote from a website using the extension).
  • RSS fetcher now uses firefox's user agent thanks to @meysam81.
  • Tags that was attached at least once by humans will no longer show up in the "AI tags" section in the "All Tags" page.
  • Default max upload size has been increased to 50MB instead of 4MB.
  • Spanish translation wasn't working, this is fixed now. We've also added Hungarian translation.

Community Projects πŸ’‘

Checkout our community projects page here. We're featuring two community projects in this release:

Obsidian Sync Plugin

By @jhofker

An Obsidian plugin that syncs your Hoarder bookmarks with Obsidian, creating markdown notes for each bookmark in a designated folder. Get it here, or install it directly from Obsidian's community plugin store (link).

Hoarder's Pipette

By @DanSnow

A chrome extension that injects hoarder's bookmarks into your search results (inspired by linkding-injector). Get it here.

Screenshots πŸ“Έ

Webhook Settings

Screenshot 2025-02-02 at 5 03 26β€―PM

Bookmark Sorting

Screenshot 2025-02-02 at 5 04 02β€―PM

Query Explanation in List Dialogs

Screenshot 2025-02-02 at 5 16 23β€―PM

Upgrading πŸ“¦

To upgrade:

  • If you're using HOARDER_VERSION=release, run docker compose pull && docker compose up -d.
  • If you're pinning it to a specific version, upgrade the version and then run docker compose pull && docker compose up -d.

All Commits

Contributors

hanguofeng, henrikno, and 10 other contributors
Loading
1 Join discussion

0.21.0

05 Jan 16:36
@MohamedBassem MohamedBassem
v0.21.0
12cb8c5
Compare
Choose a tag to compare
0.21.0

0.21.0 - The 10k ⭐ release!

Welcome to the 0.21.0 release of Hoarder! Hoarder just hit 10k stars on github and I can't be more grateful! We wouldn't have hit this milestone without all of our contributors, users and the awesome community at /r/selfhosted! Over the holidays, Hoarder got featured at the homepage of hackernews for an entire day!

We're celebrating this milestone, with a release that contains some of the long awaited features! This release introduces advanced search capabilities, smart lists, highlighting support, a TypeScript SDK, and more! As usual, we're excited to welcome our new contributors: @lexafaxine, @jdhartley, @medo & @circuitcreature!

If you enjoy using Hoarder, consider supporting the project here β˜•οΈ or via GitHub here.

New Features πŸš€

  • Advanced Search Capabilities: Hoarder's search just got much more powerful. You can now add search "qualifiers" to refine your search results. Qualifiers include: tags, lists, favourite/archived status, creation date, etc. You can read about the new query language here. Some examples:
    • is:fav after:2024-01-01 before:2024-12-31: Find all the bookmarks that are favourited and created in 2024.
    • (#neovim or #vscode) and -is:archived: Find all the non-archived bookmarks that are tagged either with #neovim or #vscode.
    • is:archived -is:inlist: Find all the bookmarks that are archived but are not sorted in any list.
    • url:github.com neovim: Find all the bookmarks that were hoarded from github and contains the neovim term in its content.
    • Special shoutout to @kamtschatka who first advocated for the powerful search language and did the first implementation.
  • Smart Lists: With the new powerful search, hoarder now allows you to save your searches as what we're calling "smart lists". Smart lists saves you the hassle of manually managing lists, and allows you create an automatic lists that dynamically matches a specific search query. For example:
    • Instead of manually managing a list called 3d Printing, you can now create a smart list with the query url:makerworld.com or url:printables.com or #3dprinting. Which will include everything you hoarded from popular 3d printing websites and everything the AI/you tagged with the 3d printing tag.
    • A smart list with the query url:reddit.com/r/selfhosted and is:fav will include all the stuff that you hoarded from the r/selfhosted subreddit and favourited.
  • Highlighting Support: You can now highlight your favourite quotes from the links that you hoard, and have a way to view all what you've highlighted. This was one of the most requested features specially for those coming to Hoarder from Omnivore.
  • Linkwarden Import: You can now import your bookmarks from Linkwarden thanks to @circuitcreature).
  • More translations: Croatian, Danish, Dutch, Galician, Italian, Japanese, Polish, Russian, Spanish & Turkish. Thanks to all those who contributed those translations over weblate (@Jaksa101, @bcanata, @KilFer, @mathyvds and more on weblate).

UX Improvements ✨

  • The admin page now features a sidebar layout, for a more consistent experience with the settings page.
  • Bookmarks created over a year ago now show the creation year in the card footer (@jdhartley).
  • Added a confirmation dialog before deleting bookmarks to prevent accidental deletions (by @lexafaxine).
  • Previously, search used to show only at most 20 bookmarks. This now fixed, and you can scroll across search results.

For Developers πŸ› οΈ

  • We're now publishing a minimal typescript sdk on npm. This allows you to quickly call hoarder's API endpoints with strong typing in both the requests and responses.
  • The search endpoint is now exposed in the REST API as GET /bookmarks/search with the support for advanced search queries.
  • You can now manipulate the assets attached to a bookmark with the new /bookmarks/assets/... endpoints.
  • The new highlights feature is also available via the API in /bookmarks/highlights/... endpoints.

Fixes πŸ›

  • Fix missing scrollbar in the preview model for long notes.
  • Refactored asset serving to not load the entire asset in memory. This should result in lower memory consumption when serving large assets (e.g. videos and full page archives).
  • Added support for self signed certs for android by @CrypticC3s4r (pending mobile app release).
  • Previously the iOS app didn't allow connecting to hoarder over http, this limitation should no longer by there (pending mobile app release). Though honestly, you probably shouldn't be serving hoarder over http.
  • Mobile devices without cameras (e.g. eink tablets) were not able to install the app. This is now fixed (pending a mobile app release).

Community Projects πŸ’‘

Checkout our community projects page here.

Screenshots πŸ“Έ

Highlights Support

Screenshot 2025-01-05 at 4 29 59β€―PM Screenshot 2025-01-05 at 4 30 08β€―PM Screenshot 2025-01-05 at 4 30 23β€―PM

Smart Lists

Screenshot 2025-01-05 at 4 32 16β€―PM

The new Admin Page

Screenshot 2025-01-05 at 4 33 30β€―PM

Upgrading πŸ“¦

To upgrade:

  • If you're using HOARDER_VERSION=release, run docker compose pull && docker compose up -d.
  • If you're pinning it to a specific version, upgrade the version and then run docker compose pull && docker compose up -d.

All Commits

Read more

Contributors

kamil, medo, and 16 other contributors
Loading
6 Join discussion

0.20.0

22 Dec 11:21
@MohamedBassem MohamedBassem
v0.20.0
e3b8cda
Compare
Choose a tag to compare
0.20.0

Welcome to the 0.20.0 release of Hoarder! This release adds internationalization support, new markdown editor, mobile app improvements, broken link management and more! As usual, we're welcoming our new contributors: @Tukks, @vhsdream, @sweepies, @PeterDaveHello, @wuast94 and @eltociear!

If you're enjoying Hoarder, you can consider supporting it here β˜•οΈ or via github here.

New Features

  • Hoarder's UI now comes in multiple languages!
    • You can change the language of the UI now to English, German, French, Swedish, Simplified and Traditional Chinese.
    • If you want to see your language there or want to improve some existing translation, you can do that via weblate here.
  • New experimental WYSIWYG markdown editor for notes by @Tukks!
    • You'll now get a preview of the notes you're writing as you're writing them!
  • A bunch of mobile app improvements:
    • You can now manage tags from the app. Super overdue, I know.
    • We have a new cleaner "info" page with the ability to edit title/tags/lists all in one page.
    • The mobile app now looks slightly more native. We've got rid of the dedicated search tag, switched to native modals, and used native page headers when possible.
    • Note: The apps are yet to be approved by apple & google.
  • Broken Link management:
    • Hoarder now stores the status codes it got when crawling websites which will allow you to identify and decide what to do about broken links.
    • This is now mainly useful for people doing large imports into hoarder, but in the future, we'll use the same mechanism to support automatic link liveness healthchecks.
  • Chrome as an optional dependency (aka minimal installation):
    • Chrome is no longer a hard dependency. This is useful for people running hoarder in resource constrained environments.
    • If you don't specify a BROWSER_WEB_URL, hoarder will fallback to a plain HTTP requests to the websites you add instead of crawling them with chrome.
    • Without chrome, you'll lose the ability to get screenshots from the websites you crawl, and websites that heavily rely on javascript won't work properly.
    • With chrome and meilisearch being optional dependencies, you can now get a single-container minimal installation of hoarder by sacrificing some of the features.
  • New installation methods:
    • Debian / Ubuntu one click installation script (docs) by @vhsdream
    • If you're a proxmox user, you can also get a one click LXC container running hoarder using proxmox's helper scripts again thanks to @vhsdream.
    • PikaPod (docs) are now offering paid hoarder hosting (~$3/month) for the less tech savvy folks out there. Disclaimer: they're sharing some of their revenue from Hoarder with us.
  • Tags placeholder in AI prompt customization:
    • You can use the placeholders $tags, $aiTags, $userTags in the prompt. These placeholders will be replaced with all tags, ai generated tags or human created tags when automatic tagging is performed thanks to @kamtschatka.
    • With that, you can use this to instruct the LLM to only use existing tags (instead of coming up with new ones). Be careful though if you have a lot of tags as it might increase the cost of the tagging significantly.
    • This mechanism is just a temporary solution. We're working on a mechanism to support this natively, in a much cheaper way.
  • New community projects documentation page (here):
    • With the release of the REST API in the last version, we started seeing some community projects pop up. So we're starting a new documentation page to list them out for visibility.
    • Hoarder now has a raycast extension and an alfred workflow thanks to @foru17 and @yinan-c. Go install them now!
    • If you develop a new extension for hoarder, let us know as we'd love to feature it in that page!
  • Others:
    • We've added the ability to show admin warnings in the admin panels for misconfigurations or future migrations.

UX Improvements

  • We're now trimming email addresses out of whitespaces during signin thanks to @sweepies!

Fixes

  • AI summarization sometimes included the LLM's response to the prompt (e.g. "Ok, I'll summarize ..."). We're now instructing the model to only respond with the summary.
  • Fix broken homepage when hitting a bookmark with an invalid image URL.
  • Multiple worker reliability improvements specially in countries with restricted internet.
    • The worker container doesn't need to download pnpm on startup anymore as it's now bundled in the container.
    • The crawler's adblock list download now has a timeout and can be completely bypassed with CRAWLER_ENABLE_ADBLOCKER=false.
    • The worker was sometimes hanging in the screenshot call. This now has a timeout as well.

Screenshots

The new Markdown Editor

Screenshot 2024-12-22 at 12 59 10β€―PM

Broken Link Management

Screenshot 2024-12-22 at 1 04 43β€―PM

Mobile App Improvements

New options at the bottom of the bookmark preview page

3EA11BCA-C06A-4681-AC44-D87DB9BC8954

Tag Management
9A4562B4-9429-41CA-AFCC-0A45941D3ACF

The new info page
E679CFD4-7EEB-4910-8FD6-B1EC92090D81

Admin Notices

Screenshot 2024-12-22 at 12 57 10β€―PM Screenshot 2024-12-22 at 12 57 20β€―PM

Raycast extension and Alfred workflows

Those screenshots are from the authors of the extensions.

Raycast extension by @foru17

image

Alfred workflow by @yinan-c

image

Upgrading

To upgrade:

  • If you're using HOARDER_VERSION=release, run docker compose pull && docker compose up -d.
  • If you're pinning it to a specific version, upgrade the version and then run docker compose pull && docker compose up -d.

All Commits

Read more

Contributors

murray3k, foru17, and 10 other contributors
Loading
7 Join discussion

0.19.0

09 Nov 16:22
@MohamedBassem MohamedBassem
v0.19.0
0f59cb6
Compare
Choose a tag to compare
0.19.0

Welcome to the 0.19.0 release of Hoarder! This release is packed with a lot of new features! The long awaited REST APIs, RSS subscriptions, AI summarization, Image OCR, archiving videos, importing from Omnivore, and more!

If you're enjoying Hoarder, you can consider supporting it here β˜•οΈ.

New Feature

  • RSS Subscriptions πŸ§ͺ: You can now subscribe to RSS feeds and Hoarder will automatically pull them every hour.
    • You can use this to auto hoard stuff from your favourite blogs, subreddits, or youtube channels.
    • This feature is still experimental and haven't been tested on a a wide variety of feeds. Please file issues whenever you face any problems using it.
  • The long awaited REST API is here. You can view the API docs here.
    • You can view the OpenAPI spec here in case you want to generate clients for it. I'm planning to offer an official Typescript SDK some time in the future.
  • AI Summarization: Hoarder now has the ability to generate summaries for the links that you hoard! Check the screenshots section to see it in action.
    • Currently, summarization is a manual action. In the future, we'll add support for auto summarization.
  • Video downloads: For ultimate hoarding, Hoarder now has the ability to download videos from the links that you hoard (e.g. youtube) thanks to @kamtschatka.
    • Given that videos can be huge, this is an opt-in feature. You can enable it with CRAWLER_VIDEO_DOWNLOAD=true. Find more configuration options here.
    • Hoarder uses ytdl under the hood, and you can find their list of supported files here.
  • Omnivore Imports: Omnivore is shutting down. You can now import your bookmarks from Omnivore into Hoarder. Check the documentation here.
  • User Management: Admins can now reset user passwords, change their roles and even create new users thanks to @kamtschatka.
  • Image OCR: Hoarder will now attempt to read and index text in the images that you hoard! Check the configuration variables here.
  • Others:
    • @kamtschatka Added authentication failure logging in case you want to configure fail2ban against hoarder logs.

UX Improvements

  • We have a new redesigned settings page to better support the new options we're adding. Check it out in the screenshot section.
  • You can use Cmd/Ctrl + K to quickly focus on Hoarder's searchbar.
  • We reverted the mobile apps to again view webpages inline, but now added buttons for quick actions underneath it.

Fixes

  • Single new lines in notes were getting lost in markdown. @kamtschatka fixed that.
  • Pocket switched their export format to CSVs instead of their old format. Hoarder now supports importing the new format.
  • Tags that had numbers or dashes in them were getting skipped, this is now fixed. Thanks @MakeSomeGood for the bug report and investigation!
  • The All Tags page was getting very slow when there's a lot of tags. This turned out to be a small misconfiguration in the database that we fixed.
  • Custom prompts had a max length of 100, which wasn't enough to some people. The new limit is 500.

Screenshots

AI Summarization

Screen.Recording.2024-11-09.at.4.12.35.PM.mov

RSS Feeds & New Settings Page

Screenshot 2024-11-09 at 4 11 59β€―PM

Admin User Management

Screenshot 2024-11-09 at 4 15 47β€―PM

Upgrading

To upgrade:

  • If you're using HOARDER_VERSION=release, run docker compose pull && docker compose up -d.
  • If you're pinning it to a specific version, upgrade the version and then run docker compose pull && docker compose up -d.

All Commits

Contributors

bjornmonnens, MohamedBassem, and 3 other contributors
Loading
0 Join discussion

0.18.0

13 Oct 14:50
@MohamedBassem MohamedBassem
v0.18.0
43ed698
Compare
Choose a tag to compare
0.18.0

Welcome to the 0.18.0 release of Hoarder! This release introduces customizable tagging rules (aka customizing the prompt), new UI look, selective full page archives, infinite scrolling, more bulk actions and more! As usual, we'd like to welcome our first time contributors @jarednipper, @Trugamr, @cedmax and @CrypticC3s4r! We also have @lucius346346 working behind the scene on improving the UX of Hoarder with amazing designs! And finally, we have our usual contributors @kamtschatka and @mdsaban! Also thanks to @Papierkorb for the help in suggestions to improve the LLM prompt!

We also now have a public roadmap which you can check for the features that we're planning to deliver here. Go upvote the features that you're waiting for!

If you're enjoying Hoarder, you can consider supporting it here β˜•οΈ.

New Feature

  • Introducing customizable tagging rules: You can now customize the prompt that we use to generate the tags to your linkings and add custom rules for the LLM to adhere to!
    • You can use this to define your tagging rules in natural language and let the LLM take care of applying it.
  • If you don't want to enable "Full page archives" by default, you can now selectively archive particular pages that you want to keep forever thanks to @kamtschatka!
  • You can now export your bookmarks from Hoarder and re-import them back in another instance (note: currently images and pdfs are not exported).
  • You can now customize the context length of the inference model using the INFERENCE_CONTEXT_LENGTH flag:
    • The bigger this value is, the more of your content the model will see and will be able to give you better tagging.
    • However, the bigger the context window, the more expensive the request is for OpenAI money-wise and for ollama resource-wise.
    • The current default is 2048 tokens (~2048 words).
  • Better asset tracking and management:
    • We're now currently correctly accounting for all asset sizes in the database. You can view the usage of every user now in the admin panel.
    • Old assets are not automatically accounted for and you'll have to click the new Compact Asset button in the admin panel to backfill that data. This button also removes assets that are dangling (aka not linked to any bookmark).
    • This work is in preparation for supporting better privacy checks in the future when we implement public and collaborative lists.
  • You can now attach custom image banners to your notes.
    • Those banners will appear at the top of your notes when you expand them as well as in the List layout.
    • We're still figuring out a good way to render them in the grid and masonry layouts.

UX Improvements

  • We have a refreshed UI looks thanks to amazing designs by @lucius346346!
    • We now have a sticky navbar for better experience in bulk editing thanks to @mdsaban.
    • We also have a new profile options dropdown in the header where the user and admin settings buttons got moved to.
  • We now have infinite scrolling for pagination so that you no longer need to click the Show more button.
  • Bulk actions improvements:
    • There's now a Select all button to select all the currently visible bookmarks.
    • Copy links is also a thing to bulk copy the source links of a bunch of bookmarks thanks to @kamtschatka.
  • You can now trigger AI tag regeneration for all bookmarks or the ones that that failed only in the admin panel.
  • When you hoard text from other webpages by the extension (by highlighting text -> right click -> add to hoarder) the source link will now be preserved with the text.
  • We have a new tabbed user settings page as it was getting quite long.
  • Sidebar items were not clickable around the boarder which was annoying. @Trugamr fixed that!

Fixes

  • For those who want to go all-in on Oauth, you can now set DISABLE_PASSWORD_AUTH=true which will forbid any password-based authentication/signup. This is implemented by @kamtschatka.
  • The All Tags page was taking too long to load when you have too many tags. @kamtschatka landed some improvements to the performance of this page.
  • Editing lists from the sidebar was broken, now it's fixed.
  • When you wipe your hoarder's database while still logged in the browser, users were getting some confusing behavior with confusing database errors. This is now fixed, and hoarder will automatically log you out if your account is no longer there.
  • @Mxrk Added docker healthchecks to the dockerfile and also source label so that hoarder's updates can be correctly reflected in stuff like renovate.

Screenshots

The new UI Look

Screenshot 2024-10-13 at 3 16 59β€―PM

Profile Options

Screenshot 2024-10-13 at 3 49 02β€―PM

AI Settings and Tagging Rules

Screenshot 2024-10-13 at 3 18 55β€―PM

New Import/Export Buttons

Screenshot 2024-10-13 at 3 19 46β€―PM

Num Bookmarks & Asset Sizes in Admin Panel

Screenshot 2024-10-13 at 3 22 13β€―PM

New Admin Actions

Screenshot 2024-10-13 at 3 22 21β€―PM

Upgrading

To upgrade:

  • If you're using HOARDER_VERSION=release, run docker compose pull && docker compose up -d.
  • If you're pinning it to a specific version, upgrade the version and then run docker compose pull && docker compose up -d.

All Commits

Read more

Contributors

jarednipper, cedmax, and 9 other contributors
Loading
1 Join discussion
0