8000 Favourites endpoint is not returning results · Issue #88 · hnrss/hnrss · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Favourites endpoint is not returning results #88

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
sesh opened this issue Jun 30, 2023 · 2 comments
Open

Favourites endpoint is not returning results #88

sesh opened this issue Jun 30, 2023 · 2 comments

Comments

@sesh
Copy link
sesh commented Jun 30, 2023

Currently the endpoint does not return any items.

~ $ http https://hnrss.org/favorites?id=edavis

HTTP/1.1 200 OK
Cache-Control: max-age=3300
Connection: keep-alive
Content-Encoding: gzip
Content-Length: 331
Content-Type: application/xml; charset=utf-8
Date: Fri, 30 Jun 2023 09:58:29 GMT
Expires: Fri, 30 Jun 2023 10:50:56 GMT
Server: nginx
Vary: Accept-Encoding
X-Algolia-Url: https://hn.algolia.com/api/v1/search_by_date?hitsPerPage=0&restrictSearchableAttributes=title&tags=%28story%2Cpoll%29%2C%28%29
X-Cache: HIT

<rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0">
  <channel>
    <title>Hacker News - edavis's favorites</title>
    <link>https://news.ycombinator.com/favorites?id=edavis</link>
    <description>Hacker News RSS</description>
    <docs>https://hnrss.org/</docs>
    <generator>hnrss v2.1</generator>
    <lastBuildDate>Fri, 30 Jun 2023 09:55:56 +0000</lastBuildDate>
    <atom:link href="https://hnrss.org/favorites?id=edavis" rel="self" type="application/rss+xml"/>
  </channel>
</rss>
@edavis
Copy link
Member
edavis commented Jun 30, 2023

Ah, bummer. HN is blocking the hnrss server from fetching their /favorites endpoint. Which is needed to populate the list of story IDs to be passed onto Algolia. Looks like they've been blocking it for awhile now (at least since June 16).

FWIW, I can't say I blame them. It's probably an expensive endpoint to maintain with a long-tail that makes caching hard and it's a pretty popular feed on hnrss . I never particularly liked the HTML parsing, I just couldn't figure out another way.

I'll see if I can surface favorites data from the official API. Or one could self-host the hnrss binary and favorites should come back (everything is working locally).

If I can't get the official API to work, I'll probably have to retire this endpoint.

Thanks for the report.

@sesh
Copy link
Author
sesh commented Jun 30, 2023

Thanks for looking into it and the quick response. I figured it would be something like this.

My use-case is a very small side project, so I'll likely just parse the HTML myself and keep calls to a few a day to stay under the radar.

Thanks for your great work on this project!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@sesh @edavis 2AE3
0