add LLM chatbot to Dask docs #11556
add LLM chatbot to Dask docs #11556
Conversation
Unit Test ResultsSee test report for an extended history of previous test failures. This is useful for diagnosing flaky tests. 15 files ±0 15 suites ±0 4h 7m 32s ⏱️ - 4m 13s Results for commit bb7609f. ± Comparison against base commit aafde77. ♻️ This comment has been updated with latest results. |
There was a problem hiding this comment.
This is exciting, thanks @dchudz!
Should we put this directly in the Dask theme instead of just in dask/dask? That way it will be present in distributed and all the other Dask subprojects.
I'm also not sure about the wording "Ask AI" on the button. I feel like we are at the point where lots of people have AI fatigue and people may be put off by that wording.
I totally agree about Discourse. We talked for a while about shutting the Slack down because it's generally not a good place to provide support. So it feels a little weird adding a feature that increases our Slack traffic. I understand the flow is to chat to the bot in the browser for a bit, and then have it move the conversation to a Slack channel. But perhaps we could remove the "Join our community" button given that our community isn't actually on Slack?
Also I noticed that the bot doesn't work in the RTD build preview. Perhaps it's a domain issue?
|
Thanks Jacob! Yeah, the docs preview thing is a problem with the domain. I'll get them to allowlist it. In the meantime if you feel like it (not that I expect this effort to be worthwhile for you), I'll push them on "Join our community" as well as "Ask AI". Hopefully that's easy for them to make configurable for us.
Good idea! Although I think we wouldn't get docs previews, so maybe I should leave it here for now? Or my screenshots are sufficient preview, happy to make that switch now. |
I'd go for "Ask Dask" or "Ask DaskBot" or something. |
Totally happy with screenshots for preview. If you could switch it that would be awesome.
Yeah I like something more along these lines. |
|
Just pushed chages for:
@jacobtomlinson I had a little trouble figuring out stuff with the sphinx theme, and then I realized RunLLM needs to allow-list the all domains we'll use, so it wouldn't just automatically work on any new Dask project anyway. Probably still good to get it in the theme and allow-list existing projects but how about we just start here and expand to other projects later? |
|
Can they allowlist a wildcard? E.g If we merge this here it'll need to be removed again when it's added to the theme. Are you happy to own that action? |
There was a problem hiding this comment.
Thanks @jrbourbeau @dchudz. Let's do it then! Thanks for funding this effort Coiled folks!
There was a problem hiding this comment.
Thanks @dchudz for the work here and @jacobtomlinson for reviewing
This reverts commit 0f3e5ff.
This reverts commit cd1ebf4.
This adds a LLM chatbot (using RAG based on Dask docs, StackOverflow Q&A, and a few other Dask-related sources) to the Dask docs. It's something I talked with a few Dask contributors about (@mrocklin , @jrbourbeau , @fjetter, @jacobtomlinson via Florian) before getting this pull request ready.
We (I and some other folks at Coiled) have played a bit with the questions and answers and think the quality is high enough to try out on real users, but we (@jrbourbeau for now) will plan to monitor the Q&A for quality.
It's implemented using a product (https://runllm.com/) that Coiled plans to pay for (and continue paying for if this experiment goes well and we keep this in the docs). To avoid paying unlimited amounts for anonymous questions and limit abuse, we're requiring users to join the Dask Slack to send more than 2 queries.
Some considerations going into the choices here: