8000 Minimal RAG recipe by francoishernandez · Pull Request #159 · eole-nlp/eole · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Minimal RAG recipe #159

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

Minimal RAG recipe #159

wants to merge 2 commits into from

Conversation

francoishernandez
Copy link
Member
@francoishernandez francoishernandez commented Dec 9, 2024 •
edited
Loading

This is just a small experiment to start enabling RAG workloads with Eole.
It should serve as a basis for future iterations, such as enabling the management and use of such RAG workflows through the server for instance.
E.g. we could manage ChromaDB collections at the same level as models, and allow for RAG-specific prompts on top of the standard chat templates.

The example setup is using the rather hard to digest "EU AI Act" full text for the sake of the exercise.

Example

Note: This is not tuned at all. For now, we just grab the first result from the vector search, retrieve its context (previous and following chunks), and infer with some arbitrary settings.

Query:

What is the general position around using biometrics and facial recognition in public places?

Generated answer based on queried context:

The general position around using biometrics and facial recognition in public places is that it is prohibited for certain
purposes, such as profiling, creating or expanding facial recognition databases, inferring emotions, and categorizing individuals based on their biometric data. However, there are exceptions for specific uses, such as searching for missing persons, preventing threats to life or safety, and identifying suspects in criminal investigations. The use of real-time remote biometric identification systems in public spaces for law enforcement purposes must be deployed for specific objectives and take into account the nature of the situation, the consequences for rights and freedoms, and necessary and proportionate safeguards.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
recipes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@francoishernandez
0