- have a working java environment
- install the quarkus CLI
- Install ollama
- install the llama2 model
ollama run llama2
quarkus dev
once the project starts you can go to the dev ui to submit a query: http://localhost:8080/q/dev-ui/io.quarkus.quarkus-smallrye-openapi/swagger-ui
Test the different answers with and without the RAG
Note: unless you have a GPU on your laptop, it's going to be slow. The timeout is set to 10 minutes
with ollama directly:
curl http://localhost:11434/api/generate -d '{
"model": "llama2",
"prompt":"What is the best way to organize an environment as a service experience in a Kubernetes or Openshift environment?",
"stream": false
}'via the RAG service
curl -X 'GET' \
'http://localhost:8080/query-raffa?question=What%20is%20the%20best%20way%20to%20organize%20an%20environment%20as%20a%20service%20experience%20in%20a%20Kubernetes%20or%20Openshift%20environment%3F&session=1' \
-H 'accept: text/plain'