summaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorGustaf Rydholm <gustaf.rydholm@gmail.com>2024-05-05 22:13:13 +0200
committerGustaf Rydholm <gustaf.rydholm@gmail.com>2024-05-05 22:13:13 +0200
commitdfc87fc319d2cfb84fa547726999b936a1d3e315 (patch)
tree90c7a3f7bbdeb557acd09f784b9dd7a932ee10dc
parent433c5b2b5287005e4c034ed0071e6488d4daf5ab (diff)
Update rag text
-rw-r--r--content/projects/retrieval-augmented-generation.md12
1 files changed, 6 insertions, 6 deletions
diff --git a/content/projects/retrieval-augmented-generation.md b/content/projects/retrieval-augmented-generation.md
index d3316d3..673a5c3 100644
--- a/content/projects/retrieval-augmented-generation.md
+++ b/content/projects/retrieval-augmented-generation.md
@@ -15,16 +15,16 @@ draft: false
I implemented a retrieval augmented generation (RAG)
[program](https://github.com/aktersnurra/rag) for fun with the goal of being able to
search my personal library. My focus was to make this run locally with only open
-source models. This was achieved with [`ollama`](ollama.com) and
+source models. This was achieved with [`ollama`](https://ollama.com) and
[`sentence-transformers`](https://github.com/UKPLab/sentence-transformers) for
downloading and running these models locally.
However, the project was expanded to
-integrate with cohere and their rerank and command-r+ models, since I was curious about
-the command-r+ performance. These models can be downloaded and run locally, but it took
-ages for my computer to generate any output, since the command-r+ is 104B parameter
-model. The obvious and cool benefit of the command-r+ is that it generates citations
-from the context in the answer.
+integrate with cohere and their rerank and command-r+ models, since I was especially
+curious about the command-r+'s performance. These models can be downloaded and run
+locally, but it took ages for my computer to generate any output, since the command-r+
+model is 104B parameters. The obvious and impressive benefit of the command-r+ is that
+it generates citations from the context in its answer.
Here is a [presentation](/rag.html) that gives a brief overview of what a RAG system
is, and how it can be improved with reranking.