Sarah Glasmacher
Sarah Glasmacher
my journey through ML and studies
⌘K

January: VectorVault - a Local RAG System from Scratch with Open-Source priority

This is the project overview page for my monthly project idea: creating my very own local RAG-system to search through my notes with natural language. I’ve been using Obsidian for everything - blog drafts, social media ideas, and work notes - but sometimes I'm too lazy to look for the right note. So, I’m building a system that lets me ask questions like, “What were my ideas for improving RAG workflows?” and instantly get the most relevant snippets.

I’ll start simple, using cloud APIs for the AI components, and gradually transition to open-source tools to make it all fully local (ideally).

What I'm aiming for: Project Goals

By the end of January, I want to have a working system that:

  • Stores my notes as embeddings (fancy AI representations of text) in a local database.
  • Lets me type in questions or keywords and pulls up the most relevant snippets.
  • Generates summaries or answers using AI.

There's not much to see at the time of initially posting this, but here is the repo:

https://github.com/GalaxyInfernoCodes/local-rag-system

Why I’m Doing This & Initial Plan

I wrote a whole blog post about starting this project, which you can find here: https://sarahglasmacher.com/starting-january-project-local-rag-system/

Read that blog post if you are interested in any of the following:

  1. Why I’m Doing This
  2. What It Will Look Like
  3. The components of the project
  4. GitHub Link
  5. Why Share This?

Further Posts and Updates about the project

Here's a list of all blog posts around the project: