Using AI at home
By SecBurg
(Updated:
)
If you want to experiment and/or develop locally with/for AI, check out these tools:
Python
Streamlit
LM Studio
GPT4ALL
Ollama
Langchain
LLamaIndex
Stable Diffusion web UI
The easiest and fastest way to get a local LLM up and running (and just chat with it) would be using LM Studio or GPT4ALL.
GPT4ALL also includes a built-in “local docs” (aka RAG) feature.