First question
Where should the work live?
Start by separating on-device models, self-hosted workspaces, local desktop tools, and privacy helpers before comparing features.
AI Resources
A focused map for tools, models, and workspaces that can keep more AI work on your own device, server, or account boundary.
Local does not automatically mean private. Open the source, check where data goes, and test with low-risk files before trusting it with important work.
First question
Start by separating on-device models, self-hosted workspaces, local desktop tools, and privacy helpers before comparing features.
Privacy check
A local tool may still call outside services, store files in unclear places, or need accounts and keys. Check the source path before using real data.
Fallback planning
Look for export options, model choices, file formats, hardware needs, and whether the workflow can survive if one provider or app changes.
Last updated
Use this page to narrow what to explore next, not as an endorsement, recommendation, guarantee, or safety review. Open the original source before relying on setup, terms, limits, privacy, access, or costs.
Local workspaces and assistants
Use this group when the question is whether an assistant, workspace, or meeting tool can run closer to your own files and accounts.
Mintplex-Labs/anything-llm
A local-first AI workspace for chatting with documents, using agents, connecting local or cloud model providers, adding MCP tools, building agent flows, and running as desktop, self-hosted, or hosted software.
osaurus-ai/osaurus
A Mac-native AI agent harness for Apple Silicon, with local and cloud model options, agents, memory, tools, cryptographic identity, MCP and local API paths, privacy-filter materials, plugin routes, and optional macOS 26 sandbox features.
HKUDS/nanobot
A lightweight personal AI agent project with packaged WebUI, goal tracking, Python SDK runtime controls, automation management, provider and channel integrations, and durability work highlighted in its v0.2.2 release.
qwibitai/nanoclaw
A lightweight personal agent system that runs agents in isolated containers and connects them to messaging channels, memory, and scheduled jobs.
ItzCrazyKns/Vane
A self-hostable AI answering engine for private search-style workflows, with local and cloud model providers, SearxNG-backed web search, cited sources, file uploads, and Docker setup paths.
Zackriya-Solutions/meetily
A local-first AI meeting assistant with public source, desktop release assets for Windows and macOS, Linux source-build docs, live transcription, meeting summaries, local Whisper or Parakeet transcription, local or external LLM summary options, optional analytics, and an MIT license.
yazinsai/OpenOats
A meeting note-taking assistant designed to be more conversational and responsive than passive transcription.
nexu-io/html-anything
A local agentic HTML editor that uses existing coding-agent CLI sessions to turn Markdown, data, and notes into exportable HTML, PNGs, decks, social cards, data reports, and web prototypes with skill templates and sandboxed preview.
On-device and local model paths
These entries help compare smaller models, local formats, and hardware routes when the fallback path matters.
google/gemma-4
A Google DeepMind Gemma 4 model family collection with public checkpoints including Gemma 4 12B, a dense multimodal model Google describes around local agentic workflows, native audio input, and encoder-free vision/audio handling.
LiquidAI/LFM2.5-230M
Liquid AI's 230M-parameter LFM2.5 text model for lightweight on-device agentic pipelines, data extraction, and edge inference, with Hugging Face weights, GGUF, ONNX, and MLX variants, 32K context notes, tool-use guidance, and official docs/blog materials.
LiquidAI/LFM2.5-350M
A hybrid model in the LFM2.5 family built for on-device deployment, with extended pre-training and reinforcement learning.
LiquidAI/LFM2.5-8B-A1B
A Liquid AI hybrid model with 8.3B total parameters, 1.5B active parameters, long-context support, tool-use notes, local formats, and deployment paths for edge and agentic workflows.
OpenBMB/MiniCPM5-1B
An OpenBMB 1B-class language model for local assistants, coding agents, tool-use, reasoning, and long-context workflows, with 131K context, Think / No Think modes, standard LlamaForCausalLM architecture, and deployment paths across Transformers, vLLM, SGLang, Docker, GGUF, Ollama, LM Studio, and MLX.
supertone-inc/supertonic
An on-device multilingual text-to-speech system built around ONNX Runtime, with local inference, 31-language support, expression tags, model assets, and examples across browser, mobile, desktop, and edge runtimes.
huggingface/optimum-intel
A Hugging Face toolkit for exporting, quantizing, compressing, and running Hub models through OpenVINO on Intel CPUs, Arc GPUs, and Core Ultra NPUs, with v2.0 making OpenVINO and NNCF the default path and release notes covering newer text, vision-language, speech, video, and diffusion model support.
Files and privacy helpers
Use this group when the work starts with documents, audio, images, or sensitive text and you need to check the local or privacy path first.
openai/privacy-filter
A privacy-filtering model and local toolkit for detecting and masking personally identifiable information in text, positioned around high-throughput sanitization workflows.
Vaibhavs10/insanely-fast-whisper
An opinionated CLI for very fast on-device transcription with Whisper.
lllyasviel/Fooocus
A local image-generation interface built around prompt-focused SDXL workflows, with Windows downloads, Colab access, inpainting, outpainting, image prompts, and presets.
PaddlePaddle/PaddleOCR
A document AI toolkit for OCR, document parsing, structured Markdown and JSON outputs, PaddleOCR-VL document parsing, PP-StructureV3 conversion, PP-OCRv6 scene OCR, and workflows that feed RAG or agent systems.
datalab-to/surya
A Datalab document OCR and analysis toolkit for OCR, layout analysis, reading order, table recognition, math-aware output, vLLM or llama.cpp backends, and structured document results.
allenai/olmocr
An Ai2 toolkit for converting PDFs, PNGs, and JPEG document images into clean Markdown or text for downstream AI workflows, with local GPU, remote vLLM/OpenAI-compatible server, Docker, benchmark, model-card, and demo paths.
Also in AI
Keep the thread going with AI Guides for decision habits for messy AI choices, AI Access for free and low-cost ways to compare AI model access, AI Ballot for a clearer view of what readers are leaning toward.