Consultant — Confidential Documents — RTX 4070
AnythingLLM + Ollama + Gemma 3 12B IT (QAT/int4 profile)
Evidence-backed configurations used by the launch Finder.
AnythingLLM + Ollama + Gemma 3 12B IT (QAT/int4 profile)
AnythingLLM + Ollama + Qwen3-8B
PrivateGPT + llama.cpp + Mistral Small 3.1 24B
Open WebUI + Ollama + Mistral Small 3.1 24B
OpenHands + LM Studio local server + Qwen3.6-35B-A3B
OpenHands + LM Studio local server + Qwen3.6-35B-A3B
Continue + Ollama + Qwen2.5-Coder-7B-Instruct Q4_K_M
AnythingLLM + Ollama + Qwen3-14B
Onyx + vLLM + Mistral Small 3.1 24B
Open WebUI + Ollama + Qwen3-14B
AnythingLLM + Ollama + Qwen3-8B
Khoj + Ollama + Gemma 3 12B IT (QAT/int4 profile)
whisper.cpp + whisper.cpp + Whisper large-v3-turbo
ComfyUI + ComfyUI backend + Stable Diffusion XL Base 1.0
Open WebUI + llama.cpp + Qwen3-4B
ComfyUI + ComfyUI backend + Stable Diffusion XL Base 1.0
ComfyUI + ComfyUI backend + Stable Diffusion XL Base 1.0
ComfyUI + ComfyUI backend + Stable Diffusion XL Base 1.0
ComfyUI + ComfyUI backend + Stable Diffusion XL Base 1.0
Open WebUI + Ollama + Qwen3-8B
Open WebUI + Ollama + Qwen3-4B
Open WebUI + Ollama + Qwen3-14B
Open WebUI + Ollama + Qwen3-8B
Open WebUI + Ollama + Qwen3-8B
Open WebUI + Ollama + Qwen3-8B
Khoj + Ollama + Qwen3-8B
Open WebUI + Ollama + Qwen3-8B
Open WebUI + Ollama + Qwen3-8B
Open WebUI + Ollama + Qwen3-8B
Open WebUI + Ollama + Qwen3-8B
Continue + Ollama + Qwen2.5-Coder-7B-Instruct
Continue + Ollama + Qwen2.5-Coder-14B-Instruct
Open WebUI + Ollama + Qwen3-14B
Open WebUI + Ollama + Qwen3-8B
Khoj + Ollama + Qwen3-8B
Khoj + Ollama + Qwen3-8B
whisper.cpp + whisper.cpp + Whisper large-v3-turbo
whisper.cpp + whisper.cpp + Whisper large-v3-turbo
Open WebUI + Ollama + Qwen3-4B
Open WebUI + Ollama + Qwen3-8B