Verified reference stack
Consultant — Confidential Documents — RTX 4070
Official Google material reports Gemma 3 12B int4 weights around 6.6 GB. Hardware score still assumes normal single-user inference and bounded context.
AnythingLLM
Open tool profile →Ollama
Open runtime profile →RTX 4070 12 GB / 32 GB RAM
GOODFully local configuration
Gemma Terms of Use — professional/legal-entity use allowed subject to terms and prohibited-use policy
Evidence
Continue the decision
Put this reference stack in context
A reference configuration is most useful when you compare it with alternatives and then apply your own hard constraints.
Private AI for Consultants
See the professional workflows and verified baselines connected to this stack.
Confidential Document AI
Understand the architecture and privacy assumptions behind this use case.
Compare related stacks
Review this configuration beside related verified references.
Run the Stack Finder
Apply your exact profession, task, privacy requirement and hardware.
Freshness rule: Material changes set this stack to REVALIDATION_REQUIRED.