r ollama - Reddit deepseek-coder 33B and RTX4090 hello, I just downloaded ollama and trying to run deepseek-coder33b However it appears not to run on my GPU according to resource monitor and at like 2 tokens a second, I was under the impression that running the version provided by ollama i get a 4bit quant and it should fit in VRAM?
AI_Agents - Reddit r AI_Agents: A place for discussion around the use of AI Agents and related tools such as in Auto-GPT, LangChain, LlamaIndex, BabyAGI, etc Join us on…