I just recently installed Strata which runs on qwen 3.8 flash next. I’m getting over 50 toks. Now a deepseek v4 version is out along with glm 5.3 flash. It’s slower but useable and very capable. All this on a 5080 16GB and 128GB ddr5. The future for me is going to be open weights and on your own hardware.