 Notice. New forum software under development. It's going to miss a few functions and look a bit ugly for a while, but I'm working on it full time now as the old forum was too unstable. Couple days, all good. If you notice any issues, please contact me. |
Forum Index : Microcontroller and PC projects : Running AI models on your own computer: a detailed investigation
| Author | Message | ||||
| matherp Guru  Joined: 11/12/2012 Location: United KingdomPosts: 12200 |
https://mather.host/ai/local-models/ Local language models Which AI models can you run on your own hardware that are actually useful for embedded C and MMBasic work? Ten models were tested on a workstation with a 20 GB graphics card, on real tasks: writing C that is checked under AddressSanitizer, answering questions about the MMBasic source, and extending a BASIC interpreter. The write-up covers the method, the results, how to set up Ollama, and what more money buys, from a used 24 GB card to a 128 GB Ryzen AI Max+ machine. |
||||
homa Guru Joined: 05/11/2021 Location: GermanyPosts: 763 |
Peter, Very interesting—thanks for sharing the AI research and findings. Cool site overall! Was it made with AI? Matthias |
||||
| matherp Guru Joined: 11/12/2012 Location: United KingdomPosts: 12200 |
No. I did all myself in an hour (NOT) |
||||
 Print this page |
 |
The Back Shed's forum code is written, and hosted, in Australia. | © JAQ Software 2026 |
