localai Tag Posts Index

The RTX PRO 6000 Blackwell for local AI: is 96GB worth $13,000?

96GB of VRAM sounds like the local AI dream. At $13K, the real question is whether it saves your workflow or just delays a better decision. #AI

AI for software engineering. About ASICs for AI, reengaging with syntax, embracing provenance, RVC, model-in-a-box and what to think about the AI IPOs.

(Image by Gemini AI) This is my third post in the Reverse Vibe-Coding series. If you prefer watching an 8 minute video over reading a 20 minute blog post, check

My Progress wih Local AI - Setting a TINY Model for Open-WebUI's Post-Response Tasks

After trying multiple AI interfaces, including LMStudio, Msty.ai and Koboldcpp's built in UI, I finally settled on Open-WebUI as my daily driver. I installed the

My Progress wih Local AI - Running LLMs on AMD Ryzen 7640hs

I've been learning about using AI locally for a few months now. First, I learned about Quantization, Llamacpp and the GGUF format. I managed to get some models run

[Human]Building a Localized HyperSmart LLM System Using Two Models; Llama2 and Stable Diffusion

As many of you have seen the past few months my feed has been various interesting AI outputs. Why is this? I've been using Hive blockchain to train different AI