Engineering writeups and incident post-mortems for #llm.
Articles: 4In-depth engineering analysis: Evaluating local code generation models: why synthetic benchmarks fail in real codebases. Practical diagnostics, logs and production configuration.
In-depth engineering analysis: Context window compression strategies for long-running AI agents. Practical diagnostics, logs and production configuration.
In-depth engineering analysis: Running 70B parameter models on workstation: memory bandwidth bottleneck. Practical diagnostics, logs and production configuration.
In-depth engineering analysis: Local LLM inference: benchmarking llama.cpp GGUF quantizations (Q4_K_M vs Q8_0). Practical diagnostics, logs and production configuration.
