Featured2 min read
How we cut LLM inference costs by 61% without touching model quality
Prompt caching, request batching and a routing layer did more than any model swap. Here is what we measured, in order.
11 articles
Topic
AI
Practical guides, expert opinions, research and case studies about building with AI, from models and prompting to retrieval and automation.
Most read
Technical deep dive1 min read
The support ticket router that took us three tries to get right
Our first two attempts at automatic ticket routing made things worse. The third one shipped because we stopped optimizing for accuracy.
Featured1 min read
What we tell customers before turning on an AI agent
Six sentences we make every customer read and confirm before we enable autonomous replies. Most of the value is in what we exclude.
Guide1 min read
Evaluating LLM output when there is no ground truth
Most of our extraction tasks have no single correct answer to grade against. This is the scoring approach we landed on after two that failed.
Latest
Guide9 min read
The SEO Delivery Bottleneck: Why More Clients Can Break a Good Agency
How growing SEO teams can identify capacity constraints before they become missed deadlines, inconsistent quality, and client friction.
Guide2 min read
Learn Programming with AI as Your Copilot
Learning to program can be a daunting task, but with the advent of Artificial Intelligence (AI), the landscape of programming has changed significantly.
Opinion3 min read
I’ve been coding for a long time
Before AI could write the code, you had to learn how to figure it out yourself.
Guide7 min read
The Ultimate Guide to Discord Bots
Discord bots have revolutionized the way communities interact and engage with each other on the popular communication platform, Discord.
Opinion3 min read
The Job Search Has Changed. And We're Optimizing for the Wrong Thing
You can have 10+ years in your field, a strong CV, the right certifications, and a track record of actually delivering results and still never get a chance to speak to a human.
Guide4 min read
How to build a workflow you can actually inspect
A walkthrough of building your first automation in Nodesin, and why every step, its inputs and outputs, and the bill remain visible.
Analysis1 min read
Why we still keep a human in the loop for refunds over $200
Our agent could technically approve these on its own. The data on why we still do not is more interesting than the policy.