Blog 
-
September 16, 2024
GPT4-o1 Test Results
I hadn’t actually planned on writing anything. Models come and go, some are cool, some are meh. But the release of GPT4-o1 has repeatedly caused click-baity headlines because the system card talks ...
-
June 19, 2024
Small Language Models
A lot of the talk in the news is about the big guys in the LLM space. Of course OpenAI with ChatGPT, Microsoft Copilot which uses OpenAI, and Google’s Gemini which powers their big AI features. At ...
-
June 17, 2024
Orchestration and Function Calling
In From Text Prediction to Action we talked about the concept of using language models to convert between natural language and structured data such as CSV or JSON. The main goal there is that “tran...
-
February 7, 2024
From Text Prediction to Action
A benefit of training a text prediction model on text from the internet, is that it not only learns language. It also learns a lot of other text that people write and talk about on the internet. Th...
-
February 5, 2024
The Killer App
Today I want to take a little detour from our descent into the depths of LLMs and how software is built around it. I’d like to go up a little higher again and get a little philosophical, perhaps. A...
-
January 31, 2024
The AI Software Pipeline
As I explained in my previous post, the software around a language model is really what makes it all work to become an AI “system”. To dig a little deeper into it, let’s look at how software levera...
-
January 29, 2024
The Software In Charge of AI
In today’s (January 2024) generative AI landscape, which came on in a flash, there’s not much broader understanding about the architecture of the AI software we use. So I wanted to explain why The ...
-
January 24, 2024
From Text Predictor to Chatbot
Previously, we talked about LLMs basically being nifty text generators by predicting the next word given a bunch of previous text (“context”). We also found out there’s some by-product of clusters ...
-
January 23, 2024
Hallucinations are a feature, not a bug
In my blog article The Great Text Predictor I talked about scaling up text prediction from next word based on the previous word, to next word based on previous words in the sentence, all the way to...
-
January 22, 2024
The Great Text Predictor
When texting became a more popular sport, we were all still using physical keys. In fact, the keys were for the numbers you would dial phone numbers with, and to type letters each number key was as...