I’ve been around technology for long enough that very little excites me, and even less surprises me. But shortly after Open AI’s ChatGPT was released, I asked it to write a WordPress plugin for my wife’s e-commerce site. When it did, and the plugin worked, I was indeed surprised.That was the beginning of my deep exploration into chatbots and AI-assisted programming. Since then, I’ve subjected 10 large machine models (LLMs) to four real-world tests. How to use ChatGPT to write: Resumes | Excel formulas | Essays | Cover letters Unfortunately, not all chatbots can code alike. It’s been 18 months since that first test, and even now, five of the 10 LLMs I tested can’t create working plugins. In this article, I’ll show you how each LLM performed against my tests. There are two chatbots I recommend you use, but they cost $20/month. The free versions of the same chatbots do well enough that you could probably get by without paying. But the rest, whether free or paid, are not so great. I won’t risk my programming projects with them or recommend that you do until their performance improves. Also: How I test an AI chatbot’s coding ability – and you can tooI’ve written a lot about using AIs to help with programming. Unless it’s a small, simple project, like my wife’s plugin, AIs can’t write entire apps or programs. But they excel at writing a few lines and are not bad at fixing code. Rather than repeat everything I’ve written, go ahead and read this article: How to use ChatGPT to write code: What it can and can’t do for you.If you want to understand my coding tests, why I’ve chosen them, and why they’re relevant to this review of the 10 LLMs, read this article: How I test an AI chatbot’s coding ability – and you can too. Let’s start with a comparative look at how the chatbots performed: David Gewirtz/ZDNETNext, let’s look at each chatbot individually. I’ll discuss nine chatbots, even though the above chart shows 10 LLMs. The results for GPT-4 and GPT-4o are both included in ChatGPT Plus. Ready? Let’s go. More