Testing AI chatbots to build Chrome ad-blockers revealed stark differences in performance and capabilities
Three AI models were tasked with creating ad-blockers for Chrome, exposing their varying abilities and limitations. The results highlighted significant differences in video, image, and writing capabilities.
Three AI chatbots—Claude, ChatGPT, and Gemini—were asked to build Chrome ad-blockers, a task that seemed straightforward but revealed the distinct strengths and weaknesses of each model. The exercise aimed to assess how well these AI tools could handle a practical coding challenge, offering insights into their real-world utility.
Despite charging the same $20 for their subscriptions, the three models produced vastly different results. While they shared a similar price point, their offerings were not interchangeable. Each had unique features and limitations that became apparent when put to the test.
The evaluation showed that no single model excelled in all areas. For instance, only Google's Gemini could produce video content effectively, while Claude lacked the ability to generate images entirely. ChatGPT, on the other hand, produced the best images and was closely followed by Gemini.
The differences in performance have implications for users and developers relying on these AI tools. The choice of model can significantly affect outcomes, with some models proving more suitable for specific tasks than others. Users must carefully consider their needs before committing to a subscription.
The results underscore the importance of selecting the right AI tool for the job. While some models may offer broader capabilities, others excel in niche areas. As these tools continue to evolve, their performance in practical applications will likely shape their adoption and impact across industries.