Why AI Costs Could Affect Your Business Sooner Than Later

The boss of a major tech company, Palantir, has flagged concerns about the high costs associated with using leading artificial intelligence (AI) systems from companies like OpenAI and Anthropic. Alex Karp, Palantir's CEO, suggested that something isn't quite right with the 'token model' these AI giants use, where charges are based on how much data the AI processes. Think of it like paying per word or per thought the AI has — it can add up quickly.

This isn't just about big tech companies arguing amongst themselves. For Australian small businesses, especially those starting to look at AI tools, these comments highlight a crucial point: the running costs of AI. While AI promises to save time and boost efficiency, the pricing model for these powerful tools needs careful consideration. If the underlying costs for these AI models continue to soar, it could impact how affordable and accessible AI solutions are for everyday businesses down the track.

Currently, many smaller AI tools and services bundle these 'token' costs into their subscription fees, making it seem like a fixed price. But if the core technology becomes more expensive for the developers, those price increases could eventually flow down to the end-users – like you. This means that an AI helper that seems affordable today might become a significant expense tomorrow.

Karp's comments serve as a timely reminder for businesses to look beyond the flashy capabilities of AI and consider the long-term financial implications. As AI becomes more integrated into our work, understanding its ongoing operational costs will be just as important as knowing what it can do.