Shrink AI Costs: New Tool Helps Save Australian Businesses

We hear a lot about the exciting things AI can do, but less about the running costs, which can add up quickly for businesses using these new technologies. A new tool called "less-tokens" aims to tackle this head-on.

Imagine you're chatting with an AI, asking it to write an email or summarise a long report. Each piece of information – every word, punctuation mark, and even the spaces – gets converted into tiny digital units called 'tokens'. AI models charge you based on how many tokens you use, both for what you send to it and what it sends back to you. The longer your request or the AI's answer, the more tokens you use, and the more it costs.

This new tool works by making your requests much shorter and more efficient before they even reach the AI, without losing any of the important information. Think of it like packing a suitcase for a trip – you want to fit everything you need but take up as little space as possible. By `compressing` your information, it means the AI has less to process, which directly translates to lower bills for businesses.

The developers claim it can cut costs by 30-40%, which is a significant saving, especially for small businesses who might be using AI for customer service, marketing, or drafting documents. It ensures the AI still understands exactly what you want, giving you the same quality results but for less money. This kind of innovation helps make powerful AI tools more accessible and affordable for everyday Australian businesses, making it easier for them to benefit without breaking the bank.

It's not just about simple text either; the tool can also take documents like PDFs and Word files and slim them down for AI use. This means a business owner could feed a long contract into an AI for summarisation, and the tool would make sure it's as cost-efficient as possible. This smart approach helps ensure that the benefits of AI are truly practical for everyday operations.