A Smarter Way To Run AI On Your Own Computer

Imagine using powerful AI tools, like those that summarise documents or answer complex questions, directly on your personal computer, without needing a super-fast internet connection or sending your data to big tech companies. That's the exciting promise of a new experiment by AI company Perplexity.

They're working on making large language models (LLMs) — the clever AI programs that power chatbots like ChatGPT — run smoothly on everyday devices like a Mac laptop. Traditionally, these powerful AIs need massive data centres to operate. Perplexity's approach uses clever software tricks to make these models much smaller and more efficient, so they can work locally on your machine.

This technology, dubbed 'hybrid compute', essentially allows the AI to perform its complex calculations right on your device. It means your data stays private and secure on your computer. Plus, it could potentially reduce the costs associated with using cloud-based AI services, which often charge by usage.

For Australian small business owners, this could be a game-changer. Think about using an AI to analyse your sales reports, draft marketing emails, or even help with customer service, all without your sensitive business information ever leaving your office computer. It opens up new possibilities for using advanced AI in a very personal and controlled way, without relying on external servers.

While still experimental, this move suggests a future where sophisticated AI isn't just for tech giants, but a powerful tool that anyone can run on their own hardware. It’s about putting the power of AI directly into the hands of everyday users, offering more control, privacy, and potentially faster, more reliable performance for tasks.