Chennai: AI large language models have largely become commoditised, and the value now lies in companies building systems that combine AI with structured enterprise data, privacy safeguards and regulatory guardrails, said Sridhar Vembu, chief scientist and co-founder of Zoho.
“The server cost 4 times more compared to a year ago, the cost of memory is up 5 times and AI token spend is skyrocketing. He was speaking after Zoho introduced an AI chatbot across its products and announced its foray into vertical software applications.
That’s why I think AI will become a commodity,” he said. He said rising memory prices and AI inference costs have hit profitability. If you are successful then we can keep a lid on prices, but we have chosen not to raise prices,” he said. He said combining horizontal breadth with vertical SaaS brings in specific business rules, regulatory mandates and end-to-end visibility of a workflow, which would make AI integration more useful and help them gain customers. On the company’s chatbot, he said, “LLM brings distilled knowledge of everything in the world.
He acknowledged that the spike in server and data centre costs, along with AI spending, has impacted profitability, adding that Zoho is taking several steps to reduce compute costs, including making its code more efficient and exploring running AI models on laptops for low-stakes tasks. Local AI, or local inference, refers to hosting AI models on one’s own devices instead of using data centres. “AI Adoption is moving towards lower-cost AI, and I believe later towards local AI. But this will take six months to one year. You can expect a lot more advances on this front. The smaller models are growing up to become more intelligent. Larger models are becoming more efficient to run on local hardware. You can predict the trend. We are trying to make both efficient. Vembu also explained the rationale behind Zoho’s move into industry-focused vertical software applications. He dismissed concerns that AI agents would lead to a reduction in seat-based subscriptions, adding that Zoho is witnessing growth in its number of customers. Behind the Zoho suite sits all of the business information, what we call the data models. We are bringing the two together and building critical security and governance guardrails, safeguards that are necessary to protect companies’ proprietary data and be compliant with regulations.”
Speaking to TOI at Zoholics, the company’s annual conference on Wednesday, he said AI inferencing is expected to move to local hardware.
You Can Also Check: Gold Rate in Chennai | Silver Rate in Chennai | Bank Holidays in Chennai | Public Holidays in Chennai | Chennai AQI | Weather in Chennai | Petrol Price in Chennai | Diesel Price in Chennai | CNG Price in Chennai | LPG Price in Chennai Stay updated with the latest Chennai news. Download the TOI App.