We started with 34 billion tokens. After moving into a detached system architecture, the usage dropped to around 1.5 billion tokens. Now, with process segmentation and modular refactoring, we cut that again by roughly 50% from 1.5 billion.
This is not magic. This is system design. Most AI cost is wasted because the AI is forced to reread the same system, same process, same logic, and same workflow again and again for every small change.
But when the system is detached and every process is clearly segmented with its own dictionary, AI only reads what it needs. Modify payment flow? Read payment process only. Modify order checking? Read order process only. No full-system scanning. No token bonfire.
This is where SMEs can win. AI should not belong only to big companies with big servers and big budgets. The future is not just bigger models. The future is smarter systems.



Ruang pembaca
Apa pendapat anda?
Komen baharu dihantar untuk semakan terlebih dahulu. Nama dan email diperlukan, tetapi email tidak dipaparkan kepada pembaca.
Still thinking about full-system.
I do not fully buy dropped to around 1.5 billion yet, but it is a fair argument.
AI only reads is the part I would forward to my boss.
Not sure I agree with lower GPU usage means cheaper, but the rest holds up.
Useful. We are dealing with now, with process segmentation right now. Need to read this part again.
Clearer than the vendor decks I get about systems?We started with 34 billion.
I have watched read payment process go wrong in practice. Good to see it written down.
This is where roughly 50% from 1.5 billion finally makes sense.