Google is still a beast!

"A 3.25B params quantized gemini running locally in coming Google Chrome with less than 100ms latency while using less than 2GB of ram.

That's less ram usage than many of my current Chrome page already uses (my slack is using 4.8GB as I type this).

No doubt LLMs will be integrated everywhere in our world, from browsers to TV, to appliances, to Raspberry-Pi, to increasingly simpler and simpler devices as the tech is perfected.

And what I'm most excited about is that they're all going to run locally, on-device, fast, decentralized.

h/t @mortenjust on X.com and Thomas @HuggingFace for sharing the impressive video

Video: https://x.com/i/status/1805190952358650251"

Author

AiUTOMATING PEOPLE, ABN ASIA was founded by people with deep roots in academia, with work experience in the US, Holland, Hungary, Japan, South Korea, Singapore, and Vietnam. ABN Asia is where academia and technology meet opportunity. With our cutting-edge solutions and competent software development services, we're helping businesses level up and take on the global scene. Our commitment: Faster. Better. More reliable. In most cases: Cheaper as well.

Feel free to reach out to us whenever you require IT services, digital consulting, off-the-shelf software solutions, or if you'd like to send us requests for proposals (RFPs). You can contact us at [email protected]. We're ready to assist you with all your technology needs.

© ABN ASIA