Over the past couple of years, Ampere has donated over 200 Mt. Collins Altra systems to 20+ universities across the world. As part of the donation, the schools and their students were invited to join the Ampere Community to get any questions answered and to connect with other developers. We’ve also encouraged feedback on user experiences with the systems and descriptions of any ongoing projects. Anybody have anything to share?
5 Likes
I’m not from the university but a Ampere system buyer. I’m working on a way that allow to offload KV cache when inferencing LLM models. Due to the fact that ARM CPU and Nvidia GPU share the same load-store architecture, I belive that there is chance for Ampere in AI market.
2 Likes
Cool! Looking forward to hear about the offload KV cache on Ampere system
1 Like
There’s a Mt Collins and a Mt Snow working some of the time on this veterinary application based at Liverpool University: SAVSNET/PetBERT · Hugging Face & SAVSNET (SAVSNET)
Essentially trawling vet’s episode notes for trends, new outbreaks, adverse drug reactions etc.