Over the past couple of years, Ampere has donated over 200 Mt. Collins Altra systems to 20+ universities across the world. As part of the donation, the schools and their students were invited to join the Ampere Community to get any questions answered and to connect with other developers. We’ve also encouraged feedback on user experiences with the systems and descriptions of any ongoing projects. Anybody have anything to share?
I’m not from the university but a Ampere system buyer. I’m working on a way that allow to offload KV cache when inferencing LLM models. Due to the fact that ARM CPU and Nvidia GPU share the same load-store architecture, I belive that there is chance for Ampere in AI market.
Cool! Looking forward to hear about the offload KV cache on Ampere system
There’s a Mt Collins and a Mt Snow working some of the time on this veterinary application based at Liverpool University: SAVSNET/PetBERT · Hugging Face & SAVSNET (SAVSNET)
Essentially trawling vet’s episode notes for trends, new outbreaks, adverse drug reactions etc.
@cxhardy Is the sponsorship program currently open for applications? I heard that a university in my country is interested in this program. Thank you.
@quocbao Yes! We do have some of Ampere’s Mt. Collins systems. Keep in mind that the school will have to sign Ampere’s donor form - not a big deal. Also, the systems come with no warranty or technical support. We have some documentation but the schools are on their own for troubleshooting and figuring out issues. If still interested, you can send me details at chardy@amperecomputing.com.
Thank you. I will forward your message.