# GPUs on Ampere **URL:** \ **Category:** General Discussion\ **Created:** [February 5, 2025, 5:09pm UTC](https://community.amperecomputing.com/t/gpus-on-ampere/1116 "2025-02-05T17:09:46Z")\ **Posts on this page:** 12\ **Page:** 1
**Author:** ![Aaron](https://yyz1.discourse-cdn.com/flex027/user_avatar/community.amperecomputing.com/aaron/32/37_2.png) [@Aaron](https://community.amperecomputing.com/u/Aaron)\ **Post date:** [February 5, 2025, 5:09pm UTC](https://community.amperecomputing.com/t/gpus-on-ampere/1116/1 "2025-02-05T17:09:46Z")
@konstantinos asked this question on the Arm Discord. Does anyone have an answer for him? _anyone using nvidia gpus on an Arm (Ampere) system? not interested in graphics, only compute_ _I tried months ago in a vm, using pci passthrough but it didn’t want to work and ended up moving the gpu to the x86 system_ here is the link the post. > **[Discord - Group Chat That’s All Fun & Games](https://discord.com/channels/839248077487472640/839248077487472644/1334138192818999307)** > > Discord is great for playing games and chilling with friends, or even building a worldwide community. Customize your own space to talk, play, and hang out. ---
**Author:** ![sjnadas](https://avatars.discourse-cdn.com/v4/letter/s/aca169/32.png) [@sjnadas](https://community.amperecomputing.com/u/sjnadas)\ **Post date:** [February 5, 2025, 9:19pm UTC](https://community.amperecomputing.com/t/gpus-on-ampere/1116/2 "2025-02-05T21:19:23Z")
It can be done. If you are in an Ampere chassis they have GPU h/w that Ampere has qualified. Putting a usual PCIE card (geforce 2080ti say) can also be done, but may be tough bcos space is very tight. Also need to get cables to go from the Ampere provided cables to ones that fit a GPU like a 2080Ti. hth. -Steve ---
**Author:** ![vikingforties](https://yyz1.discourse-cdn.com/flex027/user_avatar/community.amperecomputing.com/vikingforties/32/1192_2.png) [@vikingforties](https://community.amperecomputing.com/u/vikingforties)\ **Post date:** [February 7, 2025, 3:52pm UTC](https://community.amperecomputing.com/t/gpus-on-ampere/1116/3 "2025-02-07T15:52:56Z")
That qualified list of GPUs is here… > **[Ampere Altra family Device Documentation](https://amperecomputing.com/customer-connect/products/altra-family-device-documentation)** > > Includes application notes, data sheets, specifications, product briefs, and solutions reference architecture for Ampere Altra family of Cloud Native Processors ---
**Author:** ![Wookie69](https://avatars.discourse-cdn.com/v4/letter/w/ecb155/32.png) [@Wookie69](https://community.amperecomputing.com/u/Wookie69)\ **Post date:** [February 8, 2025, 10:48am UTC](https://community.amperecomputing.com/t/gpus-on-ampere/1116/4 "2025-02-08T10:48:42Z")
VM it was not working for me with GPU. Tried different options. I’m using docker with GPU. Missing some options like kernel updates etc., but for me it is enough. ---
**Author:** ![JoeSpeed](https://yyz1.discourse-cdn.com/flex027/user_avatar/community.amperecomputing.com/joespeed/32/16_2.png) [@JoeSpeed](https://community.amperecomputing.com/u/JoeSpeed)\ **Post date:** [February 8, 2025, 4:36pm UTC](https://community.amperecomputing.com/t/gpus-on-ampere/1116/5 "2025-02-08T16:36:24Z")
NVIDIA GPUs I’ve seen people use in their Ampere systems: - L4 L40 L40S A10 A16 A40 A100 H100 with NVLink - RTX A400, 2000 Ada SFF, 4000 Ada, 4000 Ada SFF, 5000 Ada, 6000 Ada, A4500 with NVLink, 4070, 4080, 4080 Ti, 4090, 3070 - GTX 750 TI, 1050, 1060, 1070 There may be a few others. NVIDIA and Ampere have worked together many years, NVIDIA has used Ampere processors in some of their own products including [android in cloud gaming](https://nvidianews.nvidia.com/news/ampere-nvidia-extend-aican-gaming-platform-ecosystem) and [Arm HPC Dev Kit](https://developer.nvidia.com/blog/evaluating-applications-using-the-nvidia-arm-hpc-development-kit/). NVIDIA has lots of Ampere gear for driver dev/test. And NVIDIA is “all-in” on Arm with their own products including Jetson and Grace. So arm64 is heavily invested in and well supported by NVIDIA. Also various recent AMD GPUs. Those run as-is with AmpereOne and require PCIe patch with Altra. For example Radeon RT 7800 XT used by user cryptoclixer. You can see some of that here: [https://www.supermicro.com/en/support/resources/gpu?rsc=fltr\_sku%3DARS-210M-NR](https://www.supermicro.com/en/support/resources/gpu?rsc=fltr_sku%3DARS-210M-NR) [![](https://canada1.discourse-cdn.com/flex027/uploads/amperedevelopers/original/1X/ef9c69bfd2fde15d20ec5765af08e727bc3a424f.jpeg "System76 accidentally built the fastest Windows Arm PC") ](https://www.youtube.com/watch?v=AshDjtlV6go) > **[GitHub - AmpereComputing/NVIDIA-GPU-Accelerated-Linux-Desktop-on-Ampere: This repo contains scripts and documents to enable...](https://github.com/AmpereComputing/NVIDIA-GPU-Accelerated-Linux-Desktop-on-Ampere)** > > This repo contains scripts and documents to enable Nvidia GPU accelerated desktop on Ampere CPU based workstation. It also demonstrated on installing desktop applications like open source DOOM3. [![](https://canada1.discourse-cdn.com/flex027/uploads/amperedevelopers/original/1X/7bd9259d415afbab4e2a9d6db37ca8585bf43473.jpeg "Windows Arm PCs could be SO much better") ](https://www.youtube.com/watch?v=thz5S_uciHk) > **[aadp-docs](https://www.ipi.wiki/pages/aadp-docs?page=GraphicsSupportAVL.html)** > > I-Pi offers the ready-to-go prototyping platforms, which combine production-grade components, software portability, and Raspberry Pi-like flexibility and upgradability for your proof-of-concept designs. ---
**Author:** ![konstantinos](https://avatars.discourse-cdn.com/v4/letter/k/ce7236/32.png) [@konstantinos](https://community.amperecomputing.com/u/konstantinos)\ **Post date:** [February 8, 2025, 7:03pm UTC](https://community.amperecomputing.com/t/gpus-on-ampere/1116/6 "2025-02-08T19:03:08Z")
I know I can use it on the host OS, I need to use it inside a VM, using GPU passthrough, and so far I haven’t been able to do that. Drivers were installed and modules were loaded ok (on Debian trixie/testing). I could even call nvitop, but as soon as I tried running actual software it would just throw multiple PCI errors both on host kernel and guest. I tried a 4060. ---
**Author:** ![JoeSpeed](https://yyz1.discourse-cdn.com/flex027/user_avatar/community.amperecomputing.com/joespeed/32/16_2.png) [@JoeSpeed](https://community.amperecomputing.com/u/JoeSpeed)\ **Post date:** [February 10, 2025, 3:46pm UTC](https://community.amperecomputing.com/t/gpus-on-ampere/1116/7 "2025-02-10T15:46:05Z")
hmm, that is puzzling. Automakers use it in VMs I think using virtio-gpu without issue. Maybe start a topic and share details for us to sort it with you. @bexcran ---
**Author:** ![Richard](https://avatars.discourse-cdn.com/v4/letter/r/f0a364/32.png) [@Richard](https://community.amperecomputing.com/u/Richard)\ **Post date:** [February 11, 2025, 5:46am UTC](https://community.amperecomputing.com/t/gpus-on-ampere/1116/8 "2025-02-11T05:46:16Z")
Just try to run GPU passthrough on my VM, everything is ok. Tried to run ollama model inside VM, and there is no problem. Host: Altrad8dud + AltraMax GPU: NV 4080 16G Host OS: ubuntu 22.04 + HWE kernel Guest OS: ubuntu 22.04 default kenel If you see Nvidia device in the VM but cannot install Nvidia driver, just disable secure boot option in UEFI. ---
**Author:** ![konstantinos](https://avatars.discourse-cdn.com/v4/letter/k/ce7236/32.png) [@konstantinos](https://community.amperecomputing.com/u/konstantinos)\ **Post date:** [February 12, 2025, 5:30pm UTC](https://community.amperecomputing.com/t/gpus-on-ampere/1116/9 "2025-02-12T17:30:48Z")
I did that. By the way, this is with Debian current trixie/testing kernel, I did not build my own kernel nor include any custom patches. ---
**Author:** ![Wookie69](https://avatars.discourse-cdn.com/v4/letter/w/ecb155/32.png) [@Wookie69](https://community.amperecomputing.com/u/Wookie69)\ **Post date:** [February 13, 2025, 8:02pm UTC](https://community.amperecomputing.com/t/gpus-on-ampere/1116/10 "2025-02-13T20:02:00Z")
Tested on RTX A4000, works well on Ubuntu 22.04, 24.04 server and desktop. For 24.04 desktop it’s a bit tricky, but doable to make it working from Ubuntu iso. Don’t know if any of you have noticed but there are NVidia kernels. Like linux-image-6.5.0-31-nvidia, 6.8.0-1009-nvidia and -64k as well as 6.11.0-1003-nvidia and -64k. There are more, but I have tested only 3 mentioned above. Now on 6.11.0-1003-nvidia-64k, with CUDA toolkit 12.8, so far works well, nevertheless I didn’t perform any more in depth testing. Ollama with DeepSeek-R1 32B, works, a bit slow “thinking”, but that’s the issue with 16GB VRAM. Waiting for RTX 6000 Blackwell with as they are saying 96GB VRAM :). ---
**Author:** ![dneary](https://avatars.discourse-cdn.com/v4/letter/d/47e85d/32.png) [@dneary](https://community.amperecomputing.com/u/dneary)\ **Post date:** [May 26, 2025, 11:07pm UTC](https://community.amperecomputing.com/t/gpus-on-ampere/1116/11 "2025-05-26T23:07:44Z")
Can multiple VMs use the GPU with vGPUs? I don’t know if virtio-gpu supports GPU sharing. ---
**Author:** ![JoeSpeed](https://yyz1.discourse-cdn.com/flex027/user_avatar/community.amperecomputing.com/joespeed/32/16_2.png) [@JoeSpeed](https://community.amperecomputing.com/u/JoeSpeed)\ **Post date:** [July 28, 2025, 5:31pm UTC](https://community.amperecomputing.com/t/gpus-on-ampere/1116/12 "2025-07-28T17:31:31Z")
Yes, that is what automakers do for CI testing a large number of virtual digital cockpit instances on Ampere desktops and servers with NVIDIA GPUs.