Time sharing GPU?

[Duncan Innes]

Just wondering how easy/hard it is too time share a GPU between various applications.

If I have a single GPU, can it be shared between multiple application tasks. Like Immich ML, Plex transcoding, Jellyfin transcoding, an AI container, etc.

I know that you can pass through a GPU to a virtual machine. But not sure if this same mechanism is in play for containers. 

I guess my ultimate question is if multiple GPUs are required to do justice to multiple workloads across multiple apps. Or do we need to move towards a generic GPU container which the various apps can call upon for their various workloads.

Cheers

[PsychoWards]

Hey, 

It seams to be possible to use a GPU with multiple apps, but you need to login into truenas to do this:

https://www.truenas.com/community/threads/can-multiple-apps-utilize-the-same-gpu.99757/#post-712876

Edited 1 hour ago by PsychoWards