@roxie bind the vfio driver to the one not to use by its pcie id number in modprobe conf (then don't forget to rebuild initrd)
also unbind the efi fb driver from whichever one your uefi chose during boot i'm not at home but i'll get u the command for that later