Pass-through issue

[proxmoxajin]

Hi,
The hardware basics are : asus P8B75-V + intel 3770 cpu + pci-e to sata3.0 expansion card,
The disks can pass-through via pci-e to sata3.0 expansion card , but the same disks can't pass-through via mainborad sata interface.
The relevant display and information are as follows, please advise,thanks.





I had set pass-through HDD controller IOMMU GROUP13 to the VM , as bollow:

 

[leesteken]

You are passing through all functions of the same device three times. Either passthrough each function separately (and don't enable All Functions), or remove two of the three you currently have and keep All Functions enabled.

 

[proxmoxajin]

You are passing through all functions of the same device three times. Either passthrough each function separately (and don't enable All Functions), or remove two of the three you currently have and keep All Functions enabled.

Hi,
Thank you for your hint. I did the operations as your said, but the result is that I still can't pass through the disks from the motherboard sata interface to the VM.

And I found an "interesting" thing is：
In IOMMU GROUP 13, choose one of them, and in the Device option bar, it will automatically become 0000:00:1f.0 instead of one of the three in GROUP 13, such as: 1f:2 or 1f:2 or 1f:5.




Where is the configuration problem?
Thank you for continuing to advise!

 

[leesteken]

Thank you for your hint. I did the operations as your said, but the result is that I still can't pass through the disks from the motherboard sata interface to the VM.

Where is the configuration problem?

It's not clear to me what you did exactly. Please share the VM configuration file or the output of qm config YOUR_VMID. What errors are you getting from Proxmox?

And I found an "interesting" thing is：
In IOMMU GROUP 13, choose one of them, and in the Device option bar, it will automatically become 0000:00:1f.0 instead of one of the three in GROUP 13, such as: 1f:2 or 1f:2 or 1f:5.

I think that's just because of enabling All Functions and it is only cosmetic.

 

[proxmoxajin]

It's not clear to me what you did exactly. Please share the VM configuration file or the output of qm config YOUR_VMID. What errors are you getting from Proxmox?

I think that's just because of enabling All Functions and it is only cosmetic.

The VM configuration file is below，there are currently no entries for passthrough configuration:

boot: order=scsi0;ide2;net0 cores: 4 ide2: none,media=cdrom machine: q35 memory: 8192 meta: creation-qemu=7.2.0,ctime=1683512287 name: p1TN230508 net0: virtio=46:5F:A5:94:66:74,bridge=vmbr0,firewall=1 net1: virtio=EE:81:D1:CB:6F:AA,bridge=vmbr1,firewall=1 numa: 0 ostype: l26 scsi0: single64G:203/vm-203-disk-0.qcow2,iothread=1,size=32G scsihw: virtio-scsi-single smbios1: uuid=f5dfd6ce-9ee1-447e-979e-1385d26574be sockets: 1 vmgenid: 58d21112-7f1f-4b58-8bad-62dd2613f924

Thanks.

 

[leesteken]

The VM configuration file is below，there are currently no entries for passthrough configuration:

Without those, I cannot tell you what's wrong.
EDIT: I would expect hostpci0: 0000:00:1f,ppcie=1. If that does not work, please show error messages and explain what you experience.

 

[proxmoxajin]

Without those, I cannot tell you what's wrong.
EDIT: I would expect hostpci0: 0000:00:1f,ppcie=1. If that does not work, please show error messages and explain what you experience.

The VM config file is below:
boot: order=scsi0;ide2;net0 cores: 4 hostpci0: 0000:00:1f,pcie=1 ide2: none,media=cdrom machine: q35 memory: 8192 meta: creation-qemu=7.2.0,ctime=1683512287 name: p1TN230508 net0: virtio=46:5F:A5:94:66:74,bridge=vmbr0,firewall=1 net1: virtio=EE:81:D1:CB:6F:AA,bridge=vmbr1,firewall=1 numa: 0 ostype: l26 scsi0: single64G:203/vm-203-disk-0.qcow2,iothread=1,size=32G scsihw: virtio-scsi-single smbios1: uuid=f5dfd6ce-9ee1-447e-979e-1385d26574be sockets: 1 vmgenid: 58d21112-7f1f-4b58-8bad-62dd2613f924

The VM can start ,but disks can't pass-through via mainbord sata interface.
And PVE tasks is no error message appear.

That's all ,maybe I should reinstall the host OS,then reset the pass-through steps.

Thanks for your attention.

 

[leesteken]

The VM config file is below:
boot: order=scsi0;ide2;net0 cores: 4 hostpci0: 0000:00:1f,pcie=1 ide2: none,media=cdrom machine: q35 memory: 8192 meta: creation-qemu=7.2.0,ctime=1683512287 name: p1TN230508 net0: virtio=46:5F:A5:94:66:74,bridge=vmbr0,firewall=1 net1: virtio=EE:81:D1:CB:6F:AA,bridge=vmbr1,firewall=1 numa: 0 ostype: l26 scsi0: single64G:203/vm-203-disk-0.qcow2,iothread=1,size=32G scsihw: virtio-scsi-single smbios1: uuid=f5dfd6ce-9ee1-447e-979e-1385d26574be sockets: 1 vmgenid: 58d21112-7f1f-4b58-8bad-62dd2613f924

That looks fine.

The VM can start ,but disks can't pass-through via mainbord sata interface.
And PVE tasks is no error message appear.

It's possible that the devices don't reset properly and won't work with passthrough. There are threads on this forum about SATA controller that don't work with passthrough and some that do work. Maybe buy a SATA controller that is known to work with passthrough instead?

That's all ,maybe I should reinstall the host OS,then reset the pass-through steps.

That would probably not change anything, as this is not specific to Proxmox but to hardware passthrough in general.

Can you find anyone with the same SATA controllers that have working passthrough? Maybe they need some special work-around?
Maybe an alternative reset method might work? What is the output of cat /sys/bus/pci/devices/0000:00:1f.*/reset_method?
Try early binding the devices to vfio-pci, but you might also need a softdep to make sure vfio-pci loads before the SATA driver. What is the output of lspci -nnks 00:1f after rebooting Proxmox before starting the VM.
It might be much, much easier to pass the drives instead of the SATA controllers, but it won't be exactly the same, as a search on this forum will show.

 

[proxmoxajin]

That looks fine.

It's possible that the devices don't reset properly and won't work with passthrough. There are threads on this forum about SATA controller that don't work with passthrough and some that do work. Maybe buy a SATA controller that is known to work with passthrough instead?

That would probably not change anything, as this is not specific to Proxmox but to hardware passthrough in general.

Can you find anyone with the same SATA controllers that have working passthrough? Maybe they need some special work-around?
Maybe an alternative reset method might work? What is the output of cat /sys/bus/pci/devices/0000:00:1f.*/reset_method?
Try early binding the devices to vfio-pci, but you might also need a softdep to make sure vfio-pci loads before the SATA driver. What is the output of lspci -nnks 00:1f after rebooting Proxmox before starting the VM.
It might be much, much easier to pass the drives instead of the SATA controllers, but it won't be exactly the same, as a search on this forum will show.

Hi,
The output of the two commands is as follows:





Thanks for your advising.