[SOLVED] Problem to drive GPU in Ubuntu 20.04 LTS but success in Windows 11

[kaleaves]

Story background:
Machine is operating with Proxmox 7.3.6 and successfully passthrough GPU in Windows 11 VM (works perfect in windows VM)
Recently, I did gpu passthrough to Ubuntu vm which can output video signal from GPU hdmi port but Nvidia driver still not detect the GPU.

Please Help

GRUB

GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR=`lsb_release -i -s 2> /dev/null || echo Debian`
GRUB_CMDLINE_LINUX_DEFAULT="iommu=pt initcall_blacklist=sysfb_init"
GRUB_CMDLINE_LINUX=""

Remapping shows

# dmesg | grep 'remapping'
[    0.371887] AMD-Vi: Interrupt remapping enabled

dmesg | grep -e DMAR -e IOMMU -e AMD-Vi

# dmesg | grep -e DMAR -e IOMMU -e AMD-Vi
[    0.371336] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
[    0.371881] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40
[    0.371883] AMD-Vi: Extended features (0x206d73ef22254ade): PPR X2APIC NX GT IA GA PC GA_vAPIC
[    0.371887] AMD-Vi: Interrupt remapping enabled
[    0.371888] AMD-Vi: Virtual APIC enabled
[    0.371889] AMD-Vi: X2APIC enabled
[    0.681341] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank).

# dmesg | grep -e DMAR -e IOMMU shows

# dmesg | grep -e DMAR -e IOMMU
[    0.371336] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
[    0.371881] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40
[    0.681341] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank).

#lspci -v shows

01:00.0 VGA compatible controller: NVIDIA Corporation Device 1f03 (rev a1) (prog-if 00 [VGA controller])
        Subsystem: Micro-Star International Co., Ltd. [MSI] Device c757
        Flags: fast devsel, IRQ 78, IOMMU group 0
        Memory at fb000000 (32-bit, non-prefetchable) [size=16M]
        Memory at d0000000 (64-bit, prefetchable) [size=256M]
        Memory at e0000000 (64-bit, prefetchable) [size=32M]
        I/O ports at f000 [size=128]
        Expansion ROM at 000c0000 [disabled] [size=128K]
        Capabilities: [60] Power Management version 3
        Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [78] Express Legacy Endpoint, MSI 00
        Capabilities: [100] Virtual Channel
        Capabilities: [250] Latency Tolerance Reporting
        Capabilities: [258] L1 PM Substates
        Capabilities: [128] Power Budgeting <?>
        Capabilities: [420] Advanced Error Reporting
        Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
        Capabilities: [900] Secondary PCI Express
        Capabilities: [bb0] Physical Resizable BAR
        Kernel driver in use: vfio-pci
        Kernel modules: nvidiafb, nouveau

01:00.1 Audio device: NVIDIA Corporation TU106 High Definition Audio Controller (rev a1)
        Subsystem: Micro-Star International Co., Ltd. [MSI] TU106 High Definition Audio Controller
        Flags: fast devsel, IRQ 79, IOMMU group 0
        Memory at fc080000 (32-bit, non-prefetchable) [size=16K]
        Capabilities: [60] Power Management version 3
        Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [78] Express Endpoint, MSI 00
        Capabilities: [100] Advanced Error Reporting
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel

#lspci -nnk

01:00.0 VGA compatible controller [0300]: NVIDIA Corporation Device [10de:1f03] (rev a1)
        Subsystem: Micro-Star International Co., Ltd. [MSI] Device [1462:c757]
        Kernel driver in use: vfio-pci
        Kernel modules: nvidiafb, nouveau
01:00.1 Audio device [0403]: NVIDIA Corporation TU106 High Definition Audio Controller [10de:10f9] (rev a1)
        Subsystem: Micro-Star International Co., Ltd. [MSI] TU106 High Definition Audio Controller [1462:c757]
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel

Otherwise, iommu was disabled after running ubuntu>>>#dmesg | grep -e DMAR -e IOMMU show nothing.
Reboot machine iommu back to normal.

PC Spec:
CPU: AMD 5700G
Motherboard: Asrock B550
GPU: ASUS GTX2060ti 12GB
Ram: 32GB