Search results

  1. J

    Nvidia Driver Tomfoolery, unable to apt install anything.

    Spent a chunk of time trying to get cuda / openCL working in python, and seemed to have negatively impacted something I should not have. I'll preface that my plan is to reinstall proxmox, but I hope to try to learn what has happened by diagnosing the issue before that. When I try to 'apt-get...
  2. J

    40gbs Mellanox Infinityband

    I think that Infiniband still has drivers, but as a hobbyist, I (also) had trouble without the various different Mellanox specific software and firmwares getting anything working. You would have noticed that just about anything you installed from Mellanox first wanted to uninstall existing...
  3. J

    40gbs Mellanox Infinityband

    Oh, I ran into this issue as well, try this: # NOT recommended for production use, might be redundant, but I have access to dkms, so assume it must be here. echo "deb http://download.proxmox.com/debian/pve buster pve-no-subscription" >> /etc/apt/sources.list # update package list apt update #...
  4. J

    Request: Storage configuration on cluster of hardware backed raids

    EDIT: Learning more by the minute, Leaving the below for the record, and those who follow. Questions: 1) What exactly causes hardware backed raid controller to be bad for ceph? --> Pve-docs says "Ceph is designed to handle whole disks on it’s own, without any abstraction in between. RAID...
  5. J

    iSCSI message

    Still no word on this relatively dead thread?
  6. J

    Unable to connect to ISCSI, or otherwise read LVs?

    Edit / Part 2: Just thinking, to get ahead of what I feel like is the inevitable, "You need to start over", a few questions down that path: This is one of three machines in a cluster: 1) What considerations need to be made when reinstalling to not negatively impact the cluster? 2) How about...
  7. J

    Unable to connect to ISCSI, or otherwise read LVs?

    Well, I was trying to get some outdated network cards (Connectx-2) working. Through the process, I had tried to compile and install Mellanox OFED, which failed. I am fairly confident what happened was the installer removed packages which were otherwise required, before it failed. Specifically...
  8. J

    40gbs Mellanox Infinityband

    Well, since I've accidentally turned this into a work log, I figure I'll keep going. opensm --create-config /etc/opensm/opensm.conf created me a config file to work against. Inside, I set the GUID to match the port GUID I got from ibstatus started `opensm` and boom! Infiniband device...
  9. J

    40gbs Mellanox Infinityband

    Ok, So, I managed to get ibstatus to report the link as being up between two devices! Infiniband device 'mlx4_0' port 1 status: default gid: fe80:0000:0000:0000:0002:c903:000c:4991 base lid: 0x3 sm lid: 0x3 state: 2...
  10. J

    40gbs Mellanox Infinityband

    Thanks SourCheeks, Yeah, Infiniband only. I'll work against this, see if I can figure it out. Could use some more specific guidance though, for sure. OpenSM I thought was built into the cards, that's my mistake (still learning). I had been trying to connect two machines directly to each other...
  11. J

    40gbs Mellanox Infinityband

    Wow, this actually went sooo smoothly. I am not sure why I was struggling soo badly. So, I actually have no ethernet ports, only infiniband, on my cards. As such, I assume switching to ethernet mode is not required between two of these cards (on seperate physical machines, right?) In fact...
  12. J

    40gbs Mellanox Infinityband

    I just wanted to chime in and say thank you. I see you still never had anyone to reach out to help or confirm your thread, but this solution worked for me with a connectX-2 as well. Spent a lot of time before I came across this thread, but it is exactly what I needed. The only item I was...