Search results

After doing some reading up, this is how to set port type at boot time. By specifying port_type_array parameter (0 = auto, 1 = ib, 2 = eth) So I've tried to add this line to /etc/modprobe.d/mlx4.conf options mlx4_core port_type_array=2,2 However above option gets ignored at boot time and I...

Are there additional ethernet ports seen after doing this? ll /sys/class/net/ If you see them there, it's just a matter of configuring them in /etc/network/interfaces file. If there are no additional interfaces seen above, try this to see what module(s) is being loaded for the card. dmesg...

In fact I just found how to enable native 10gigE mode. modprobe mlx4_en echo eth > /sys/bus/pci/devices/0000\:0d\:00.0/mlx4_port2 And I get 2 native ethernet interfaces in /sys/class/net/. I have to echo to port2, otherwise I get an error back "-bash: echo: write error: Invalid argument"...

Oh I see. You added it manually. Well, good to know. Negative, comrade. We both have such cards (well, mine is faster with DDR infiniband :)) . Mellanox VPI cards are both Infiniband and 10gigE in one package. Later ConnectX- (2 or 3) also support up to 40gigE. And latest ConnectX-4 goes up...

Ok looking closer and comparing with your output, mir, I just realized I don't have ib_ipoib module loaded. OK, once I load it, I can see ib0 and ib1 network interfaces. So I was able to bring up IPoIB. Thank you, mir! Question, how the hell are your mlx4_ib, ib_ipoib, and other ib-related...

Re: Unable to see Infiniband interfaces on Proxmox? I updated my last post above to show you what it looks like right after a fresh reboot where neither mlx4_ne nor mlx4_ib are loaded. Native 10gigE attempt After doing modprobe mlx4_en I get this: ib_iser 42209 0 ib_cm...

Re: Unable to see Infiniband interfaces on Proxmox? I do not have that last line. But that made be think I should see what modules are available. Looks like there is mlx4_core, which is loaded. But mlx4_ib and mlx4_en are also present on the filesystem but not loaded. After fresh reboot #...

Re: Unable to see Infiniband interfaces on Proxmox? This is a vanilla Proxmox v3.4 install with all updates # pveversion -v proxmox-ve-2.6.32: 3.4-156 (running kernel: 2.6.32-39-pve) pve-manager: 3.4-6 (running version: 3.4-6/102d4547) pve-kernel-2.6.32-39-pve: 2.6.32-156...

I've got a pair of infiniband HCAs. They are dual-mode and support both infiniband and native 10GigE (not IPoIB but actual 10gigE). I tested them and updated firmware to latest available on a CentOS 7.1 box. HCAs are good. But I am unable to bring them up in Proxmox with neither IPoIB nor...

I had an issue of VMs not starting. Was out of ideas, thought you might be having related issue. Turned out it was nothing like your problem. Mine was related to glusterfs and improperly configured pve-firewall.

On a related note, if my machines are directly connected via eth3 ports to each other for glusterfs replication. And, once enabled, pve-firewall filters all interfaces. What is the best way to minimize iptables overhead since there is no real need to filter traffic on the eth3 iface? Is...

Yes, i'm using the same two servers as both PVE and glusterfs hosts. A bit late to the party, but thought I would update this in case someone encounters the same issue. The issue was improperly configured firewall rules just as Proxmox staff indicated. Thank you for making me see the light :)

Also if you can spare a dedicated box for it, NAS4FREE might be an easy to use turn-key solution. It has simple web interface to enable and configure things like NFS, Samba, RSYNC, iSCSI targets and many other options.

Hmmmm glusterfs still working fine and replicating. This may be due to the fact that connections are in the established state and get by firewall rules. Still why would it start 2 VMs?

Re: pve-firewall prevents VM starts from web interface (also noVNC hangs) I've experimented with a number of firewall settings. Nothing prevented the issue from occurring as long as pve-firewall was enabled. This is my current cluster.fw file: ========================= [OPTIONS] #...

Re: pve-firewall prevents VM starts from web interface (also noVNC hangs) No, sir. No firewall for private network (eth3). Wide open because it's a server-to-server link specifically for glusterfs.

Re: pve-firewall prevents VM starts from web interface (also noVNC hangs) I use a public IP for cluster. And private network on separate interface. Here's the config from first cluster node. The rest are exact the same except for IP addresses: =========== # eth0 bridge auto vmbr0 iface...

I've ran into exactly the same issue. Attempting to use a kickstart script to setup a newly created VM. Were you able to find a work around?

I'm not OP, but yeah I think using VM templates is good enough solution when creating a bunch of similar VMs. You can create templates based on your typical VM needs (e.g. small, med, large with varying specs). Now a slightly unrelated question. How does everyone then go about changing...

Re: pve-firewall prevents VM starts from web interface (also noVNC hangs) *crickets * After posting here, creating an issue in the bugtracker, and posting to pve-users... no response?