[SOLVED] 4 days of rage. i have problem with static ip, vlan, pfsense, switch. Someone could check this quickly and give me some help with my questions. ty ty

cyqpann

Member
Nov 18, 2021
25
0
6
44
Hi everyone,

i have network problem and i don't understand why or what wrong am i doing. Am i dumb, slow brain or just too noob or a mix or everything since this seem simple things. I also need answer to few questions if it possible. Im not that great in networking and im farly new to this.

I will write a lot of detail, if your'e lost into all of this, i am also. feel free to ask me question i will answer during the day.

I created a datacenter with 4 desktop computer i had in my basement laying with tons of storage and cpu power for my need.

i bought a 48 port switch Cisco 3750g-48ts

first server:
[Terra] got 6 network ports.
vmbr0 = 192.168.1.10/24 with gw 192.168.1.1 so i can access it via https://192.168.1.10:8006/
I follow promox tutorial to create a pfsense router sending everything into my switch 48 port.

enp3s0f0 = Network device = vmbr1 = Virtio xxx= pfsense WAN
enp3s0f1 = Network device = vmbr2 = Virtio xxx= lan 192.168.1.1/24
enp4s0f0 = Network device = vmbr4 = Virtio xxx = vtnet3 that goes into another 8 switch port for ,guest network on vlan 44 configured into pfsense. this work perfectly
enp4s0f1= Network device =
enp6s0 = Network device = vmbr0 = 192.168.1.10 with gw 192.168.1.1 ( the network i configured when i created proxmox)
enp7s0 = network device =

okay now second server
[Montana] got 2 network port.

enp3s0 is in brigde with vmbr0 with ip 192.168.1.11 gw 192.168.1.1 ( the network i configured when i created proxmox)
enp6s0 = is not use.
my plex use the same vmbr0 as bridge with dhcp because i cannot set a static ip. If i set a static ip, i cannot ping google, no route to hostname but as soon i put dhcp, i can ping google. I tried to check into my plex container the /etc/network/interface and edit it like i see but i cant saved anything.

here the log of the dhcp

[root@plex-server ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: vmbr0@if72: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 72:05:a0:4f:da:10 brd ff:ff:ff:ff:ff:ff link-netnsid 0
inet 192.168.1.101/24 brd 192.168.1.255 scope global dynamic vmbr0
valid_lft 5352sec preferred_lft 5352sec
inet6 fe80::7005:a0ff:fe4f:da10/64 scope link
valid_lft forever preferred_lft forever
[root@plex-server ~]# ping google.ca
PING google.ca (172.217.13.163) 56(84) bytes of data.
64 bytes from yul03s04-in-f3.1e100.net (172.217.13.163): icmp_seq=1 ttl=117 time=5.57 ms

--- google.ca ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 5.570/5.570/5.570/0.000 ms

i create for this purpose static vmbr0 with static ip 192.168.1.121/24 with no gateway because it doesnt let me.

[root@plex-server ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: static@if78: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether ce:91:c7:76:79:2c brd ff:ff:ff:ff:ff:ff link-netnsid 0
inet 192.168.1.121/24 brd 192.168.1.255 scope global static
valid_lft forever preferred_lft forever
inet6 fe80::cc91:c7ff:fe76:792c/64 scope link
valid_lft forever preferred_lft forever
[root@plex-server ~]# ping google.ca
PING google.ca(yul03s04-in-x03.1e100.net (2607:f8b0:4020:806::2003)) 56 data bytes

this stop there. nothing else. i have to revert at dhcp to get internet / network access

Now this is 1 problem.

I have another problem. Either im stupid or i don't understand what to do or i am doing something wrong and mabye you can't help me. Im totally lost
Do i configure this into pfsense, into my switch, on network port only, somewhere else?

On my thrid server called draco, i have 5 network port. only 1 is use to access it via 192.168.1.12 gw 192.168.1.1. it connected into my switch

i wanna use this network card to create like 4 different server with 4 different vlan and like do some cleanup into my house with all the computer we have and iot and wireless device. will it be possible to do this with my actual setup or i need my put back my physical 1x4 network port card into my pfsense server to do this? do i need to put patch cord into each port up to my switch to make this work or everything in virtual is fine without patch cord and via x way i can like share internet and data between those port?

Does it need to be only pfsense that will handle every vlan i wanna create or i can bypass it and still have internet and access to my server?

Vlad will be use for a windows 10 rpd server with obs and ndi for streaming. i don't really care about this one for now.

It being 4 day since im screaming and raging because nothing work like expected. my ip changed all the time since static doesnt work i cant find the doc i m searching problably because i don't know the proper term.
If someone could help me
I add some screenshot of my datacenter so far. not quite sure it might help but incase.

and sorry if my english isnt perfect, this is not my primary language.

Thanks a lot and have a wonderful day guys.
 

Attachments

  • Draco network card.png
    Draco network card.png
    119.9 KB · Views: 7
  • Montana.png
    Montana.png
    115.9 KB · Views: 7
  • pfsense.png
    pfsense.png
    127.4 KB · Views: 7
  • plex.png
    plex.png
    91.9 KB · Views: 7
  • Terra.png
    Terra.png
    125.3 KB · Views: 7
  • Vlad network.png
    Vlad network.png
    116.7 KB · Views: 7

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!