Hello,
The usage of swap is managed by Linux kernel and he his trying to use swap if available before using 100% of RAM that will cause OOM.
Changing the vm.swapiness value can effectively reduce the usage of swap.
If you want to try to empty the swap without rebooting you can do that :
Bash:
sudo swapoff -a #Disable swap
sudo swapon -a #Enable swap
Then see if you swap usage is high.
If you don't want to use swap you can disable it but in fact Linux kernel put in swap data that is not frequently used.
You can edit dynamically (and temporary) the vm.swappiness value with the command : sysctl vm.swappiness=10
You can put the value to 0 and it will use swap only if your RAM is full.