VM "AI" and internal server error .

frankz

Member
Nov 16, 2020
354
23
23
Hello everyone, surely some of you use an AI-type proxmox VM.

I have a chatgpt compatible server and it works properly thanks to the variation or rather the obligatory use of the host CPU .

Unfortunately, I can't get some AI modules to work, which are downloaded from the VM but not loaded into memory.

The error is strict-origin-when-cross-origin .

I don't know if I should actually research the lawsuit on the node, so I try to ask the same .....
 
I don't know if I should actually research the lawsuit on the node, so I try to ask the same .....
You lost me here with lawsuit...
I am actually working on this currently and had hope to use RancherOS. But, support/development ended; so, I'll use Debian minimal with AutoGPT or create my own. What OS are you using on your VM? Do you have an API key for all modules?
 
Last edited:
I'm not really understanding your post here completely, but can give you some hint's w.r.t. quoted error message:
The error is strict-origin-when-cross-origin .
See https://developer.mozilla.org/en-US/docs/Web/HTTP/CORS (it is a bit complicated in the details though)

Basically this is a security protection of modern browsers to avoid that some scripts or attacks can easily leak your browser session state (login ticket-cookies and other things) to some other host (origin) that the current web-site/web-app is not related too.

Either ensure your backend tells the browser to allow request to your other origins that are used here (e.g., some API of some AI thingy), or route them all to the same backend, e.g., use nginx/caddy/... reverse proxying.
 
Sorry, the post is a little ambiguous or poorly explained. I have an ubuntu VM with a server downloaded from Github ( serge ) , with which I run a chatgpt server via docker . It always works (with the obligation to use the host cpu on proxmox), but I encountered some problems in loading some models into memory. I thought I would find some suggestions on the proxmox forum ( if it is necessary to modify some parameters beyond the host cpu). I think the problem is different, as being not very proficient on docker, I probably misconfigured the updates.
 
You lost me here with lawsuit...
I am actually working on this currently and had hope to use RancherOS. But, support/development ended; so, I'll use Debian minimal with AutoGPT or create my own. What OS are you using on your VM? Do you have an API key for all modules?
Ubuntu 22.04 lts (VM no LXC ) .
 
Interesting...thank you for sharing!
Very interesting, I recommend you download nouse-hermes and stable-vicuna . Also, if you install the server, let me know if when you refresh the available models, a new list will appear with a few but very recent modules. It's these modules that I can't load into memory but no problem for downloading. Also just today I downloaded the lxc ubuntu 22.04 template on proxmox and installed serge . It works prefettamete apart from what I wrote to you. If you can solve it, let me know, I want to solve this problem!
 
Hello everyone, surely some of you use an AI-type proxmox VM.

I have a chatgpt compatible server and it works properly thanks to the variation or rather the obligatory use of the host CPU .

Unfortunately, I can't get some AI modules to work, which are downloaded from the VM but not loaded into memory.

The error is strict-origin-when-cross-origin .

I don't know if I should actually research the lawsuit on the node, so I try to ask the same .....
I am similar to you, there is a compatibility with ChatGPT but still have some problems that need to be resolved.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!