Try manually importing the cert into the keychain and setting it to always trusted. It fixed it for me in Safari. I think my server updated it's cert or something recently and Safari wouldn't automatically trust the new certificate. I don't think this would be an issue with a non-self signed cert.