Radsecproxy application is unable to establish secure connection with the RADSEC server. The TLS handschake fails with failed: error:0A000086:SSL routines::certificate verify failed . However with OpenSSL 1.1.0 the TLS handshake succeeds, without changing anything.
The issue you're encountering with Radsecproxy failing TLS handshake with OpenSSL 3.0 but not with OpenSSL 1.1.0 could be due to several factors, including changes in OpenSSL's handling of certificates, protocols, or cipher suites between these versions. OpenSSL 3.0 introduced stricter default settings and deprecated various features and algorithms, which might cause compatibility issues with existing configurations or certificates not adhering to the new standards.