TLS handshake fails(radsecproxy) with OpenSSL 3.0 but succeeds with OpenSSL 1.1.0

Radsecproxy application is unable to establish secure connection with the RADSEC server. The TLS handschake fails with failed: error:0A000086:SSL routines::certificate verify failed . However with OpenSSL 1.1.0 the TLS handshake succeeds, without changing anything.

Radsecproxy version : v1.9.1

You've probably only got deprecated SSL protocols available to you...

Take a look at SSL and TLS Protocols - OpenSSLWiki

This says TLS is not enabled by default and must be "compiled in".

https://www.openssl.org/docs/man3.0/man7/migration_guide.html

The issue you're encountering with Radsecproxy failing TLS handshake with OpenSSL 3.0 but not with OpenSSL 1.1.0 could be due to several factors, including changes in OpenSSL's handling of certificates, protocols, or cipher suites between these versions. OpenSSL 3.0 introduced stricter default settings and deprecated various features and algorithms, which might cause compatibility issues with existing configurations or certificates not adhering to the new standards.