A logic issue was addressed with improved checks. This issue is fixed in macOS Ventura 13.7, iOS 17.7 and iPadOS 17.7, visionOS 2, iOS 18 and iPadOS 18, macOS Sonoma 14.7, macOS Sequoia 15. Network traffic may leak outside a VPN tunnel.
https://support.apple.com/en-us/121250
https://support.apple.com/en-us/121249
https://support.apple.com/en-us/121247
https://support.apple.com/en-us/121246