This issue was addressed with improved entitlements. This issue is fixed in iOS 16.5 and iPadOS 16.5, watchOS 9.5, macOS Ventura 13.4. An app may be able to bypass Privacy preferences.
https://support.apple.com/kb/HT213761
https://support.apple.com/en-us/HT213764