Are wallets actually anonymous in themselves?

What sort of info do wallets like metamask, Exodus etc, store when someone downloads the wallet app or installs on desktop? For example, if someone downloads the app - is information about the downloader stored in the form of device models and numbers, IP addresses?

Could that then compromise the anonymity of the wallet in the first place?