Absolutely not. Read this article to how safe is your users’ and company data during the installation of YAMM for your domain.
Difference between installation by Individual vs. G Suite Admin
As a G Suite admin, you can also pre-install and pre-authorize YAMM from G Suite Marketplace, for all users of your domain. Your installation for domain-wide use, is one-time and makes YAMM readily available for all your users.
You authorize and grant the same set of permissions as in an individual install, but you do it on behalf of all your users as well. So when the users want to use YAMM, they don't need to individually authorize it again.
Does your permission for YAMM allow it to have access to all your user’s data?
We cannot impersonate your users and retrieve their Drive/Gmail data, programmatically.
We can retrieve their data only when a specific user interacts with YAMM add-on. This behavior is exactly as if he has installed and authorized YAMM himself.
Is your company and user data at risk?
Unlike many other G Suite apps, YAMM does not ask to create a 'service account with domain-wide delegation'. So YAMM does not access to data of the users who aren't actually using the product.
Can I whitelist YAMM instead of domain-wide installation?
OAuth apps whitelisting is to specifically allow selected third-party applications to access your users’ G Suite data.
YAMM is neither a G Suite web application (it is an add-on for Google Sheets) nor does it ask for access to your users’ data (via domain-wide delegation of authority).
So whitelisting is not applicable for YAMM.