I also imagine there is the other side where the third party has crap data security. End users figure that their data is safe with Google and may not consider that there is a third party with their various levels of security.
I can see Google copping a lot of heat should Company X have a data leak and that data was originally gathered from a users Google data store, whether it is justified or not.