OAuth not working for filesystem gdrive verified source

[dat-a-man]

dlt version

0.4.7

Describe the problem

When attempting to load a Parquet file from Google Drive to a destination using service account credentials, the operation proceeds without issue. However, utilizing OAuth credentials results in an error despite ensuring that all necessary permissions for accessing, reading, and downloading content from Google Drive have been granted to the OAuth credentials. This error has been consistently encountered across different platforms, including macOS and Codespaces. The specific error message is as follows:

In processing pipe filesystem_jsonl_team_data: extraction of resource filesystem_jsonl_team_data in generator filesystem caused an exception: <HttpError 403 when requesting https://www.googleapis.com/drive/v3/files/19Qmr9ZU-Kb9SA13WB5uqfGRLa5ePzu4d?fields=name%2Cid%2Csize%2Cdescription%2CmimeType%2Cversion%2CcreatedTime%2CmodifiedTime%2Ccapabilities&supportsAllDrives=true&alt=json returned "Request had insufficient authentication scopes.". Details: "[{'message': 'Insufficient Permission', 'domain': 'global', 'reason': 'insufficientPermissions'}]">

This error message indicates that the request was denied due to insufficient authentication scopes. Despite the permissions being ostensibly configured correctly, the OAuth credentials used has have the necessary scopes to perform the operation.

Expected behavior

The Oauth credentials should work as smoothly as service account credentialy without any changes required to be done to environment or source.

Steps to reproduce

Mentioned in the PR: #1040

Operating system

Linux, macOS

Runtime environment

Local

Python version

3.11

dlt data source

filesystem

dlt destination

Google BigQuery

Other deployment details

No response

Additional information

No response