Manage the BigQuery Connector
The Composer BigQuery connector lets you access the data available in Google BigQuery storage using the Composer client. The Composer BigQuery connector supports the current version of this software as a microservice (SaaS) product.
Composer does not provide an out-of-the-box BigQuery connection. You must first download, install, configure, and enable it to connect to it in Composer. For steps and more information, see the Google BigQuery website. Also see Manage Connectors and Connector Servers for general instructions and Connect to BigQuery for details specific to the BigQuery connector.
After the connector has been set up, you can create data source configurations that specify the necessary connection information and identify the data you want to use. See Manage Data Source Configurations for more information. After data sources are configured, they can be used to create dashboards and visuals from your data. See Create Dashboards.
Key: P - Supported; O - Not Supported; N/A - not applicable
When connecting to BigQuery, provide the following information:
- Key Path: you have to specify the absolute path to the file that must be available for the connector.
- Public Project IDs.
For more information about these values, refer to Google BigQuery's documentation.
Authorize the BigQuery Connection
To authorize the BigQuery connection, you need to create a security key for it. Before you can create the security key, you must access or create a BigQuery microservice account.
To create a BigQuery microservice account, perform the following steps:
Login to your Google API Console.
Select the required project from the list.
Make sure that current account is linked to a billing account. To check this, select the icon and then select Billing.
On the API Manager page, select Credentials:
On the Credentials page, select Manage service accounts.
On the Service Accounts page, select Create Service Account and specify the following:
- Service account name
- Role - grant this microservice account role based access to the project. From the list, select the BigQuery category and then select BigQuery Data Viewer and BigQuery User roles.
- Service account ID
After you have created an account, create a security key for it.
To create a security key:
On the Service Accounts page, find the required account.
From the menu, select Create key.
In the Create private key dialog, select JSON for the key type and select Create. The local copy of the key is saved on your computer.
Move the file with the key to the server, on which the connector is running.