Information Schema
These functions are used to extend the accessibility of metadata returned from the INFORMATION_SCHEMA to permit aggregation of metadata across multiple projects. These functions write the metadata to a destination table to avoid metadata query limits and improve subsequent query performance.
Functions
TABLES
| Attribute | Value |
|---|---|
| Name | INFORMATION_SCHEMA_TABLES |
| ID | bqtools.[region].INFORMATION_SCHEMA_TABLES |
| Description | Creates or replaces the BQMANAGER.INFORMATION_SCHEMA_TABLES table, which is the aggregation of the INFORMATION_SCHEMA.TABLES metadata view across multiple projects. |
| Type | PROCEDURE |
| Arguments | destination_project_id STRING, source_project_ids ARRAY<STRING>, dataset_batch_size INT64, exclude_dataset_ids ARRAY<STRING> |
| Returns | None |
| Dependencies | bqtools-qb.[region].INFORMATION_SCHEMA_TABLES |
execution: INFORMATION_SCHEMA_TABLES
CALL bqmanager.eu.INFORMATION_SCHEMA_TABLES(destination_project_id, source_project_ids, dataset_batch_size, exclude_dataset_ids)
CALL bqmanager.us.INFORMATION_SCHEMA_TABLES(destination_project_id, source_project_ids, dataset_batch_size, exclude_dataset_ids)
TABLES_METADATA
| Attribute | Value |
|---|---|
| Name | INFORMATION_SCHEMA_TABLES_METADATA |
| ID | bqtools.[region].INFORMATION_SCHEMA_TABLES_METADATA |
| Description | Creates or replaces the BQMANAGER.INFORMATION_SCHEMA_TABLES_METADATA table, which is the aggregation of the INFORMATION_SCHEMA.__TABLES__ metadata view across multiple projects. |
| Type | PROCEDURE |
| Arguments | destination_project_id STRING, source_project_ids ARRAY<STRING>, dataset_batch_size INT64, exclude_dataset_ids ARRAY<STRING> |
| Returns | None |
| Dependencies | bqtools-qb.[region].INFORMATION_SCHEMA_TABLES_METADATA |
execution: INFORMATION_SCHEMA_TABLES_METADATA
CALL bqmanager.eu.INFORMATION_SCHEMA_TABLES_METADATA(destination_project_id, source_project_ids, dataset_batch_size, exclude_dataset_ids)
CALL bqmanager.us.INFORMATION_SCHEMA_TABLES_METADATA(destination_project_id, source_project_ids, dataset_batch_size, exclude_dataset_ids)
TABLE_OPTIONS
| Attribute | Value |
|---|---|
| Name | INFORMATION_SCHEMA_TABLE_OPTIONS |
| ID | bqtools.[region].INFORMATION_SCHEMA_TABLE_OPTIONS |
| Description | Creates or replaces the BQMANAGER.INFORMATION_SCHEMA_TABLE_OPTIONS table, which is the aggregation of the INFORMATION_SCHEMA.TABLE_OPTIONS metadata view across multiple projects. |
| Type | PROCEDURE |
| Arguments | destination_project_id STRING, source_project_ids ARRAY<STRING>, dataset_batch_size INT64, exclude_dataset_ids ARRAY<STRING> |
| Returns | None |
| Dependencies | bqtools-qb.[region].INFORMATION_SCHEMA_TABLE_OPTIONS |
execution: INFORMATION_SCHEMA_TABLE_OPTIONS
CALL bqmanager.eu.INFORMATION_SCHEMA_TABLE_OPTIONS(destination_project_id, source_project_ids, dataset_batch_size, exclude_dataset_ids)
CALL bqmanager.us.INFORMATION_SCHEMA_TABLE_OPTIONS(destination_project_id, source_project_ids, dataset_batch_size, exclude_dataset_ids)
PARTITIONS
| Attribute | Value |
|---|---|
| Name | INFORMATION_SCHEMA_PARTITIONS |
| ID | bqtools.[region].INFORMATION_SCHEMA_PARTITIONS |
| Description | Creates or replaces the BQMANAGER.INFORMATION_SCHEMA_PARTITIONS table, which is the aggregation of the INFORMATION_SCHEMA.PARTITIONS metadata view across multiple projects. |
| Type | PROCEDURE |
| Arguments | destination_project_id STRING, source_project_ids ARRAY<STRING>, dataset_batch_size INT64, exclude_dataset_ids ARRAY<STRING> |
| Returns | None |
| Dependencies | bqtools-qb.[region].INFORMATION_SCHEMA_PARTITIONS |
execution: INFORMATION_SCHEMA_PARTITIONS
CALL bqmanager.eu.INFORMATION_SCHEMA_PARTITIONS(destination_project_id, source_project_ids, dataset_batch_size, exclude_dataset_ids)
CALL bqmanager.us.INFORMATION_SCHEMA_PARTITIONS(destination_project_id, source_project_ids, dataset_batch_size, exclude_dataset_ids)