Partitioned Tables

These functions support profiling and working with partitioned tables.

Functions

get_date_partitions

Attribute	Value
Function Name	get_date_partitions
ID	bqtools.[region].get_date_partitions
Description	Returns an array of dates corresponding to all existing partitions in a single partitioned table.
Type	PROCEDURE
Arguments	partitioned_table_id STRING, OUT partitions ARRAY<DATE>
Returns	OUT partitions ARRAY<DATE>
Dependencies	bqtools-qb.[region].get_date_partitions, bqtools.[region].parse_resource_id

execution: get_date_partitions

EUUS

CALL bqtools.eu.get_date_partitions(partitioned_table_id, partitions);

CALL bqtools.us.get_date_partitions(partitioned_table_id, partitions);

get_date_partition_ids

Attribute	Value
Function Name	get_date_partition_ids
ID	bqtools.[region].get_date_partition_ids
Description	Returns an array of date_ids corresponding to all existing partitions in a single partitioned table.
Type	PROCEDURE
Arguments	partitioned_table_id STRING, OUT partition_ids ARRAY<STRING>
Returns	OUT partition_ids ARRAY<STRING>
Dependencies	bqtools-qb.[region].get_date_partitions, bqtools.[region].parse_resource_id

execution: get_date_partition_ids

EUUS

CALL bqtools.eu.get_date_partition_ids(partitioned_table_id, partition_ids);

CALL bqtools.us.get_date_partition_ids(partitioned_table_id, partition_ids);

get_first_date_partition

Attribute	Value
Function Name	get_first_date_partition
ID	bqtools.[region].get_first_date_partition
Description	Returns the first partition date from a single date-partitioned table.
Type	PROCEDURE
Arguments	partitioned_table_id STRING, OUT first_partition DATE
Returns	OUT first_partition DATE
Dependencies	bqtools.[region].get_date_partitions, bqtools.[region].parse_resource_id

execution: get_first_date_partition

EUUS

CALL bqtools.eu.get_first_date_partition(partitioned_table_id, first_partition);

CALL bqtools.us.get_first_date_partition(partitioned_table_id, first_partition);

get_first_date_partition_id

Attribute	Value
Function Name	get_first_date_partition_id
ID	bqtools.[region].get_first_date_partition_id
Description	Returns the first partition date_id from a single date-partitioned table.
Type	PROCEDURE
Arguments	partitioned_table_id STRING, OUT first_partition_id STRING
Returns	OUT first_partition_id STRING
Dependencies	bqtools.[region].get_date_partition_ids, bqtools.[region].parse_resource_id

execution: get_first_date_partition_id

EUUS

CALL bqtools.eu.get_first_date_partition_id(partitioned_table_id, first_partition_id);

CALL bqtools.us.get_first_date_partition_id(partitioned_table_id, first_partition_id);

get_last_date_partition

Attribute	Value
Function Name	get_last_date_partition
ID	bqtools.[region].get_last_date_partition
Description	Returns the last partition date from a single date-partitioned table.
Type	PROCEDURE
Arguments	partitioned_table_id STRING, OUT last_partition DATE
Returns	OUT last_partition DATE
Dependencies	bqtools.[region].get_date_partitions, bqtools.[region].parse_resource_id

execution: get_last_date_partition

EUUS

CALL bqtools.eu.get_last_date_partition(partitioned_table_id, last_partition);

CALL bqtools.us.get_last_date_partition(partitioned_table_id, last_partition);

get_last_date_partition_id

Attribute	Value
Function Name	get_last_date_partition_id
ID	bqtools.[region].get_last_date_partition_id
Description	Returns the last partition date_id from a single date-partitioned table.
Type	PROCEDURE
Arguments	partitioned_table_id STRING, OUT last_partition_id STRING
Returns	OUT last_partition_id STRING
Dependencies	bqtools.[region].get_date_partition_ids, bqtools.[region].parse_resource_id

execution: get_last_date_partition_id

EUUS

CALL bqtools.eu.get_last_date_partition_id(partitioned_table_id, last_partition_id);

CALL bqtools.us.get_last_date_partition_id(partitioned_table_id, last_partition_id);

get_missing_date_partitions

Attribute	Value
Function Name	get_missing_date_partitions
ID	bqtools.[region].get_missing_date_partitions
Description	Returns an array containing the missing date partitions between the start_date and end_date in a single date-partitioned table.
Type	PROCEDURE
Arguments	partitioned_table_id STRING, start_date DATE, end_date DATE, OUT missing_partitions ARRAY<DATE>
Returns	OUT missing_partitions ARRAY<DATE>
Dependencies	bqtools.[region].get_date_partitions, bqtools.[region].parse_resource_id

execution: get_missing_date_partitions

EUUS

CALL bqtools.eu.get_missing_date_partitions(partitioned_table_id, start_date, end_date, missing_partitions);

CALL bqtools.us.get_missing_date_partitions(partitioned_table_id, start_date, end_date, missing_partitions);

get_missing_date_partition_ids

Attribute	Value
Function Name	get_missing_date_partition_ids
ID	bqtools.[region].get_missing_date_partition_ids
Description	Returns an array containing the missing date partition_ids between the start_date and end_date in a single date-partitioned table.
Type	PROCEDURE
Arguments	partitioned_table_id STRING, start_date DATE, end_date DATE, OUT missing_partition_ids ARRAY<STRING>
Returns	OUT missing_partition_ids ARRAY<STRING>
Dependencies	bqtools.[region].get_date_partitions, bqtools.[region].parse_resource_id

execution: get_missing_date_partition_ids

EUUS

CALL bqtools.eu.get_missing_date_partition_ids(partitioned_table_id, start_date, end_date, missing_partition_ids);

CALL bqtools.us.get_missing_date_partition_ids(partitioned_table_id, start_date, end_date, missing_partition_ids);

overwrite_date_partitions

Attribute	Value
Function Name	overwrite_date_partitions
ID	bqtools.[region].overwrite_date_partitions
Description	Writes a range of date partitions from a date-paramaterised table function into a destination table, deleting any existing destination table date partitions within the date range.
Type	PROCEDURE
Arguments	destination_table_id STRING, date_column_name STRING, source_table_function_id STRING, start_date DATE, end_date DATE
Returns	None
Dependencies	bqtools.[region].get_last_date_partition, bqtools.[region].delete_date_partitions, bqtools.[region].insert_date_partitions

execution: overwrite_date_partitions

EUUS

CALL bqtools.eu.overwrite_date_partitions(destination_table_id, date_column_name, source_table_function_id, start_date, end_date);

CALL bqtools.us.overwrite_date_partitions(destination_table_id, date_column_name, source_table_function_id, start_date, end_date);

delete_date_partitions

Attribute	Value
Function Name	delete_date_partitions
ID	bqtools.[region].delete_date_partitions
Description	Deletes a range of date partitions from a date-partitioned destination table (with time-unit column partitioning).
Type	PROCEDURE
Arguments	destination_table_id STRING, date_column_name STRING, start_date DATE, end_date DATE
Returns	None
Dependencies	bqtools-qb.[region].delete_date_partitions

execution: delete_date_partitions

EUUS

CALL bqtools.eu.delete_date_partitions(destination_table_id, date_column_name, start_date, end_date);

CALL bqtools.us.overwrite_date_partitions(destination_table_id, date_column_name, start_date, end_date);

insert_date_partitions

Attribute	Value
Function Name	insert_date_partitions
ID	bqtools.[region].insert_date_partitions
Description	Inserts a range of date-partitions from a date-paramaterised table function into a date-partitioned destination table.
Type	PROCEDURE
Arguments	destination_table_id STRING, source_table_function_id STRING, start_date DATE, end_date DATE
Returns	None
Dependencies	bqtools-qb.[region].insert_date_partitions

execution: delete_date_partitions

EUUS

CALL bqtools.eu.delete_date_partitions(destination_table_id, source_table_function_id, start_date, end_date);

CALL bqtools.us.overwrite_date_partitions(destination_table_id, source_table_function_id, start_date, end_date);