database.resources.packaging#
This script houses functions for packaging the data.
Attributes#
Functions#
|
Creates a data dictionary from the metadata. |
This function creates a datapackage. |
|
Creates data packages for each product |
|
|
Exports the table to a CSV file. |
|
Creates individual data dictionaries for each resource. |
Calls functions in the required order. |
|
|
Imports the Frictionless JSON datapackage metadata. |
Module Contents#
- database.resources.packaging.create_data_dictionary(metadata_dictionary: dict)#
Creates a data dictionary from the metadata.
- Parameters:
metadata_dictionary (dict) – Dictionary of Frictionless JSON metadata.
- Returns:
Pandas DataFrame resource schema fields.
- Return type:
pd.DataFrame (pd.DataFrame)
- database.resources.packaging.create_data_package()#
This function creates a datapackage.
- database.resources.packaging.create_individual_data_packages()#
Creates data packages for each product
- Parameters:
None.
- Returns:
None.
Note
Parses the data-package directory for pairs of dictionary and data file pairs.
- database.resources.packaging.export_data_csv(dataframe: polars.DataFrame, filename: str)#
Exports the table to a CSV file.
- Parameters:
dataframe (pl.DataFrame) – Table to write out.
filename (str) – Filename to write to.
Note
Do not include file extensions in the filename.
- database.resources.packaging.export_data_dictionaries(data_dictionary: pandas.DataFrame)#
Creates individual data dictionaries for each resource.
- Parameters:
data_dictionary (pd.DataFrame) – Data dictionary of all resources.
- Returns:
None
- database.resources.packaging.generate_dictionaries()#
Calls functions in the required order.
- Parameters:
None
- Returns:
None
- database.resources.packaging.load_json(file_path: str)#
Imports the Frictionless JSON datapackage metadata.
- Parameters:
file_path (str) – Filepath to the Frictionless JSON datapackage metadata.
- Returns:
Dictionary class of metadata
- Return type:
metadata (dict)
- database.resources.packaging.EXPORT_DIR#
- database.resources.packaging.FULL_DATAPACKAGE_DIR#
- database.resources.packaging.INDV_DATAPACKAGE_DIR#
- database.resources.packaging.METADATA_DIR#