ColumnNamesSummary¶

class ColumnNamesSummary(sum_op)[source]: Manager for summaries of column names for a dataset.

Methods

`ColumnNamesSummary.__init__`(sum_op)	Constructor for column name summary manager.
`ColumnNamesSummary.dump_summary`(filename, ...)
`ColumnNamesSummary.get_details_dict`(...)	Return the summary dictionary extracted from a ColumnNameSummary.
`ColumnNamesSummary.get_individual`(...[, ...])	Return a dictionary of the individual file summaries.
`ColumnNamesSummary.get_summary`([...])	Return a summary dictionary with the information.
`ColumnNamesSummary.get_summary_details`([...])	Return a dictionary with the details for individual files and the overall dataset.
`ColumnNamesSummary.get_text_summary`([...])	Return a complete text summary by assembling the individual pieces.
`ColumnNamesSummary.get_text_summary_details`([...])	Return a text summary of the information represented by this summary.
`ColumnNamesSummary.merge_all_info`()	Create a ColumnNameSummary containing the overall dataset summary.
`ColumnNamesSummary.save`(save_dir[, ...])	Save the summaries using the format indicated.
`ColumnNamesSummary.save_visualizations`(save_dir)	Save summary visualizations, if any, using the format indicated.
`ColumnNamesSummary.update_summary`(new_info)	Update the summary for a given tabular input file.

Attributes

`ColumnNamesSummary.DISPLAY_INDENT`
`ColumnNamesSummary.INDIVIDUAL_SUMMARIES_PATH`

ColumnNamesSummary.__init__(sum_op)[source]¶

Constructor for column name summary manager.

Parameters:: sum_op (SummarizeColumnNamesOp) – Operation associated with this summary.

static ColumnNamesSummary.dump_summary(filename, summary)¶

ColumnNamesSummary.get_details_dict(column_summary)[source]¶

Return the summary dictionary extracted from a ColumnNameSummary.

Parameters:: column_summary (ColumnNameSummary) – A column name summary for the data file.
Returns:: dict - a dictionary with the summary information for column names.

ColumnNamesSummary.get_individual(summary_details, separately=True)¶

Return a dictionary of the individual file summaries.

Parameters:

summary_details (dict) – Dictionary of the individual file summaries.
separately (bool) – If True (the default), each individual summary has a header for separate output.

ColumnNamesSummary.get_summary(individual_summaries='separate')¶

Return a summary dictionary with the information.

Parameters:: individual_summaries (str) – “separate”, “consolidated”, or “none”
Returns:: dict - dictionary with “Dataset” and “Individual files” keys.

Notes: The individual_summaries value is processed as follows:

“separate” individual summaries are to be in separate files.
“consolidated” means that the individual summaries are in same file as overall summary.
“none” means that only the overall summary is produced.

ColumnNamesSummary.get_summary_details(include_individual=True)¶

Return a dictionary with the details for individual files and the overall dataset.

Parameters:: include_individual (bool) – If True, summaries for individual files are included.
Returns:: dict - a dictionary with ‘Dataset’ and ‘Individual files’ keys.

Notes

The ‘Dataset’ value is either a string or a dictionary with the overall summary.
The ‘Individual files’ value is dictionary whose keys are file names and values are
their corresponding summaries.

Users are expected to provide merge_all_info and get_details_dict functions to support this.

ColumnNamesSummary.get_text_summary(individual_summaries='separate')¶

Return a complete text summary by assembling the individual pieces.

Parameters:: individual_summaries (str) – One of the values “separate”, “consolidated”, or “none”.
Returns:: Complete text summary.
Return type:: str

Notes: The options are:

“none”: Just has “Dataset” key.
“consolidated” Has “Dataset” and “Individual files” keys with the values of each is a string.
“separate” Has “Dataset” and “Individual files” keys. The values of “Individual files” is a dict.

ColumnNamesSummary.get_text_summary_details(include_individual=True)¶

Return a text summary of the information represented by this summary.

Parameters:: include_individual (bool) – If True (the default), individual summaries are in “Individual files”.

ColumnNamesSummary.merge_all_info()[source]¶

Create a ColumnNameSummary containing the overall dataset summary.

Returns:: ColumnNameSummary - the overall summary object for column names.

ColumnNamesSummary.save(save_dir, file_formats=['.txt'], individual_summaries='separate', task_name='')¶

Save the summaries using the format indicated.

Parameters:

save_dir (str) – Name of the directory to save the summaries in.
file_formats (list) – List of file formats to use for saving.
individual_summaries (str) – Save one file or multiple files based on setting.
task_name (str) – If this summary corresponds to files from a task, the task_name is used in filename.

ColumnNamesSummary.save_visualizations(save_dir, file_formats=['.svg'], individual_summaries='separate', task_name='')¶

Save summary visualizations, if any, using the format indicated.

Parameters:

save_dir (str) – Name of the directory to save the summaries in.
file_formats (list) – List of file formats to use for saving.
individual_summaries (str) – Save one file or multiple files based on setting.
task_name (str) – If this summary corresponds to files from a task, the task_name is used in filename.

ColumnNamesSummary.update_summary(new_info)[source]¶

Update the summary for a given tabular input file.

Parameters:: new_info (dict) – A dictionary with the parameters needed to update a summary.

Notes

The summary information is kept in separate ColumnNameSummary objects for each file.
The summary needs a “name” str and a “column_names” list.
The summary uses ColumnNameSummary as the summary object.

ColumnNamesSummary.DISPLAY_INDENT = ' '¶

ColumnNamesSummary.INDIVIDUAL_SUMMARIES_PATH = 'individual_summaries'¶