Base Data

class dataprofiler.data_readers.base_data.BaseData(input_file_path, data, options)

Bases: object

Abstract class for data loading and saving

Base class for loading a dataset. Options can be specified and maybe more specific to the subclasses.

Parameters

  • input_file_path (str) – path to the file being loaded or None

  • data (multiple types) – data being loaded into the class instead of an input file

  • options (dict) – options pertaining to the data type

Returns

None

data_type = None
info = None
property data
property is_structured

Determines compatibility with StructuredProfiler

property data_format
property file_encoding
get_batch_generator(batch_size)
classmethod is_match(input_file_path, options)
reload(input_file_path, data, options)

Reload the data class with a new dataset. This erases all existing data/options and replaces it with the input data/options.

Parameters

  • input_file_path (str) – path to the file being loaded or None

  • data (multiple types) – data being loaded into the class instead of an input file

  • options (dict) – options pertaining to the data type

Returns

None

property length

Returns the length of the dataset which is loaded.

Returns

length of the dataset