dataprofiler.labelers package

Submodules

• dataprofiler.labelers.base_data_labeler module
  • BaseDataLabeler
    • BaseDataLabeler.help()
    • BaseDataLabeler.label_mapping
    • BaseDataLabeler.reverse_label_mapping
    • BaseDataLabeler.labels
    • BaseDataLabeler.preprocessor
    • BaseDataLabeler.model
    • BaseDataLabeler.postprocessor
    • BaseDataLabeler.set_params()
    • BaseDataLabeler.add_label()
    • BaseDataLabeler.set_labels()
    • BaseDataLabeler.predict()
    • BaseDataLabeler.set_preprocessor()
    • BaseDataLabeler.set_model()
    • BaseDataLabeler.set_postprocessor()
    • BaseDataLabeler.check_pipeline()
    • BaseDataLabeler.load_from_library()
    • BaseDataLabeler.load_from_disk()
    • BaseDataLabeler.load_with_components()
    • BaseDataLabeler.save_to_disk()
  • TrainableDataLabeler
    • TrainableDataLabeler.fit()
    • TrainableDataLabeler.set_model()
    • TrainableDataLabeler.load_with_components()
    • TrainableDataLabeler.add_label()
    • TrainableDataLabeler.check_pipeline()
    • TrainableDataLabeler.help()
    • TrainableDataLabeler.label_mapping
    • TrainableDataLabeler.labels
    • TrainableDataLabeler.load_from_disk()
    • TrainableDataLabeler.load_from_library()
    • TrainableDataLabeler.model
    • TrainableDataLabeler.postprocessor
    • TrainableDataLabeler.predict()
    • TrainableDataLabeler.preprocessor
    • TrainableDataLabeler.reverse_label_mapping
    • TrainableDataLabeler.save_to_disk()
    • TrainableDataLabeler.set_labels()
    • TrainableDataLabeler.set_params()
    • TrainableDataLabeler.set_postprocessor()
    • TrainableDataLabeler.set_preprocessor()
• dataprofiler.labelers.base_model module
  • AutoSubRegistrationMeta
    • AutoSubRegistrationMeta.mro()
    • AutoSubRegistrationMeta.register()
  • BaseModel
    • BaseModel.requires_zero_mapping
    • BaseModel.label_mapping
    • BaseModel.reverse_label_mapping
    • BaseModel.labels
    • BaseModel.num_labels
    • BaseModel.get_class()
    • BaseModel.get_parameters()
    • BaseModel.set_params()
    • BaseModel.add_label()
    • BaseModel.set_label_mapping()
    • BaseModel.help()
    • BaseModel.reset_weights()
    • BaseModel.predict()
    • BaseModel.load_from_disk()
    • BaseModel.save_to_disk()
  • BaseTrainableModel
    • BaseTrainableModel.fit()
    • BaseTrainableModel.add_label()
    • BaseTrainableModel.get_class()
    • BaseTrainableModel.get_parameters()
    • BaseTrainableModel.help()
    • BaseTrainableModel.label_mapping
    • BaseTrainableModel.labels
    • BaseTrainableModel.load_from_disk()
    • BaseTrainableModel.num_labels
    • BaseTrainableModel.predict()
    • BaseTrainableModel.requires_zero_mapping
    • BaseTrainableModel.reset_weights()
    • BaseTrainableModel.reverse_label_mapping
    • BaseTrainableModel.save_to_disk()
    • BaseTrainableModel.set_label_mapping()
    • BaseTrainableModel.set_params()
• dataprofiler.labelers.char_load_tf_model module
  • CharLoadTFModel
    • CharLoadTFModel.requires_zero_mapping
    • CharLoadTFModel.set_label_mapping()
    • CharLoadTFModel.save_to_disk()
    • CharLoadTFModel.load_from_disk()
    • CharLoadTFModel.reset_weights()
    • CharLoadTFModel.fit()
    • CharLoadTFModel.predict()
    • CharLoadTFModel.details()
    • CharLoadTFModel.add_label()
    • CharLoadTFModel.get_class()
    • CharLoadTFModel.get_parameters()
    • CharLoadTFModel.help()
    • CharLoadTFModel.label_mapping
    • CharLoadTFModel.labels
    • CharLoadTFModel.num_labels
    • CharLoadTFModel.reverse_label_mapping
    • CharLoadTFModel.set_params()
• dataprofiler.labelers.character_level_cnn_model module
  • build_embd_dictionary()
  • create_glove_char()
  • ThreshArgMaxLayer
    • ThreshArgMaxLayer.get_config()
    • ThreshArgMaxLayer.call()
    • ThreshArgMaxLayer.add_loss()
    • ThreshArgMaxLayer.add_metric()
    • ThreshArgMaxLayer.add_variable()
    • ThreshArgMaxLayer.add_weight()
    • ThreshArgMaxLayer.build()
    • ThreshArgMaxLayer.build_from_config()
    • ThreshArgMaxLayer.compute_dtype
    • ThreshArgMaxLayer.compute_mask()
    • ThreshArgMaxLayer.compute_output_shape()
    • ThreshArgMaxLayer.compute_output_spec()
    • ThreshArgMaxLayer.count_params()
    • ThreshArgMaxLayer.dtype
    • ThreshArgMaxLayer.dtype_policy
    • ThreshArgMaxLayer.from_config()
    • ThreshArgMaxLayer.get_build_config()
    • ThreshArgMaxLayer.get_weights()
    • ThreshArgMaxLayer.input
    • ThreshArgMaxLayer.input_dtype
    • ThreshArgMaxLayer.input_spec
    • ThreshArgMaxLayer.load_own_variables()
    • ThreshArgMaxLayer.losses
    • ThreshArgMaxLayer.metrics
    • ThreshArgMaxLayer.metrics_variables
    • ThreshArgMaxLayer.non_trainable_variables
    • ThreshArgMaxLayer.non_trainable_weights
    • ThreshArgMaxLayer.output
    • ThreshArgMaxLayer.path
    • ThreshArgMaxLayer.quantization_mode
    • ThreshArgMaxLayer.quantize()
    • ThreshArgMaxLayer.quantized_call()
    • ThreshArgMaxLayer.save_own_variables()
    • ThreshArgMaxLayer.set_weights()
    • ThreshArgMaxLayer.stateless_call()
    • ThreshArgMaxLayer.supports_masking
    • ThreshArgMaxLayer.symbolic_call()
    • ThreshArgMaxLayer.trainable
    • ThreshArgMaxLayer.trainable_variables
    • ThreshArgMaxLayer.trainable_weights
    • ThreshArgMaxLayer.variable_dtype
    • ThreshArgMaxLayer.variables
    • ThreshArgMaxLayer.weights
  • EncodingLayer
    • EncodingLayer.get_config()
    • EncodingLayer.call()
    • EncodingLayer.add_loss()
    • EncodingLayer.add_metric()
    • EncodingLayer.add_variable()
    • EncodingLayer.add_weight()
    • EncodingLayer.build()
    • EncodingLayer.build_from_config()
    • EncodingLayer.compute_dtype
    • EncodingLayer.compute_mask()
    • EncodingLayer.compute_output_shape()
    • EncodingLayer.compute_output_spec()
    • EncodingLayer.count_params()
    • EncodingLayer.dtype
    • EncodingLayer.dtype_policy
    • EncodingLayer.from_config()
    • EncodingLayer.get_build_config()
    • EncodingLayer.get_weights()
    • EncodingLayer.input
    • EncodingLayer.input_dtype
    • EncodingLayer.input_spec
    • EncodingLayer.load_own_variables()
    • EncodingLayer.losses
    • EncodingLayer.metrics
    • EncodingLayer.metrics_variables
    • EncodingLayer.non_trainable_variables
    • EncodingLayer.non_trainable_weights
    • EncodingLayer.output
    • EncodingLayer.path
    • EncodingLayer.quantization_mode
    • EncodingLayer.quantize()
    • EncodingLayer.quantized_call()
    • EncodingLayer.save_own_variables()
    • EncodingLayer.set_weights()
    • EncodingLayer.stateless_call()
    • EncodingLayer.supports_masking
    • EncodingLayer.symbolic_call()
    • EncodingLayer.trainable
    • EncodingLayer.trainable_variables
    • EncodingLayer.trainable_weights
    • EncodingLayer.variable_dtype
    • EncodingLayer.variables
    • EncodingLayer.weights
  • CharacterLevelCnnModel
    • CharacterLevelCnnModel.requires_zero_mapping
    • CharacterLevelCnnModel.set_label_mapping()
    • CharacterLevelCnnModel.save_to_disk()
    • CharacterLevelCnnModel.load_from_disk()
    • CharacterLevelCnnModel.reset_weights()
    • CharacterLevelCnnModel.fit()
    • CharacterLevelCnnModel.predict()
    • CharacterLevelCnnModel.details()
    • CharacterLevelCnnModel.add_label()
    • CharacterLevelCnnModel.get_class()
    • CharacterLevelCnnModel.get_parameters()
    • CharacterLevelCnnModel.help()
    • CharacterLevelCnnModel.label_mapping
    • CharacterLevelCnnModel.labels
    • CharacterLevelCnnModel.num_labels
    • CharacterLevelCnnModel.reverse_label_mapping
    • CharacterLevelCnnModel.set_params()
• dataprofiler.labelers.classification_report_utils module
  • convert_confusion_matrix_to_MCM()
  • precision_recall_fscore_support()
  • classification_report()
• dataprofiler.labelers.column_name_model module
  • ColumnNameModel
    • ColumnNameModel.reset_weights()
    • ColumnNameModel.predict()
    • ColumnNameModel.load_from_disk()
    • ColumnNameModel.save_to_disk()
    • ColumnNameModel.add_label()
    • ColumnNameModel.get_class()
    • ColumnNameModel.get_parameters()
    • ColumnNameModel.help()
    • ColumnNameModel.label_mapping
    • ColumnNameModel.labels
    • ColumnNameModel.num_labels
    • ColumnNameModel.requires_zero_mapping
    • ColumnNameModel.reverse_label_mapping
    • ColumnNameModel.set_label_mapping()
    • ColumnNameModel.set_params()
• dataprofiler.labelers.data_labelers module
  • train_structured_labeler()
  • UnstructuredDataLabeler
    • UnstructuredDataLabeler.add_label()
    • UnstructuredDataLabeler.check_pipeline()
    • UnstructuredDataLabeler.help()
    • UnstructuredDataLabeler.label_mapping
    • UnstructuredDataLabeler.labels
    • UnstructuredDataLabeler.load_from_disk()
    • UnstructuredDataLabeler.load_from_library()
    • UnstructuredDataLabeler.load_with_components()
    • UnstructuredDataLabeler.model
    • UnstructuredDataLabeler.postprocessor
    • UnstructuredDataLabeler.predict()
    • UnstructuredDataLabeler.preprocessor
    • UnstructuredDataLabeler.reverse_label_mapping
    • UnstructuredDataLabeler.save_to_disk()
    • UnstructuredDataLabeler.set_labels()
    • UnstructuredDataLabeler.set_model()
    • UnstructuredDataLabeler.set_params()
    • UnstructuredDataLabeler.set_postprocessor()
    • UnstructuredDataLabeler.set_preprocessor()
  • StructuredDataLabeler
    • StructuredDataLabeler.add_label()
    • StructuredDataLabeler.check_pipeline()
    • StructuredDataLabeler.help()
    • StructuredDataLabeler.label_mapping
    • StructuredDataLabeler.labels
    • StructuredDataLabeler.load_from_disk()
    • StructuredDataLabeler.load_from_library()
    • StructuredDataLabeler.load_with_components()
    • StructuredDataLabeler.model
    • StructuredDataLabeler.postprocessor
    • StructuredDataLabeler.predict()
    • StructuredDataLabeler.preprocessor
    • StructuredDataLabeler.reverse_label_mapping
    • StructuredDataLabeler.save_to_disk()
    • StructuredDataLabeler.set_labels()
    • StructuredDataLabeler.set_model()
    • StructuredDataLabeler.set_params()
    • StructuredDataLabeler.set_postprocessor()
    • StructuredDataLabeler.set_preprocessor()
  • DataLabeler
    • DataLabeler.labeler_classes
    • DataLabeler.load_from_library()
    • DataLabeler.load_from_disk()
    • DataLabeler.load_with_components()
• dataprofiler.labelers.data_processing module
  • AutoSubRegistrationMeta
    • AutoSubRegistrationMeta.mro()
    • AutoSubRegistrationMeta.register()
  • BaseDataProcessor
    • BaseDataProcessor.processor_type
    • BaseDataProcessor.get_class()
    • BaseDataProcessor.help()
    • BaseDataProcessor.get_parameters()
    • BaseDataProcessor.set_params()
    • BaseDataProcessor.process()
    • BaseDataProcessor.load_from_disk()
    • BaseDataProcessor.load_from_library()
    • BaseDataProcessor.save_to_disk()
  • BaseDataPreprocessor
    • BaseDataPreprocessor.processor_type
    • BaseDataPreprocessor.process()
    • BaseDataPreprocessor.get_class()
    • BaseDataPreprocessor.get_parameters()
    • BaseDataPreprocessor.help()
    • BaseDataPreprocessor.load_from_disk()
    • BaseDataPreprocessor.load_from_library()
    • BaseDataPreprocessor.save_to_disk()
    • BaseDataPreprocessor.set_params()
  • BaseDataPostprocessor
    • BaseDataPostprocessor.processor_type
    • BaseDataPostprocessor.process()
    • BaseDataPostprocessor.get_class()
    • BaseDataPostprocessor.get_parameters()
    • BaseDataPostprocessor.help()
    • BaseDataPostprocessor.load_from_disk()
    • BaseDataPostprocessor.load_from_library()
    • BaseDataPostprocessor.save_to_disk()
    • BaseDataPostprocessor.set_params()
  • DirectPassPreprocessor
    • DirectPassPreprocessor.help()
    • DirectPassPreprocessor.process()
    • DirectPassPreprocessor.get_class()
    • DirectPassPreprocessor.get_parameters()
    • DirectPassPreprocessor.load_from_disk()
    • DirectPassPreprocessor.load_from_library()
    • DirectPassPreprocessor.processor_type
    • DirectPassPreprocessor.save_to_disk()
    • DirectPassPreprocessor.set_params()
  • CharPreprocessor
    • CharPreprocessor.help()
    • CharPreprocessor.process()
    • CharPreprocessor.get_class()
    • CharPreprocessor.get_parameters()
    • CharPreprocessor.load_from_disk()
    • CharPreprocessor.load_from_library()
    • CharPreprocessor.processor_type
    • CharPreprocessor.save_to_disk()
    • CharPreprocessor.set_params()
  • CharEncodedPreprocessor
    • CharEncodedPreprocessor.process()
    • CharEncodedPreprocessor.get_class()
    • CharEncodedPreprocessor.get_parameters()
    • CharEncodedPreprocessor.help()
    • CharEncodedPreprocessor.load_from_disk()
    • CharEncodedPreprocessor.load_from_library()
    • CharEncodedPreprocessor.processor_type
    • CharEncodedPreprocessor.save_to_disk()
    • CharEncodedPreprocessor.set_params()
  • CharPostprocessor
    • CharPostprocessor.help()
    • CharPostprocessor.convert_to_NER_format()
    • CharPostprocessor.match_sentence_lengths()
    • CharPostprocessor.process()
    • CharPostprocessor.get_class()
    • CharPostprocessor.get_parameters()
    • CharPostprocessor.load_from_disk()
    • CharPostprocessor.load_from_library()
    • CharPostprocessor.processor_type
    • CharPostprocessor.save_to_disk()
    • CharPostprocessor.set_params()
  • StructCharPreprocessor
    • StructCharPreprocessor.help()
    • StructCharPreprocessor.get_parameters()
    • StructCharPreprocessor.convert_to_unstructured_format()
    • StructCharPreprocessor.process()
    • StructCharPreprocessor.get_class()
    • StructCharPreprocessor.load_from_disk()
    • StructCharPreprocessor.load_from_library()
    • StructCharPreprocessor.processor_type
    • StructCharPreprocessor.save_to_disk()
    • StructCharPreprocessor.set_params()
  • StructCharPostprocessor
    • StructCharPostprocessor.help()
    • StructCharPostprocessor.match_sentence_lengths()
    • StructCharPostprocessor.convert_to_structured_analysis()
    • StructCharPostprocessor.process()
    • StructCharPostprocessor.get_class()
    • StructCharPostprocessor.get_parameters()
    • StructCharPostprocessor.load_from_disk()
    • StructCharPostprocessor.load_from_library()
    • StructCharPostprocessor.processor_type
    • StructCharPostprocessor.save_to_disk()
    • StructCharPostprocessor.set_params()
  • RegexPostProcessor
    • RegexPostProcessor.help()
    • RegexPostProcessor.priority_prediction()
    • RegexPostProcessor.split_prediction()
    • RegexPostProcessor.process()
    • RegexPostProcessor.get_class()
    • RegexPostProcessor.get_parameters()
    • RegexPostProcessor.load_from_disk()
    • RegexPostProcessor.load_from_library()
    • RegexPostProcessor.processor_type
    • RegexPostProcessor.save_to_disk()
    • RegexPostProcessor.set_params()
  • StructRegexPostProcessor
    • StructRegexPostProcessor.set_params()
    • StructRegexPostProcessor.help()
    • StructRegexPostProcessor.process()
    • StructRegexPostProcessor.get_class()
    • StructRegexPostProcessor.get_parameters()
    • StructRegexPostProcessor.load_from_disk()
    • StructRegexPostProcessor.load_from_library()
    • StructRegexPostProcessor.processor_type
    • StructRegexPostProcessor.save_to_disk()
  • ColumnNameModelPostprocessor
    • ColumnNameModelPostprocessor.help()
    • ColumnNameModelPostprocessor.process()
    • ColumnNameModelPostprocessor.get_class()
    • ColumnNameModelPostprocessor.get_parameters()
    • ColumnNameModelPostprocessor.load_from_disk()
    • ColumnNameModelPostprocessor.load_from_library()
    • ColumnNameModelPostprocessor.processor_type
    • ColumnNameModelPostprocessor.save_to_disk()
    • ColumnNameModelPostprocessor.set_params()
• dataprofiler.labelers.labeler_utils module
  • f1_report_dict_to_str()
  • evaluate_accuracy()
  • get_tf_layer_index_from_name()
  • hide_tf_logger_warnings()
  • protected_register_keras_serializable()
  • FBetaScore
    • FBetaScore.update_state()
    • FBetaScore.result()
    • FBetaScore.get_config()
    • FBetaScore.add_variable()
    • FBetaScore.add_weight()
    • FBetaScore.dtype
    • FBetaScore.from_config()
    • FBetaScore.reset_state()
    • FBetaScore.stateless_reset_state()
    • FBetaScore.stateless_result()
    • FBetaScore.stateless_update_state()
    • FBetaScore.variables
  • F1Score
    • F1Score.add_variable()
    • F1Score.add_weight()
    • F1Score.dtype
    • F1Score.from_config()
    • F1Score.reset_state()
    • F1Score.result()
    • F1Score.stateless_reset_state()
    • F1Score.stateless_result()
    • F1Score.stateless_update_state()
    • F1Score.update_state()
    • F1Score.variables
    • F1Score.get_config()
• dataprofiler.labelers.regex_model module
  • RegexModel
    • RegexModel.reset_weights()
    • RegexModel.predict()
    • RegexModel.load_from_disk()
    • RegexModel.save_to_disk()
    • RegexModel.add_label()
    • RegexModel.get_class()
    • RegexModel.get_parameters()
    • RegexModel.help()
    • RegexModel.label_mapping
    • RegexModel.labels
    • RegexModel.num_labels
    • RegexModel.requires_zero_mapping
    • RegexModel.reverse_label_mapping
    • RegexModel.set_label_mapping()
    • RegexModel.set_params()
• dataprofiler.labelers.utils module
  • warn_missing_module()
  • require_module()

Module contents

The following will list the built-in models, processors, and data labelers.

Models:

1. CharacterLevelCnnModel - character classification of text.

2. RegexModel - character classification of text.

Processors:

Preprocessors

1. CharPreprocessor

2. StructCharPreprocessor

3. DirectPassPreprocessor

PostProcessors

1. CharPreprocessor

2. StructCharPostprocessor

3. RegexPostProcessor

Data Labelers:

Classes

1. UnstructuredDataLabeler

2. StructuredDataLabeler

Files to load from disk using BaseDataLabeler.load_from_library(<NAME>)

1. unstructured_model

2. structured_model

3. regex_model