Float Column Profile¶
Float profile analysis for individual col within structured profiling.
- class dataprofiler.profilers.float_column_profile.FloatColumn(name: Optional[str], options: Optional[dataprofiler.profilers.profiler_options.FloatOptions] = None)¶
Bases:
dataprofiler.profilers.numerical_column_stats.NumericStatsMixin
,dataprofiler.profilers.base_column_profilers.BaseColumnPrimitiveTypeProfiler
Float column profile mixin with numerical stats.
Represents a column in the dataset which is a float column.
Initialize column base properties and itself.
- Parameters
name (String) – Name of the data
options (FloatOptions) – Options for the float column
- type: Optional[str] = 'float'¶
- diff(other_profile: dataprofiler.profilers.float_column_profile.FloatColumn, options: Optional[Dict] = None) Dict ¶
Find the differences for FloatColumns.
- Parameters
other_profile (FloatColumn) – profile to find the difference with
- Returns
the FloatColumn differences
- Return type
dict
- report(remove_disabled_flag: bool = False) Dict ¶
Report profile attribute of class; potentially pop val from self.profile.
- property profile: Dict¶
Return the profile of the column.
- Returns
- property precision: Dict[str, Optional[float]]¶
Report statistics on the significant figures of each element in the data.
- Returns
Precision statistics
- Return type
dict
- property data_type_ratio: Optional[float]¶
Calculate the ratio of samples which match this data type.
- Returns
ratio of data type
- Return type
float
- col_type = None¶
- static is_float(x: str) bool ¶
Return True if x is float.
For “0.80” this function returns True For “1.00” this function returns True For “1” this function returns True
- Parameters
x (str) – string to test
- Returns
if is float or not
- Return type
bool
- static is_int(x: str) bool ¶
Return True if x is integer.
For “0.80” This function returns False For “1.00” This function returns True For “1” this function returns True
- Parameters
x (str) – string to test
- Returns
if is integer or not
- Return type
bool
- property kurtosis: float¶
Return kurtosis value.
- property mean: float¶
Return mean value.
- property median: float¶
Estimate the median of the data.
- Returns
the median
- Return type
float
- property median_abs_deviation: float¶
Get median absolute deviation estimated from the histogram of the data.
Subtract bin edges from the median value Fold the histogram to positive and negative parts around zero Impose the two bin edges from the two histogram Calculate the counts for the two histograms with the imposed bin edges Superimpose the counts from the two histograms Interpolate the median absolute deviation from the superimposed counts
- Returns
median absolute deviation
- property mode: List[float]¶
Find an estimate for the mode[s] of the data.
- Returns
the mode(s) of the data
- Return type
list(float)
- static np_type_to_type(val: Any) Union[int, float] ¶
Convert numpy variables to base python type variables.
- Parameters
val (numpy type or base type) – value to check & change
- Return val
base python type
- Rtype val
int or float
- property skewness: float¶
Return skewness value.
- property stddev: float¶
Return stddev value.
- update(df_series: pandas.core.series.Series) dataprofiler.profilers.float_column_profile.FloatColumn ¶
Update the column profile.
- Parameters
df_series (pandas.core.series.Series) – df series
- Returns
updated FloatColumn
- Return type
- property variance: float¶
Return variance.
- name: Optional[str]¶
- sample_size: int¶
- metadata: Dict¶
- times: Dict¶
- thread_safe: bool¶
- match_count: int¶