Float Column Profile

Float profile analysis for individual col within structured profiling.

class dataprofiler.profilers.float_column_profile.FloatColumn(name: Optional[str], options: Optional[dataprofiler.profilers.profiler_options.FloatOptions] = None)

Bases: dataprofiler.profilers.numerical_column_stats.NumericStatsMixin, dataprofiler.profilers.base_column_profilers.BaseColumnPrimitiveTypeProfiler

Float column profile mixin with numerical stats.

Represents a column in the dataset which is a float column.

Initialize column base properties and itself.

Parameters
  • name (String) – Name of the data

  • options (FloatOptions) – Options for the float column

type: Optional[str] = 'float'
diff(other_profile: dataprofiler.profilers.float_column_profile.FloatColumn, options: Optional[Dict] = None) Dict

Find the differences for FloatColumns.

Parameters

other_profile (FloatColumn) – profile to find the difference with

Returns

the FloatColumn differences

Return type

dict

report(remove_disabled_flag: bool = False) Dict

Report profile attribute of class; potentially pop val from self.profile.

property profile: Dict

Return the profile of the column.

Returns

property precision: Dict[str, Optional[float]]

Report statistics on the significant figures of each element in the data.

Returns

Precision statistics

Return type

dict

property data_type_ratio: Optional[float]

Calculate the ratio of samples which match this data type.

Returns

ratio of data type

Return type

float

col_type = None
static is_float(x: str) bool

Return True if x is float.

For “0.80” this function returns True For “1.00” this function returns True For “1” this function returns True

Parameters

x (str) – string to test

Returns

if is float or not

Return type

bool

static is_int(x: str) bool

Return True if x is integer.

For “0.80” This function returns False For “1.00” This function returns True For “1” this function returns True

Parameters

x (str) – string to test

Returns

if is integer or not

Return type

bool

property kurtosis: float

Return kurtosis value.

property mean: float

Return mean value.

property median: float

Estimate the median of the data.

Returns

the median

Return type

float

property median_abs_deviation: float

Get median absolute deviation estimated from the histogram of the data.

Subtract bin edges from the median value Fold the histogram to positive and negative parts around zero Impose the two bin edges from the two histogram Calculate the counts for the two histograms with the imposed bin edges Superimpose the counts from the two histograms Interpolate the median absolute deviation from the superimposed counts

Returns

median absolute deviation

property mode: List[float]

Find an estimate for the mode[s] of the data.

Returns

the mode(s) of the data

Return type

list(float)

static np_type_to_type(val: Any) Union[int, float]

Convert numpy variables to base python type variables.

Parameters

val (numpy type or base type) – value to check & change

Return val

base python type

Rtype val

int or float

property skewness: float

Return skewness value.

property stddev: float

Return stddev value.

update(df_series: pandas.core.series.Series) dataprofiler.profilers.float_column_profile.FloatColumn

Update the column profile.

Parameters

df_series (pandas.core.series.Series) – df series

Returns

updated FloatColumn

Return type

FloatColumn

property variance: float

Return variance.

name: Optional[str]
sample_size: int
metadata: Dict
times: Dict
thread_safe: bool
match_count: int