DEVELOPMENT... OpenML
Data
cps_85_wages

cps_85_wages

active ARFF Publicly available Visibility: public Uploaded 29-09-2014 by unknown
0 likes downloaded by 0 people , 0 total downloads 0 issues 0 downvotes
Issue #Downvotes for this reason By


Loading wiki
Help us complete this description Edit
Author: Source: Unknown - Date unknown Please cite: Determinants of Wages from the 1985 Current Population Survey Summary: The Current Population Survey (CPS) is used to supplement census information between census years. These data consist of a random sample of 534 persons from the CPS, with information on wages and other characteristics of the workers, including sex, number of years of education, years of work experience, occupational status, region of residence and union membership. We wish to determine (i) whether wages are related to these characteristics and (ii) whether there is a gender gap in wages. Based on residual plots, wages were log-transformed to stabilize the variance. Age and work experience were almost perfectly correlated (r=.98). Multiple regression of log wages against sex, age, years of education, work experience, union membership, southern residence, and occupational status showed that these covariates were related to wages (pooled F test, p < .0001). The effect of age was not significant after controlling for experience. Standardized residual plots showed no patterns, except for one large outlier with lower wages than expected. This was a male, with 22 years of experience and 12 years of education, in a management position, who lived in the north and was not a union member. Removing this person from the analysis did not substantially change the results, so that the final model included the entire sample. Adjusting for all other variables in the model, females earned 81% (75%, 88%) the wages of males (p < .0001). Wages increased 41% (28%, 56%) for every 5 additional years of education (p < .0001). They increased by 11% (7%, 14%) for every additional 10 years of experience (p < .0001). Union members were paid 23% (12%, 36%) more than non-union members (p < .0001). Northerns were paid 11% (2%, 20%) more than southerns (p =.016). Management and professional positions were paid most, and service and clerical positions were paid least (pooled F-test, p < .0001). Overall variance explained was R2 = .35. In summary, many factors describe the variations in wages: occupational status, years of experience, years of education, sex, union membership and region of residence. However, despite adjustment for all factors that were available, there still appeared to be a gender gap in wages. There is no readily available explanation for this gender gap. Authorization: Public Domain Reference: Berndt, ER. The Practice of Econometrics. 1991. NY: Addison-Wesley. Description: The datafile contains 534 observations on 11 variables sampled from the Current Population Survey of 1985. This data set demonstrates multiple regression, confounding, transformations, multicollinearity, categorical variables, ANOVA, pooled tests of significance, interactions and model building strategies. Variable names in order from left to right: EDUCATION: Number of years of education. SOUTH: Indicator variable for Southern Region (1=Person lives in South, 0=Person lives elsewhere). SEX: Indicator variable for sex (1=Female, 0=Male). EXPERIENCE: Number of years of work experience. UNION: Indicator variable for union membership (1=Union member, 0=Not union member). WAGE: Wage (dollars per hour). AGE: Age (years). RACE: Race (1=Other, 2=Hispanic, 3=White). OCCUPATION: Occupational category (1=Management, 2=Sales, 3=Clerical, 4=Service, 5=Professional, 6=Other). SECTOR: Sector (0=Other, 1=Manufacturing, 2=Construction). MARR: Marital Status (0=Unmarried, 1=Married) Therese Stukel Dartmouth Hitchcock Medical Center One Medical Center Dr. Lebanon, NH 03756 e-mail: stukel@dartmouth.edu Information about the dataset CLASSTYPE: numeric CLASSINDEX: none specific

11 features

WAGE (target)numeric238 unique values
0 missing
EDUCATIONnumeric17 unique values
0 missing
SOUTHnominal2 unique values
0 missing
SEXnominal2 unique values
0 missing
EXPERIENCEnumeric52 unique values
0 missing
UNIONnominal2 unique values
0 missing
AGEnumeric47 unique values
0 missing
RACEnominal3 unique values
0 missing
OCCUPATIONnominal6 unique values
0 missing
SECTORnominal3 unique values
0 missing
MARRnominal2 unique values
0 missing

107 properties

534
Number of instances (rows) of the dataset.
11
Number of attributes (columns) of the dataset.
0
Number of distinct values of the target attribute (if it is nominal).
0
Number of missing values in the dataset.
0
Number of instances with at least one value missing.
4
Number of numeric attributes.
7
Number of nominal attributes.
-3.8
Average class difference between consecutive instances.
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.DecisionStump -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
Error rate achieved by the landmarker weka.classifiers.trees.DecisionStump -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
Kappa coefficient achieved by the landmarker weka.classifiers.trees.DecisionStump -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
Area Under the ROC Curve achieved by the landmarker weka.classifiers.bayes.NaiveBayes -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
Error rate achieved by the landmarker weka.classifiers.bayes.NaiveBayes -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
Kappa coefficient achieved by the landmarker weka.classifiers.bayes.NaiveBayes -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
Area Under the ROC Curve achieved by the landmarker weka.classifiers.lazy.IBk -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
Error rate achieved by the landmarker weka.classifiers.lazy.IBk -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
Kappa coefficient achieved by the landmarker weka.classifiers.lazy.IBk -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
Entropy of the target attribute values.
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.DecisionStump
Error rate achieved by the landmarker weka.classifiers.trees.DecisionStump
Kappa coefficient achieved by the landmarker weka.classifiers.trees.DecisionStump
0.02
Number of attributes divided by the number of instances.
Number of attributes needed to optimally describe the class (under the assumption of independence among attributes). Equals ClassEntropy divided by MeanMutualInformation.
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.J48 -C .00001
Error rate achieved by the landmarker weka.classifiers.trees.J48 -C .00001
Kappa coefficient achieved by the landmarker weka.classifiers.trees.J48 -C .00001
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.J48 -C .0001
Error rate achieved by the landmarker weka.classifiers.trees.J48 -C .0001
Kappa coefficient achieved by the landmarker weka.classifiers.trees.J48 -C .0001
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.J48 -C .001
Error rate achieved by the landmarker weka.classifiers.trees.J48 -C .001
Kappa coefficient achieved by the landmarker weka.classifiers.trees.J48 -C .001
Percentage of instances belonging to the most frequent class.
Number of instances belonging to the most frequent class.
Maximum entropy among attributes.
4.99
Maximum kurtosis among attributes of the numeric type.
36.83
Maximum of means among attributes of the numeric type.
Maximum mutual information between the nominal attributes and the target attribute.
6
The maximum number of distinct values among attributes of the nominal type.
1.7
Maximum skewness among attributes of the numeric type.
12.38
Maximum standard deviation of attributes of the numeric type.
Average entropy of the attributes.
1.22
Mean kurtosis among attributes of the numeric type.
19.17
Mean of means among attributes of the numeric type.
Average mutual information between the nominal attributes and the target attribute.
An estimate of the amount of irrelevant information in the attributes regarding the class. Equals (MeanAttributeEntropy - MeanMutualInformation) divided by MeanMutualInformation.
2.86
Average number of distinct values among the attributes of the nominal type.
0.68
Mean skewness among attributes of the numeric type.
7.97
Mean standard deviation of attributes of the numeric type.
Minimal entropy among attributes.
-0.58
Minimum kurtosis among attributes of the numeric type.
9.02
Minimum of means among attributes of the numeric type.
Minimal mutual information between the nominal attributes and the target attribute.
2
The minimal number of distinct values among attributes of the nominal type.
-0.2
Minimum skewness among attributes of the numeric type.
2.62
Minimum standard deviation of attributes of the numeric type.
Percentage of instances belonging to the least frequent class.
Number of instances belonging to the least frequent class.
Area Under the ROC Curve achieved by the landmarker weka.classifiers.bayes.NaiveBayes
Error rate achieved by the landmarker weka.classifiers.bayes.NaiveBayes
Kappa coefficient achieved by the landmarker weka.classifiers.bayes.NaiveBayes
4
Number of binary attributes.
36.36
Percentage of binary attributes.
0
Percentage of instances having missing values.
0
Percentage of missing values.
36.36
Percentage of numeric attributes.
63.64
Percentage of nominal attributes.
First quartile of entropy among attributes.
-0.53
First quartile of kurtosis among attributes of the numeric type.
10.02
First quartile of means among attributes of the numeric type.
First quartile of mutual information between the nominal attributes and the target attribute.
-0.02
First quartile of skewness among attributes of the numeric type.
3.25
First quartile of standard deviation of attributes of the numeric type.
Second quartile (Median) of entropy among attributes.
0.23
Second quartile (Median) of kurtosis among attributes of the numeric type.
15.42
Second quartile (Median) of means among attributes of the numeric type.
Second quartile (Median) of mutual information between the nominal attributes and the target attribute.
0.62
Second quartile (Median) of skewness among attributes of the numeric type.
8.43
Second quartile (Median) of standard deviation of attributes of the numeric type.
Third quartile of entropy among attributes.
3.95
Third quartile of kurtosis among attributes of the numeric type.
32.08
Third quartile of means among attributes of the numeric type.
Third quartile of mutual information between the nominal attributes and the target attribute.
1.44
Third quartile of skewness among attributes of the numeric type.
12.22
Third quartile of standard deviation of attributes of the numeric type.
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.REPTree -L 1
Error rate achieved by the landmarker weka.classifiers.trees.REPTree -L 1
Kappa coefficient achieved by the landmarker weka.classifiers.trees.REPTree -L 1
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.REPTree -L 2
Error rate achieved by the landmarker weka.classifiers.trees.REPTree -L 2
Kappa coefficient achieved by the landmarker weka.classifiers.trees.REPTree -L 2
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.REPTree -L 3
Error rate achieved by the landmarker weka.classifiers.trees.REPTree -L 3
Kappa coefficient achieved by the landmarker weka.classifiers.trees.REPTree -L 3
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.RandomTree -depth 1
Error rate achieved by the landmarker weka.classifiers.trees.RandomTree -depth 1
Kappa coefficient achieved by the landmarker weka.classifiers.trees.RandomTree -depth 1
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.RandomTree -depth 2
Error rate achieved by the landmarker weka.classifiers.trees.RandomTree -depth 2
Kappa coefficient achieved by the landmarker weka.classifiers.trees.RandomTree -depth 2
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.RandomTree -depth 3
Error rate achieved by the landmarker weka.classifiers.trees.RandomTree -depth 3
Kappa coefficient achieved by the landmarker weka.classifiers.trees.RandomTree -depth 3
1.46
Standard deviation of the number of distinct values among attributes of the nominal type.
Area Under the ROC Curve achieved by the landmarker weka.classifiers.lazy.IBk
Error rate achieved by the landmarker weka.classifiers.lazy.IBk
Kappa coefficient achieved by the landmarker weka.classifiers.lazy.IBk

14 tasks

2 runs - estimation_procedure: 10-fold Crossvalidation - evaluation_measure: mean_absolute_error - target_feature: WAGE
0 runs - estimation_procedure: 10 times 10-fold Crossvalidation - evaluation_measure: mean_absolute_error - target_feature: WAGE
0 runs - estimation_procedure: 33% Holdout set - target_feature: WAGE
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
Define a new task