Skip to content

Instantly share code, notes, and snippets.

@grayskripko
Created August 9, 2017 10:53
Show Gist options
  • Save grayskripko/fab4ff079bbbc45e865bab94c6a0db06 to your computer and use it in GitHub Desktop.
Save grayskripko/fab4ff079bbbc45e865bab94c6a0db06 to your computer and use it in GitHub Desktop.
Ignoring columns
# please note, the first 2 tests are on the same data!
> devtools::test(filter='Ignor')
Loading stackatto
Testing stackatto
>> Ignoring columns:
dataset [Ionosphere], target [V26], by_col [], n_cells [12K], seed [9171]
layer1 models: [ kknn svmLinear svmRadial glm glmnet rf ranger catboost lgbm xgb ]
Ignored: [ V30 V16 ]
model time memory mse R2
1: stacking_xgb_ignor 21.0 7.06 MB 0.149 0.388
2: stacking_xgb_ignor 23.6 6.94 MB 0.151 0.377
3: stacking_xgb_full 22.0 7.15 MB 0.170 0.299
4: stacking_xgb_full 20.6 7.08 MB 0.173 0.286
5: mean_dummy 0.0 0 0.243 0.000
.
DONE ====================================================================
> devtools::test(filter='Ignor')
Loading stackatto
Testing stackatto
>> Ignoring columns:
dataset [Ionosphere], target [V26], by_col [], n_cells [12K], seed [9171]
layer1 models: [ kknn svmLinear svmRadial glm glmnet rf ranger catboost lgbm xgb ]
Ignored: [ V30 V16 ]
model time memory mse R2
1: stacking_xgb_ignor 19.8 7.06 MB 0.147 0.396
2: stacking_xgb_ignor 21.5 6.94 MB 0.166 0.318
3: stacking_xgb_full 21.1 7.15 MB 0.171 0.296
4: stacking_xgb_full 22.4 7.08 MB 0.174 0.285
5: mean_dummy 0.0 0 0.243 0.000
.
DONE ====================================================================
> devtools::test(filter='Ignor')
Loading stackatto
Testing stackatto
>> Ignoring columns:
dataset [Vowel], target [V4], by_col [], n_cells [11K], seed [3328]
layer1 models: [ kknn svmLinear svmRadial glm glmnet rf ranger catboost lgbm xgb ]
Ignored: [ V6 V10 ]
model time memory mse R2
1: stacking_xgb_full 21.5 15.3 MB 0.030 0.946
2: stacking_xgb_full 21.0 15.2 MB 0.031 0.944
3: stacking_xgb_ignor 21.5 14.9 MB 0.046 0.917
4: stacking_xgb_ignor 21.2 14.9 MB 0.047 0.917
5: mean_dummy 0.0 0 0.560 0.000
.
DONE ====================================================================
> devtools::test(filter='Ignor')
Loading stackatto
Testing stackatto
>> Ignoring columns:
dataset [Sonar], target [Class], by_col [], n_cells [13K], seed [839]
layer1 models: [ knn kknn svmLinear svmRadial glm glmnet rf ranger lgbm xgb ]
Ignored: [ V17 V12 ]
model time memory logLoss R2
1: stacking_xgb_full 22.5 3.73 MB 0.250 0.637
2: stacking_xgb_ignor 22.2 3.84 MB 0.263 0.620
3: stacking_xgb_full 22.1 3.79 MB 0.296 0.571
4: stacking_xgb_ignor 23.2 3.75 MB 0.319 0.538
5: mean_dummy 0.0 0 0.690 0.000
.
DONE ====================================================================
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment