Created
August 9, 2017 10:53
-
-
Save grayskripko/fab4ff079bbbc45e865bab94c6a0db06 to your computer and use it in GitHub Desktop.
Ignoring columns
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # please note, the first 2 tests are on the same data! | |
| > devtools::test(filter='Ignor') | |
| Loading stackatto | |
| Testing stackatto | |
| >> Ignoring columns: | |
| dataset [Ionosphere], target [V26], by_col [], n_cells [12K], seed [9171] | |
| layer1 models: [ kknn svmLinear svmRadial glm glmnet rf ranger catboost lgbm xgb ] | |
| Ignored: [ V30 V16 ] | |
| model time memory mse R2 | |
| 1: stacking_xgb_ignor 21.0 7.06 MB 0.149 0.388 | |
| 2: stacking_xgb_ignor 23.6 6.94 MB 0.151 0.377 | |
| 3: stacking_xgb_full 22.0 7.15 MB 0.170 0.299 | |
| 4: stacking_xgb_full 20.6 7.08 MB 0.173 0.286 | |
| 5: mean_dummy 0.0 0 0.243 0.000 | |
| . | |
| DONE ==================================================================== | |
| > devtools::test(filter='Ignor') | |
| Loading stackatto | |
| Testing stackatto | |
| >> Ignoring columns: | |
| dataset [Ionosphere], target [V26], by_col [], n_cells [12K], seed [9171] | |
| layer1 models: [ kknn svmLinear svmRadial glm glmnet rf ranger catboost lgbm xgb ] | |
| Ignored: [ V30 V16 ] | |
| model time memory mse R2 | |
| 1: stacking_xgb_ignor 19.8 7.06 MB 0.147 0.396 | |
| 2: stacking_xgb_ignor 21.5 6.94 MB 0.166 0.318 | |
| 3: stacking_xgb_full 21.1 7.15 MB 0.171 0.296 | |
| 4: stacking_xgb_full 22.4 7.08 MB 0.174 0.285 | |
| 5: mean_dummy 0.0 0 0.243 0.000 | |
| . | |
| DONE ==================================================================== | |
| > devtools::test(filter='Ignor') | |
| Loading stackatto | |
| Testing stackatto | |
| >> Ignoring columns: | |
| dataset [Vowel], target [V4], by_col [], n_cells [11K], seed [3328] | |
| layer1 models: [ kknn svmLinear svmRadial glm glmnet rf ranger catboost lgbm xgb ] | |
| Ignored: [ V6 V10 ] | |
| model time memory mse R2 | |
| 1: stacking_xgb_full 21.5 15.3 MB 0.030 0.946 | |
| 2: stacking_xgb_full 21.0 15.2 MB 0.031 0.944 | |
| 3: stacking_xgb_ignor 21.5 14.9 MB 0.046 0.917 | |
| 4: stacking_xgb_ignor 21.2 14.9 MB 0.047 0.917 | |
| 5: mean_dummy 0.0 0 0.560 0.000 | |
| . | |
| DONE ==================================================================== | |
| > devtools::test(filter='Ignor') | |
| Loading stackatto | |
| Testing stackatto | |
| >> Ignoring columns: | |
| dataset [Sonar], target [Class], by_col [], n_cells [13K], seed [839] | |
| layer1 models: [ knn kknn svmLinear svmRadial glm glmnet rf ranger lgbm xgb ] | |
| Ignored: [ V17 V12 ] | |
| model time memory logLoss R2 | |
| 1: stacking_xgb_full 22.5 3.73 MB 0.250 0.637 | |
| 2: stacking_xgb_ignor 22.2 3.84 MB 0.263 0.620 | |
| 3: stacking_xgb_full 22.1 3.79 MB 0.296 0.571 | |
| 4: stacking_xgb_ignor 23.2 3.75 MB 0.319 0.538 | |
| 5: mean_dummy 0.0 0 0.690 0.000 | |
| . | |
| DONE ==================================================================== |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment