Releases: LudvigOlsen/cvms
cvms 1.3.5
- Fixes tests for CRAN.
cvms 1.3.4
- Fixes tests for CRAN.
- Adds merDeriv as suggested package.
cvms 1.3.3
- Prepares for
parameters 0.15.0
. Thanks to @strengejacke.
cvms 1.3.2
- Prepares package for checkmate 2.1.0.
cvms 1.3.1
- Replaces deprecated uses of ggplot2 functions. Now compatible with ggplot2 3.3.4.
cvms 1.3.0
-
In order to reduce dependencies, model coefficients are now tidied with the
parameters
package instead ofbroom
andbroom.mixed
. Thanks to @IndrajeetPatil for the contributions. -
In
cross_validate()
andcross_validate_fn()
, fold columns can now have a varying number of folds in repeated cross-validation. Struggling to choose a number of folds? Average over multiple settings. -
In the
Class Level Results
in multinomial evaluations, the nestedConfusion Matrix
andResults
tibbles are now named with their class to ease extraction and further work with these tibbles. TheResults
tibble further gets aClass
column. This information might be redundant, but could make life easier. -
Adds vignette:
Multiple-k: Picking the number of folds for cross-validation
.
cvms 1.2.1
- Fixes bug in
plot_confusion_matrix()
, where tiles with a count > 0 but a rounded percentage of 0 did not have the percentage text. Only tiles with a count of 0 should now be without text.
cvms 1.2.0
Breaking
-
Breaking change: In
plot_confusion_matrix()
, thetargets_col
andpredictions_col
arguments have been renamed totarget_col
andprediction_col
to be consistent withevaluate()
. -
Breaking change: In
evaluate_residuals()
, thetargets_col
andpredictions_col
arguments have been renamed totarget_col
andprediction_col
to be consistent withevaluate()
. -
Breaking change: In
process_info_gaussian/binomial/multinomial()
, thetargets_col
argument have been renamed totarget_col
to be consistent withevaluate()
. -
In
binomial
most_challenging()
, the probabilities are now properly of the second class alphabetically.
Additions
-
In
plot_confusion_matrix()
, adds argumentclass_order
for manually setting the order of the classes
in the facets. -
In
plot_confusion_matrix()
, tiles with a count of0
no longer has text in the tile by default.
This adds therm_zero_percentages
(for column/row percentage) andrm_zero_text
(for counts and normalized) arguments. -
In
plot_confusion_matrix()
, adds optional sum tiles. Enabling this (add_sums = TRUE
) adds an extra column and
an extra row with the sums. The corner tile contains the total count. This adds theadd_sums
andsums_settings
arguments. Asum_tile_settings()
function has been added to control the appearance of these tiles. Thanks to @MaraAlexeev for the idea. -
In
plot_confusion_matrix()
, adds option (intensity_by
) to set the color intensity of the tiles to the overall percentages (normalized
).
cvms 1.1.0
-
In
plot_confusion_matrix()
, adds option to only have row and column percentages in the diagonal tiles. Thanks to @xgirouxb for the idea. -
Adds
Process
information to output with the settings used. Adds transparency. It has a custom print method, making it easy to read. Underneath it is a list, why all information is available using$
or similar. In most cases, theFamily
information has been moved into theProcess
object. Thanks to @daviddalpiaz for notifying me of the need for more transparency. -
In outputs, the
Family
information is (in most cases) moved into the newProcess
object. -
In
binomial
evaluate()
andbaseline()
,Accuracy
is now enabled by default. It is still disabled incross_validate*()
functions to guide users away from using it as the main criterion for model selection (as it is well known to many but can be quite bad in cases with imbalanced datasets.) -
Fixes: In binomial evaluation, the probabilities are now properly of the second class alphabetically.
When the target column was a factor where the levels were not in alphabetical order, the second level in that order was used. The levels are now sorted before extraction. Thanks to @daviddalpiaz for finding the bug. -
Fixes: In grouped multinomial evaluation, when predictions are classes and there are different sets of classes per group, only the classes in the subset are used.
-
Fixes: Bug in
ROC
direction parameter being set wrong whenpositive
is numeric. In regression tests, theAUC
scores were not impacted. -
Fixes: 2-class
multinomial
evaluation returns all expected metrics. -
In multinomial evaluation, the
Class Level Results
are sorted by theClass
. -
Imports
broom.mixed
to allow tidying of coefficients fromlme4::lmer
models. -
Exports
process_info_binomial()
,process_info_multinomial()
,process_info_gaussian()
constructors to ensure the various methods are available. They are not necessarily intended for external use.
cvms 1.0.2
- Compatibility with
dplyr
version1.0.0
. NOTE: this version ofdplyr
slows down some functions incvms
significantly, why it might be beneficial not to update before version1.1.0
, which is supposed to tackle this problem.