The SUMO toolbox
2018a

This measure uses a set of validation samples, not used for construction of the model, to estimate the accuracy of the model. More...
Public Member Functions  
function  ValidationSet (var varargin) 
Class constructor. More...  
function  calculateMeasure (var model, var context, var outputIndex) 
Calculates the measure. More...  
function  calculateValidationSet (var samples) 
Creates a validation set from the full set of training samples. More...  
function  setErrorFcn (var efun) 
Sets the error function to use. More...  
function  getErrorFcn () 
Returns the used error function. More...  
function  getFinalTarget () 
Returns the target (goal) accuracy. More...  
function  getParallelMode () 
Returns whether we are using parallel computing. More...  
function  getWeight () 
Returns vector of weights. More...  
function  isEnabled () 
Returns whether this measures is being used. More...  
function  getTarget () 
Returns the target (goal) accuracy. More...  
function  processMeasure (var model, var context, var outputIndex) 
Wrapper that calls calculateMeasure. More...  
This measure uses a set of validation samples, not used for construction of the model, to estimate the accuracy of the model.
There are two sources for this set of validation samples:
This measure is very useful for validation purposes.

inline 
Class constructor.
function calculateMeasure  (  var  model, 
var  context,  
var  outputIndex  
) 
Calculates the measure.
Splits the list of samples in a set of validation samples and a set of training samples.
model  surrogate model 
context  struct of contextual information (optional) 
outputIndex  for which output to calculate the measure 
newModel  updated surrogate model (may happen in some measures) 
score  score of the surrogate model 
Then a new model is constructed using the training samples, and the accuracy of this model is validationed using the validation samples. When an external dataset is provided, the entire list of samples is used for training and the model is evaluated against the dataset. The model that was constructed is returned, so that submeasures can act on this model.
function calculateValidationSet  (  var  samples  ) 
Creates a validation set from the full set of training samples.
samples  training set 

inlineinherited 
Returns the used error function.

inlineinherited 
Returns the target (goal) accuracy.

inlineinherited 
Returns whether we are using parallel computing.

inlineinherited 
Returns the target (goal) accuracy.

inlineinherited 
Returns vector of weights.

inlineinherited 
Returns whether this measures is being used.

inherited 
Wrapper that calls calculateMeasure.
This function calls calculateMeasure and replaces NaN/Inf Values.
model  surrogate model 
context  struct of contextual information (optional) 
outputIndex  for which output to calculate the measure 
score  score of the surrogate model 

inlineinherited 
Sets the error function to use.