Output Files

OUTPUT FILE

• "XXX.pred"
  Currently, it is ordered by KC, student (and preserving the record order within a KC-student), which may not be the same as the original ordering in test set (unless you just have one HMM in test set). The columns actualLabel,predLabel,predProb,probKnow,student,kc are:

  • actual student responses(correct or incorrect)
  • predicted student responses
  • predicted probability of getting correct responses
  • predicted probability of known/mastered (before updating by current observed correctness)
  • student
  • KC

• "XXX.eval":

  • modelName.eval: modelName is specified by your configuration file. This file contains a row of evaluation metrics for each fold(run), and the last row corresponds to the average evaluation metrics across different folds(runs).
  • all-models-evaluation-metrics.eval: compares only the average evaluation metrics of across different folds(runs) for each model;

• evaluation.log: This file maintains the log of each time's evaluation results.

• finalHmmParameters.txt: This file maintains the HMM parameters. Caution: known(mastered) state doesn't neccessarily correspond to 1.

• finalFeatureWeights.txt: This file contains the feature values for guess and slip probabilities. Caution: known(mastered) state doesn't neccessarily correspond to hidden1.

• main.log: This file contains the basic information of running FAST (configuration, log likelihood changes, etc.).