Repeat the analysis for part (c) using the same cutoff threshold on model M2. Compare the F-measure results for both models. Which model is better? Are the results consistent with what you expect from the ROC curve?

You are asked to evaluate the performance of two classification models, M1

and M2. The test set you have chosen contains 26 binary attributes, labeled

as A through Z.

Table 5.5 shows the posterior probabilities obtained by applying the models to

the test set. (Only the posterior probabilities for the positive class are shown).

As this is a two-class problem, P(?)=1 ? P(+) and P(?|A, . . . , Z)=1 ?

P(+|A, . . . , Z). Assume that we are mostly interested in detecting instances

from the positive class.




When t = 0.5, the confusion matrix for M2 is shown below.



Precision = 1/2 = 50%.

Recall = 1/5 = 20%.

F-measure = (2 × .5 × .2)/(.5 + .2) = 0.2857.



Based on F-measure, M1 is still better than M2. This result is consis-

Computer Science & Information Technology

You might also like to view...

In a multiple-document interface (MDI), a JDesktopPane is the parent window and what class is the child window?

a. JChild. b. JInternalFrame. c. JChildWindow. d. JFrame.

Computer Science & Information Technology

Is it possible to write a for loop that does not execute when the program runs? A while loop? A do while loop?

What will be an ideal response?

Computer Science & Information Technology

To close the document without exiting Word, click the ____ tab, and then on the navigation bar, click the Close command.

A. File B. Home C. View D. Page Layout

Computer Science & Information Technology

Sle x ale = aro

Indicate whether the statement is true or false

Computer Science & Information Technology