next up previous contents
Next: State of the Art Up: No Title Previous: Possibility for Later Additions

Results

 

In this chapter the most important results from the tests performed are presented. A full description of these tests is given in Appendix gif. Some of the tests have been performed several times with different data sets, but the conclusions may still not be strictly statistically valid. Still, we believe the following results are correct:
Four Equally Good Methods: The three methods using voting and the weight of evidence measure method all are equally good. Even though they did not produce the same results in the tests, these four methods had about the same classification accuracy for the test sets, and seems to be just as good overall. The ``best rule'' method is significantly worse than these four methods, and is not recommended for use.

Since the exponential, linear and squared voting give almost the same results in all tests, the use could be restricted to the ordinary linear one.
Top Node Rules Most Important: The classification results were best overall when the rules from the top node was among the rules used. If these rules were the only rules used, no significant worse classification resulted.
The Methods Performed Differently on Subsets of Rules: The weight of evidence measure method was better than voting when applied to rules from the bottom nodes of the lattice. At the top of the lattice there were no real differences.
Noise has Some Impact: The classification is degraded when some degree of noise is added to the system, but not very much. The systems ability to handle noise seems satisfactory.
Learning Time Considerable: The time it takes to create rules with RGEN is considerable when compared to the time it takes to use these rules in RCLASS on a training set of the same size.



Helge Grenager Solheim
Sat May 4 03:30:02 MET DST 1996