Machine learning is traditionally considered as a single objective optimization problem. That is, a learner iteratively improves performances through optimizing one single objective function. However, many machine-learning tasks need to simultaneously optimize multiple objective functions. For example, ensemble learning need to find a set of accurate but diverse base learners, and it is desirable for the feature selection task to extract a small number of representative features. As a consequence, there is a surge of multiobjective machine learning in recent years. That is, a machine-learning task is considered as the multiobjective optimization problem (MOP). Moreover, evolutionary algorithms are usually employed to optimize it, since evolutionary algorithms have shown their superiority for MOPs. In this chapter, we will introduce our recent work in multilabel learning with multiobjective optimization. As an important supervised learning task, multilabel learning refers to the task of predicting potentially multiple labels for a given instance. Conventional multilabel learning approaches focus on a single objective setting, and there is a basic assumption that the optimization over one single objective can improve the overall performance of multilabel learning. However, in many real applications, an optimal multilabel learner may need to consider the trade-offs among multiple objectives. In this chapter, we will present two works in evolutionary multiobjective optimization for multilabel learning. In the first work, we directly optimize multiobjective functions based the multiobjective optimization framework; in the second work, we generate a set of accurate but diverse multilabel learners with the ensemble learning framework.

Chapter Contents:

• Abstract
• 8.1 Multiobjective multilabel classification
• 8.1.1 Overview
• 8.1.2 Related work
• 8.1.3 Problem definition
• 8.1.4 The MOML algorithm
• 8.1.4.1 Model training
• 8.1.4.2 Model selection
• 8.1.5 Experiments
• 8.1.5.1 Experimental setup
• 8.1.5.2 Performance comparison
• 8.1.5.3 Influence of the number of objectives
• 8.2 Multilabel ensemble learning
• 8.2.1 Overview
• 8.2.2 The EnML method
• 8.2.2.1 Measure criteria
• 8.2.2.2 Optimization process and algorithm framework
• 8.2.3 Experiments
• 8.2.3.1 Experimental setup
• 8.2.3.2 Performance comparison
• 8.3 Conclusion
• References

Inspec keywords: Pareto optimisation; optimisation; learning (artificial intelligence); evolutionary computation

Other keywords: important supervised learning task; conventional multilabel learning; evolutionary multiobjective optimization; ensemble learning framework; single objective optimization problem; single objective setting; optimal multilabel learner; multiple objective functions; accurate but diverse multilabel learners; machine-learning task; single objective function; feature selection task; multiobjective optimization framework; multiobjective optimization problem; multiobjective machine learning; evolutionary algorithms

Subjects: Optimisation techniques; Other topics in statistics; Optimisation techniques; Knowledge engineering techniques