dc.contributor.author | Fieldsend, Jonathan E. | |
dc.contributor.author | Singh, Sameer | |
dc.date.accessioned | 2013-07-11T14:07:10Z | |
dc.date.issued | 2005-03-07 | |
dc.description.abstract | For the purposes of forecasting (or classification) tasks neural networks (NNs) are typically trained with respect to Euclidean distance minimization. This is commonly the case irrespective of any other end user preferences. In a number of situations, most notably time series forecasting, users may have other objectives in addition to Euclidean distance minimization. Recent studies in the NN domain have confronted this problem by propagating a linear sum of errors. However this approach implicitly assumes a priori knowledge of the error surface defined by the problem, which, typically, is not the case. This study constructs a novel methodology for implementing multiobjective optimization within the evolutionary neural network (ENN) domain. This methodology enables the parallel evolution of a population of ENN models which exhibit estimated Pareto optimality with respect to multiple error measures. A new method is derived from this framework, the Pareto evolutionary neural network (Pareto-ENN). The Pareto-ENN evolves a population of models that may be heterogeneous in their topologies inputs and degree of connectivity, and maintains a set of the Pareto optimal ENNs that it discovers. New generalization methods to deal with the unique properties of multiobjective error minimization that are not apparent in the uni-objective case are presented and compared on synthetic data, with a novel method based on bootstrapping of the training data shown to significantly improve generalization ability. Finally experimental evidence is presented in this study demonstrating the general application potential of the framework by generating populations of ENNs for forecasting 37 different international stock indexes. | en_GB |
dc.identifier.citation | Vol. 16 (2), pp. 338 - 354 | en_GB |
dc.identifier.doi | 10.1109/TNN.2004.841794 | |
dc.identifier.uri | http://hdl.handle.net/10871/11712 | |
dc.language.iso | en | en_GB |
dc.publisher | Institute of Electrical and Electronics Engineers (IEEE) | en_GB |
dc.subject | Pareto optimisation | en_GB |
dc.subject | Evolutionary computation | en_GB |
dc.subject | neural nets | en_GB |
dc.subject | time series | en_GB |
dc.subject | Euclidean distance minimization | en_GB |
dc.subject | Pareto evolutionary neural networks | en_GB |
dc.subject | multiobjective optimization | en_GB |
dc.subject | time series forecasting | en_GB |
dc.subject | Econometrics | en_GB |
dc.subject | Euclidean distance | en_GB |
dc.subject | Minimization methods | en_GB |
dc.subject | Network topology | en_GB |
dc.subject | Neural networks | en_GB |
dc.subject | Optimization methods | en_GB |
dc.subject | Predictive models | en_GB |
dc.subject | Time measurement | en_GB |
dc.subject | Training data | en_GB |
dc.title | Pareto Evolutionary Neural Networks | en_GB |
dc.type | Article | en_GB |
dc.date.available | 2013-07-11T14:07:10Z | |
dc.identifier.issn | 1045-9227 | |
dc.description | Copyright © 2005 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works. | en_GB |
dc.description | Notes: This paper introduces a novel method for the effective training and evaluation of artificial neural networks with many competing objectives, and demonstrates the superiority of this approach to previous work making use of only a single composite objective. Its publication led to invitations to write a number of book chapters in the area of multi-objective machine learning, as well invitations to join technical committees of conference sessions in the emergent area. Theory from it also fed in to three DTI-funded KTP projects (one with NATS and two with AI Corporation Ltd.) for which I am a ‘University Supervisor’. | en_GB |
dc.identifier.journal | IEEE Transactions on Neural Networks | en_GB |