Research Output
Imbalanced data classification using SVM based on simulated annealing featuring synthetic data generation and reduction
Face Recognition System Based on Fusion Features of Local Methods Using CCA
1 - 2 of 2
Publication
Imbalanced data classification is one of the major problems in machine learning. This imbalanced dataset typically has significant differences in the number of data samples between its classes. In most cases, the performance of the machine learning algorithm such as Support Vector Machine (SVM) is affected when dealing with an imbalanced dataset. The classification accuracy is mostly skewed toward the majority class and poor results are exhibited in the prediction of minority-class samples. In this paper, a hybrid approach combining data pre-processing technique and SVM algorithm based on improved Simulated Annealing (SA) was proposed. Firstly, the data pre-processing technique which primarily aims at solving the resampling strategy of handling imbalanced datasets was proposed. In this technique, the data were first synthetically generated to equalize the number of samples between classes and followed by a reduction step to remove redundancy and duplicated data. Next is the training of a balanced dataset using SVM. Since this algorithm requires an iterative process to search for the best penalty parameter during training, an improved SA algorithm was proposed for this task. In this proposed improvement, a new acceptance criterion for the solution to be accepted in the SA algorithm was introduced to enhance the accuracy of the optimization process. Experimental works based on ten publicly available imbalanced datasets have demonstrated higher accuracy in the classification tasks using the proposed approach in comparison with the conventional implementation of SVM. Registering at an average of 89.65% of accuracy for the binary class classification has demonstrated the good performance of the proposed works.
Publication
Information fusion is a solution espoused for enhancing a pattern recognition system's performance. A single representation précises the information and presents a single cue on the data; thus, information fusion is said to be more prolific as every feature set depicts a different outlook on the actual dataset. This paper recommends a face recognition system by utilizing fusion features of two local descriptor approaches. Firstly, blending of two most effective local face features, namely Gabor transform features and Local Binary Pattern (LBP), renders significantly improved performance compared to either individually: they complement each other wherein small appearance details are captured by LBP, while Gabor includes encoding facial shape for a wider range of scales. Secondly, to the combined feature vector, applying of the Canonical Correlation Analysis method (CCA) is done in order to extract discriminant characteristics for recognition. Lastly, a support vector machine (SVM) is deployed for classification, and K-nearest neighbor (K-NN) is utilized for feature matching. The technique is assessed against many challenging face datasets such as Yale database, with encouraging outcomes.