Plant disease classification is essential to the agriculture industry. In this work, a tomato disease classification using Extreme Learning Machine (ELM) with image-based features. Extreme Learning Machine (ELM), a classification algorithm with a single layer feed-forward neural network where it can be combined with few activation functions. The image features as the input where the image is pre-processed via HSV colour space and extracted using Haralick textures, colour moments and HSV histogram. The features are then loaded in the ELM classifier to perform the ELM training and testing. The accuracy result of ELM classification is then analysed after the validation. The dataset used for disease detection is tomato plant leaves which is a subset of the Plant-Village dataset. The results produced from the ELM demonstrate an accuracy of around 84.94% which is comparable to classifiers such as the Support Vector Machine and Decision Tree.