This paper presents a pork quality evaluation method based on the hyperspectral image datasets of 96 pork samples in the range of 400–1000nm. First, through the K-medoids clustering algorithm based on manifold distance, 30 important wavelengths are selected from 753 wavelengths, and final 8 optimum wavelengths are obtained based on the discriminant value and the spectral resolution. Then, the two-dimensional Gabor wavelet transform is used to extract the eight texture features of the image under the final eight wavelengths respectively, to form a 64-dimensional features of pork quality. Finally, using the fussy C-means (FCM) algorithm based on Isomap dimension reduction, the pork quality evaluation model is constructed. The result of wavelength extraction experiments show that although there is a strong linear correlation between adjacent bands in the hyperspectral image, there is an obvious nonlinear manifold relation in the whole band. Therefore, the K-medoids clustering algorithm based on manifold distance in this paper is more reasonable than the traditional principal component analysis (PCA) in characteristic wavelength selection. According to the experiment of pork quality evaluation, two-dimensional Gabor wavelet transform can extract the texture characteristics of pork better. Compared with the FCM algorithm based on PCA, the FCM algorithm based on Isomap can better solve the high-dimensional clustering problem, and can distinguish fresh chilled meat, frozen-thawed meat and spoiled meat accurately. The study shows that hyperspectral image technology can be used in pork quality evaluation.