Principal Component Analysis (PCA) - An Effective Tool in Machine Learning

Ledisi Giok Kabari


Abstract— Machine learning problems involves thousands or even millions of features of each training instance.  This makes training in machine learning very slow and much harder to find a good solution.  Ability to reduce the number features considerably without losing important information will significantly reduce the number of training data required to resolve tasks.   Principal component Analysis (PCA) is the most popular dimensionality reduction algorithm used in machine learning analyses the interrelationships among a large number of variables and to explain these variabilities in terms of a smaller number of variables, called principal components, with a minimum loss of information. In this paper Iris dataset which has 50 instances of 3 types of iris flower species (Iris-setosa, Iris-versicolor and Iris-virginica) with four features (sepal length, sepal width, petal length and petal width) was used to demonstrate PCA. The model was implemented using Anaconda python 3.6 distribution. From the results, PCA clearly classifies the data visually showing their differences.

Full Text:



A. Gron, Hands-on Machine Learning with Scikit-learn, Keras, and Tensorflow. [s.l.]: O'Reilly Media, 2018.

D. Speyer, Good PCA examples for teaching. [online]. Available at:

C. Zaiontz, Principal Component Analysis (PCA) | Real Statistics Using Excel. [online] Available at:

NCSS (2018). [online] Available at: .

]5] D. Marx, Is PCA considered a machine learning algorithm. [online] Data Science Stack Exchange. Available at:

J. Leskovec, Dimensionality reduction, PCA, SVD, MDS, ICA,

and friends. [online] Available at:

R. Fisher, Iris Data Set. [html] University of California, School of Information and Computer Science, UCI Machine Learning Repository [], 1988.



  • There are currently no refbacks.

© International Journals of Advanced Research in Computer Science and Software Engineering (IJARCSSE)| All Rights Reserved | Powered by Advance Academic Publisher.