ABCDEFGHIJKLMNOPQRSTUVWXYZ Definition of Least Squares Regression more ... A way of finding a "line of best fit" by making the total of the square of the errors as small as possible, which is why it is called "least squares". Least Squares Regression