Linear Regression Calculator – Least Squares & Trend Line

Linear regression is a fundamental statistical method used to model the relationship between two variables by fitting a linear equation to observed data. One variable is considered the independent variable (X), and the other is the dependent variable (Y). The goal is to find the best-fitting straight line — called the regression line or trend line — that describes how Y changes as X changes. This line can then be used for prediction and to understand the strength and direction of the relationship between the variables.

The Least Squares method finds the regression line by minimizing the sum of squared vertical distances (residuals) between each data point and the line. In other words, it selects the slope (b) and intercept (a) such that the total squared error — Σ(y_actual − y_predicted)² — is as small as possible. The formulas derived from calculus are:

Slope: b = Σ((x_i − x̄)(y_i − ȳ)) / Σ(x_i − x̄)²
Intercept: a = ȳ − b·x̄

This approach guarantees the "best fit" in the mathematical sense of minimizing squared errors, which is why it's the standard method for simple linear regression.

R², also called the coefficient of determination, measures how well the regression line fits the data. It ranges from 0 to 1 (or 0% to 100%) and represents the proportion of variance in the dependent variable (Y) that is predictable from the independent variable (X).

• R² = 1.0 → Perfect fit. All data points lie exactly on the regression line.
• R² > 0.8 → Strong fit. The model explains most of the variability in Y.
• R² 0.5–0.8 → Moderate fit. Some predictive power, but other factors likely influence Y.
• R² < 0.5 → Weak fit. The linear model may not be appropriate for this data.

A high R² does not necessarily mean the model is "good" — it's important to also check residual plots and ensure the linear regression assumptions are met.

The correlation coefficient (r) ranges from -1 to +1 and indicates both the strength and direction of the linear relationship:

• r > 0 → Positive correlation (as X increases, Y tends to increase)
• r < 0 → Negative correlation (as X increases, Y tends to decrease)
• r ≈ 0 → No linear correlation

R² is simply the square of r (for simple linear regression). It ranges from 0 to 1 and loses the direction information — it only tells you about the strength of fit. R² is often preferred for interpretation because it has a clear meaning: "the percentage of variation in Y explained by X."

For linear regression to be valid and reliable, several key assumptions should be checked:

1. Linearity: The relationship between X and Y should be approximately linear.
2. Independence: Observations should be independent of each other.
3. Homoscedasticity: The variance of residuals should be roughly constant across all values of X.
4. Normality: The residuals should be approximately normally distributed.
5. No extreme outliers: Outliers can heavily influence the regression line, especially with small datasets.

If these assumptions are violated, the regression results may be misleading. Always visualize your data (as this calculator does with the scatter plot) to spot potential issues.

Slope (b): The slope tells you how much Y changes, on average, for a one-unit increase in X. For example, if b = 2.5, then every time X increases by 1, Y increases by 2.5. A negative slope means Y decreases as X increases.

Intercept (a): The intercept is the predicted value of Y when X = 0. It's where the regression line crosses the Y-axis. In many real-world applications, the intercept may not have a practical interpretation (e.g., if X=0 is outside the observed data range), but it's mathematically necessary to define the line.

Technically, you need at least 2 data points to fit a straight line (two points uniquely determine a line). However, with only 2 points, R² will always equal 1.0, which is misleading. For meaningful inference:

• Minimum: 5–10 data points for a rough estimate
• Better: 20–30+ data points for reliable results
• Ideal: 50+ data points for stable estimates and valid statistical inference

More data points provide more precise estimates of the slope and intercept, reduce the impact of outliers, and allow for better assessment of model assumptions.