Hypothesis testing is a formal procedure of testing your ideas about the world using statistics.
Null hypothesis ($H_0$) and Alternate hypothesis ($H_1$)
Low within group variance & high between group variance : low p-value
Does independent variable affect dependent variable?
The significance level, or alpha (α), is a value that the researcher sets in advance as the threshold for statistical significance. It is the maximum risk of making a false positive conclusion (Type I error) that you are willing to accept.
APA guidelines advise reporting not only p values but also effect sizes and confidence intervals wherever possible to show the real world implications of a research outcome.
In statistics, a Type I error is a false positive conclusion, while a Type II error is a false negative conclusion.
| [Hypothesis Testing | A Step-by-Step Guide with Easy Examples](https://www.scribbr.com/statistics/hypothesis-testing/) |
Statistical Significance in A/B testing (Calculation and the Math Behind it)
A/B-Test Calculator - Power & Significance - ABTestGuide.com
What is Effect Size and Why Does It Matter? (Examples)
| [Understanding Confidence Intervals | Easy Examples & Formulas](http://scribbr.com/statistics/confidence-interval/) |
| [Choosing the Right Statistical Test | Types & Examples](https://www.scribbr.com/statistics/statistical-tests/) |