Interview Prep
Career
GenAI
Prompt Engg
ChatGPT
LLM
Langchain
RAG
AI Agents
Machine Learning
Deep Learning
GenAI Tools
LLMOps
Python
NLP
SQL
AIML Projects

Reading list

Machine Learning Basics for a Newbie
6 Steps of Machine learning Lifecycle Introduction to Predictive Modeling
Introduction to Exploratory Data Analysis & Data Insights Descriptive Statistics Inferential Statistics How to Understand Population Distributions?
Reading Data Files into Python Different Variable Datatypes
Probability for Data Science Basic Concepts of Probability Axioms of Probability Conditional Probability
Central Tendencies for Continuous Variables Spread of Data KDE plots for Continuous Variable Overview of Distribution for Continuous variables Normal Distribution Skewed Distribution Skeweness and Kurtosis Distribution for Continuous Variable
Central Tendencies for Categorical Variables Understanding Discrete Distributions Performing EDA on Categorical Variables
Dealing with Missing Values Understanding Outliers Identifying Outliers in Data Outlier Detection in Python Outliers Detection Using IQR, Z-score, LOF and DBSCAN
Sample and Population Central Limit Theorem Confidence Interval and Margin of Error
Bivariate Analysis Introduction
Covariance Pearson Correlation Spearman's Correlation & Kendall's Tau Correlation versus Causation Tabular and Graphical methods for Bivariate Analysis Performing Bivariate Analysis on Continuous-Continuous Variables
Tabular and Graphical methods for Continuous-Categorical Variables Introduction to Hypothesis Testing P-value Two sample Z-test T-test T-test vs Z-test Performing Bivariate Analysis on Continuous-Catagorical variables
Chi-Squares Test Bivariate Analysis on Categorical Categorical Variables
Multivariate Analysis A Comprehensive Guide to Data Exploration The Data Science behind IPL
Supervised Learning vs Unsupervised Learning Reinforcement Learning Generative and Descriminative Models Parametric and Non Parametric model
Machine Learning Pipeline Preparing Dataset Build a Benchmark Model: Regression Build a Benchmark Model: Classification
Evaluation Metrics for Machine Learning Everyone should know Confusion Matrix Accuracy Precision and Recall AUC-ROC Log Loss R2 and Adjusted R2
Dealing with Missing Values Replacing Missing Values Imputing Missing Values in Data Working with Categorical Variables Working with Outliers Preprocessing Data for Model Building
Understanding Cost Function Understanding Gradient Descent Math Behind Gradient Descent Assumptions of Linear Regression Implement Linear Regression from Scratch Train Linear Regression in Python Implementing Linear Regression in R Diagnosing Residual Plots in Linear Regression Models Generalized Linear Models Introduction to Logistic Regression Odds Ratio Implementing Logistic Regression from Scratch Introduction to Scikit-learn in Python Train Logistic Regression in python Multiclass using Logistic Regression How to use Multinomial and Ordinal Logistic Regression in R ? Challenges with Linear Regression Introduction to Regularisation Implementing Regularisation Ridge Regression Lasso Regression
Introduction to K Nearest Neighbours Determining the Right Value of K in KNN Implement KNN from Scratch Implement KNN in Python
Bias Variance Tradeoff Introduction to Overfitting and Underfitting Visualizing Overfitting and Underfitting Selecting the Right Model What is Validation? Hold-Out Validation Understanding K Fold Cross Validation
Introduction to Feature Selection Feature Selection Algorithms Missing Value Ratio Low Variance Filter High Correlation Filter Backward Feature Elimination Forward Feature Selection Implement Feature Selection in Python Implement Feature Selection in R
Introduction to Decision Tree Purity in Decision Tree Terminologies Related to Decision Tree How to Select Best Split Point in Decision Tree? Chi-Squares Information Gain Reduction in Variance Optimizing Performance of Decision Tree Train Decision Tree using Scikit Learn Pruning of Decision Trees
Introduction to Feature Engineering Feature Transformation Feature Scaling Feature Engineering Frequency Encoding Automated Feature Engineering: Feature Tools
Introduction to Naive Bayes Conditional Probability and Bayes Theorem Introduction to Bayesian Adjustment Rating: The Incredible Concept Behind Online Ratings! Working of Naive Bayes Math behind Naive Bayes Types of Naive Bayes Implementation of Naive Bayes
Understanding how to solve Multiclass and Multilabled Classification Problem Evaluation Metrics: Multi Class Classification
Introduction to Ensemble Techniques Basic Ensemble Techniques Implementing Basic Ensemble Techniques Finding Optimal Weights of Ensemble Learner using Neural Network Why Ensemble Models Work well?
Introduction to Stacking Implementing Stacking Variants of Stacking Implementing Variants of Stacking Introduction to Blending Bootstrap Sampling Introduction to Random Sampling Hyper-parameters of Random Forest Implementing Random Forest Out-of-Bag (OOB) Score in the Random Forest IPL Team Win Prediction Project Using Machine Learning Introduction to Boosting Gradient Boosting Algorithm Math behind GBM Implementing GBM in python Regularized Greedy Forests Extreme Gradient Boosting Implementing XGBM in python Tuning Hyperparameters of XGBoost in Python Implement XGBM in R/H2O Adaptive Boosting Implementing Adaptive Boosing LightGBM Implementing LightGBM in Python Catboost Implementing Catboost in Python
Different Hyperparameter Tuning methods Implementing Different Hyperparameter Tuning methods GridsearchCV RandomizedsearchCV Bayesian Optimization for Hyperparameter Tuning Hyperopt
Understanding SVM Algorithm SVM Kernels In-depth Intuition and Practical Implementation SVM Kernel Tricks Kernels and Hyperparameters in SVM Implementing SVM from Scratch in Python and R
Introduction to Principal Component Analysis Steps to Perform Principal Compound Analysis Computation of Covariance Matrix Finding Eigenvectors and Eigenvalues Implementing PCA in python Visualizing PCA A Brief Introduction to Linear Discriminant Analysis Introduction to Factor Analysis
Introduction to Clustering Applications of Clustering Evaluation Metrics for Clustering Understanding K-Means Implementation of K-Means in Python Implementation of K-Means in R Choosing Right Value for K Profiling Market Segments using K-Means Clustering Hierarchical Clustering Implementation of Hierarchial Clustering DBSCAN Defining Similarity between clusters Build Better and Accurate Clusters with Gaussian Mixture Models
Understand Basics of Recommendation Engine with Case Study
8 Ways to Improve Accuracy of Machine Learning Models
Introduction to Dask Working with CuML
Introduction to Machine Learning Interpretability Framework and Interpretable Models model Agnostic Methods for Interpretability Implementing Interpretable Model Understanding SHAP Out-of-Core ML Introduction to Interpretable Machine Learning Models Model Agnostic Methods for Interpretability Game Theory & Shapley Values
Introduction to Machine Learning Interpretability Framework and Interpretable Models model Agnostic Methods for Interpretability Implementing Interpretable Model Understanding SHAP Out-of-Core ML Introduction to Interpretable Machine Learning Models Model Agnostic Methods for Interpretability Game Theory & Shapley Values
Introduction to AutoML Implementation of MLBox Introduction to PyCaret TPOT Auto-Sklearn EvalML
Pickle and Joblib Introduction to Model Deployment
Deploying Machine Learning Model using Streamlit Deploying ML Models in Docker Deploy Using Streamlit Deploy on Heroku Deploy Using Netlify Introduction to Amazon Sagemaker Setting up Amazon SageMaker Using SageMaker Endpoint to Generate Inference Deploy on Microsoft Azure Cloud Introduction to Flask for Model Deploying ML model using Flask
Model Deployment in Android Model Deployment in Iphone

Hypothesis Testing in Inferential Statistics

M
Monica seles Last Updated : 23 Jun, 2022
7 min read

This article was published as a part of the Data Science Blogathon.

Introduction

Hypothesis testing is one of the most important techniques applied in various fields such as statistics, economics, pharmaceutical, mining and manufacturing industries. Suppose we want to know if something took place if certain medicines are effective, if groups differ from each other or if one variable predicts another variable.

Hypothesis Testing

     Source: ety.com

All in all, we want to predict if the data collected is statistically significantly different from another. This article is for anyone who wants to know and understand the concept of hypothesis testing, which is a significant component of inferential statistics. The 5 steps taken to conduct the hypothesis testing have been explained in detail.

Alright, let’s begin!

What is Hypothesis Testing?

Hypothesis Testing is an inferential statistical method that is required to use sample data to solve assumptions about a population parameter (a characteristic that describes a population).

Inferential Statistics Definition

I want to define inferential statistics as the main reason we study statistics to make inferences about our population of interest using sample data. Hence, inferential statistics is a branch of statistics that refers to the probability that the sample data can represent the population data from which the sample was obtained. In other words, it’s like saying what can we conclude about the population based on what we know about the sample. For instance, if you wanted to know the average salary of a domestic worker, if covid has less impact on people who take vitamin C if a manufacturer produces the same quantity of 50 litres of milk and many other examples where inferential statistics is applicable.

5 Steps taken to Conduct a Hypothesis Testing

The following is a graphical representation of the steps to conduct hypothesis testing.

Steps for Hypothesis Testing

Step 1: Select the appropriate Statistics

The test is chosen based on whether you are looking for relationships or differences between groups and whether the assumptions for a particular test have been satisfied. However, this step involves exploratory data analysis, which helps us choose the test to conduct the hypothesis.

° Looking for Differences between groups. Hypothesis tests that can be used are as follows:

✓ The independent sample t-test is a parametric procedure or test used to compare two independent samples where the mean from one group has no effect on the mean from the other group.

✓ In other terms, it tests whether or not the sample means are statistically significantly different from each other. For example, measuring women’s weight from one group will not affect the importance of men from another group.

 

✓ The dependent sample t-test is a parametric procedure or test, also referred to as the matched paired sample t-test, related sample t-test and repeated measures t-test.

✓ It is used to compare means between two related samples; in short, it tests whether the average difference between means is different from zero. For instance, before and after experimental designs, matched pairs and pre-test and post-tests experiments use the dependent sample t-test.

✓ The One-Sample t-test is a parametric procedure or test that allows us to compare a sample mean to a known population mean provided the population standard deviation is unknown and checks if the means are statistically significantly different.

✓ The Mann-Whitney U test is a non-parametric test that corresponds to the independent sample t-test.

✓ It is categorised under the group of ranked sum tests. It is used to measure two independent samples that have been calculated on an ordinal level and follow a ranked order.

√ The Wilcoxon signed-rank test is a non-parametric procedure or test that corresponds to the one-sample t-test and can be used to test if the sample median is statistically significantly different from the hypothesised population median value.

✓ It is a non-parametric procedure or test corresponding to the dependent sample t-test.

✓ It measures whether there is a difference between two related/dependent/matched samples that have been calculated on an ordinal level and follow a ranked order.

Hypothesis Testing

✓ The Friedman test is a non-parametric procedure or test that corresponds to the repeated measures ANOVA.

✓ It is used to measure whether or not there is a statistically significant difference between medians of three groups and the same subjects or scores show up in the same groups or classes.

✓ It is a non-parametric procedure or test corresponding to the one-way ANOVA.

✓ It is used to measure whether or not there is a statistically significant difference between medians of three independent groups.

✓ The repeated measures ANOVA is a parametric procedure or test that measures whether or not the means of three or more dependent variables are statistically significantly different from the other.

Hypothesis Testing

✓ The one-way ANOVA is a parametric procedure or test that measures whether or not the means of three independent groups are statistically significantly different from the other.

° Looking for relationships between groups. Hypothesis tests that can be made used are as follows:

Hypothesis Testing

✓ Simple Linear Regression is a parametric procedure or test that uses the general linear model to analyse the relationship between the independent and dependent variables, measured on a scale level or are continuous.

✓  Simple Linear Regression uses the independent variable, which is on the x-axis, to predict a dependent variable on the y-axis. For us, for instance, predict the crime rate from an increase in population.

✓ The relationship between the variables is described mathematically by the equation of a straight line: Y=AX+B,

where Y is the y-intercept and represents a constant value of y when x =0, A represents a constant value of y when x=0, B represents the slope of the straight line. X represents the value used for prediction.

Hypothesis Testing

✓ The Pearson correlation coefficient is a parametric procedure or test that measures the strength of association (relationship) between two quantitative variables.

✓ It ranges from -1 to 1. -1 indicates a perfect positive linear association between the independent and dependent variable; meanwhile, -1 indicates a perfect negative linear association between the independent and dependent variable.

Hypothesis Testing

✓ The Spearman’s Rank Correlation coefficient is a non-parametric procedure or test corresponding to the Pearson correlation coefficient.

✓ It measures the strength, direction and relationship between two ordinal or ordered variables.

✓ It also ranges from a negative one to a positive one.

✓ The Chi-Square test is a non-parametric procedure or test that can be used to determine if there is a relationship between two qualitative variables.

✓ For example, suppose we want to determine if there is a relationship between gender (male or female)  and the highest educational level. We can apply the Chi-Square test.

Step 2: State the Null and Alternative hypothesis

In hypothesis testing, two hypotheses are:

✓Null hypothesis, which states that no difference between means and any differences would have occurred due to chance or randomness, is denoted by Ho.

✓ Alternative hypothesis states that one group mean will be statistically significantly different from the other and is denoted by Ha or H1.

Hypothesis Testing

Research by design

Step 3: Select a Level of Significance

This step requires us to state whether the test is one-tailed or two-tailed. We then select a level of Significance, also known as the alpha level, which will help us in setting a critical value, and the most commonly used alpha level is 0.05

Level of significance | Hypothesis Testing

source: statistics made easy

Step 4: Calculate the test statistic

Here, the test statistic is calculated either by hand where the test value is found using a specific formula for a particular test and is compared to the critical value from a student statistics table or using software like R, python, Spss, excel, datatab, etc. here the software calculates the test statistic and then computes a probability value P. If P is less than the alpha level, then the null hypothesis is rejected.

Step 5: Make a decision

Here the decision is based on the following rules

✓ If the calculated test statistic exceeds the critical value, then the test is significant: the null hypothesis is rejected, implying that the test is statistically significantly different.

✓ If the calculated test statistic is less than the critical value, then the test is not Significant: we fail to reject the null hypothesis implying that the test is not statistically significantly different.

Decision | Hypothesis Testing

Research by design

Conclusion

In this article, I have discussed the concept of hypothesis testing, a branch of inferential statistics, followed by the definition of inferential statistics. Furthermore, I have explained the 5 steps taken to conduct a hypothesis testing that is :

•Step one: select the appropriate Statistics

•Step two: state the null and alternative hypothesis

•Step three: select a Level of Significance

•Step four: calculate the statistics

•Step five: make a decision

You can reach out to me via email: [email protected]

The media shown in this article is not owned by Analytics Vidhya and is used at the Author’s discretion.

M
Monica seles

Free Courses

Generative AI 4.7

Generative AI - A Way of Life

Explore Generative AI for beginners: create text and images, use top AI tools, learn practical skills, and ethics.
Large Language Models 4.5

Getting Started with Large Language Models

Master Large Language Models (LLMs) with this course, offering clear guidance in NLP and model training made simple.
Prompt Engineering 4.6

Building LLM Applications using Prompt Engineering

This free course guides you on building LLM apps, mastering prompt engineering, and developing chatbots with enterprise data.
LlamaIndex 4.8

Improving Real World RAG Systems: Key Challenges & Practical Solutions

Explore practical solutions, advanced retrieval strategies, and agentic RAG systems to improve context, relevance, and accuracy in AI-driven applications.
RAG systems using LlamaIndex 4.7

Microsoft Excel: Formulas & Functions

Master MS Excel for data analysis with key formulas, functions, and LookUp tools in this comprehensive course.

Recommended Articles

Responses From Readers

Clear

Write for us

Write, captivate, and earn accolades and rewards for your work
  • Reach a Global Audience
  • Get Expert Feedback
  • Build Your Brand & Audience
  • Cash In on Your Knowledge
  • Join a Thriving Community
  • Level Up Your Data Science Game
imag

We use cookies essential for this site to function well. Please click to help us improve its usefulness with additional cookies. Learn about our use of cookies in our Privacy Policy & Cookies Policy.

Show details