Skip to main content

Basic Hypotheses Testing

Hypothesis testing is one of the most interesting and important statistical tools useful in suggesting a decision or coming to a conclusion about an experiment. Where is it used? Its used in all kinds of fields ranging from scientific studies to economic analyses to business and so on. So what is this testing any way?

Skipping the theory which you will find in any books or Internet sites. I will try explaining from the point of view of a problem rather than a solution. That way, the understanding becomes more better - at least that is what I think. OK, so lets start it.

Lets suppose, one analytics purposed a marketing campaign that is going to increase the sales to 300 per months in each outlet. After the campaign was carried out the result was as follow:

Number of outlet surveyed (n) = 50
Average number of sales (X) = 295 
Standard Deviation (S.D) = 20

Now, how would you react to the analyst. Was he correct or was he wrong? Hmmm. That's funny, because his hypothesis was 300 but the average was 295 very close but not 300

So, there are two options, either he is correct or he is wrong. But, in statistics and in these kind of calculation, it is very difficult to prove either, therefore, we decide in terms of by how much percentage was he right and by how much percentage he was wrong. We call this the significance level.

There are many types of testing depending upon the characteristics of variable and the hypotheses. For example, checking the hypotheses of proportion, difference between means, goodness of fit etc.

So, do you get the problem. Its the testing of the hypothesis and giving a verdict. In the above example, the hypothesis looks very close but its significance level must be check to verify that the difference in the mean, is insignificance to prove the analyst was right.

Now, follow the following testing method.

1. State the Null and Alternative hypothesis

In this example our:
                      Null Hypothesis 
                                       u is equal to  300
                                       u is not equal to 300
  u is the hypothesised mean

      This is also known as two-tailed test.

2. Choose the significance level

Usually the significance level is chosen around 0.01, 0.05, 0.10. The lesser the value the      more less margin for errors.
Lets choose 0.05.

3. Choose the test method

There are many testing methods available in the theory. For this we chose the simple, one sample t-Test. It measures the difference in the observed and hypothesised mean value.

4. Run the test either manually or in software

Lets calculate:

Standard Error (S.E) = S.D / sqrt(n) = 2.83
DF (degree of freedom) =  n-1 = 49
t = (X-u) /S.E = 1.77 where X is the observed mean.

5. Calculate the P-Value

Now we calculate the P-value. You can use t-Distribution calculator or a table to find the P value. P-Value is the probability that the t-score having a degree of freedom is less than -1.77 and greater then1.77. This choice is due to the fact that we are doing two-tailed test.

P(t<-1.77) = 0.04 and P(t>1.77) = 0.04. 
Thus P value = 0.04 + 0.04 = 0.08

6. Interpret the result  

Since the P-value is greater than our significance level, we cannot reject the Null Hypothesis.

So the verdict is that the Analyst was correct within the significance of .08.

There are two kind of error that we can happen in this process. 

First, we conclude that hypothesis is right when it is wrong. 
Second , we conclude that hypothesis is wrong when it is right.

The above error has been named as I and II. 

Well, the above analysis was not mean to teach how to carry a hypothesis test but to clarify the point of carrying out the test in the very first place. 

All the other statistic test are used so that we have a quantitative view of the problem and make decision depending upon the empirical value, as this gives us more confidence in our decision. But, as always I say, we need to utilize more than just numbers but also intuition.

Lastly, what would it mean to test the hypotheses on zero level of confidence. It would mean that the value of observed mean must be exactly equal to the hypothesised value for the hypothesis to be correct and there is no other option. It is an qualitative analysis.
Hope it was helpful.


Popular posts from this blog

Selling a Comb to a Bald Person?

Here my friend, Ashay, put it very truly to me that the marketer's most challenge is to sell a comb to a bald. First, I am not trying to justify anything here. But I just couldn't help thinking how on earth am I going to sell a comb to a bald. How? Just how? I kept pondering upon it till late night. I actually had very few options with me, the first was obviously to use Google and Find? :) But, I didn't do that. Some how I was still in confusion. Then just before going to sleep, I had an discussion with my other friend, on types of marketing on issues related to customer centric marketing. Hmm. Then some how it hit me. I went back to basic on my own philosophy, sell things that is needed. So here is a small anecdote I prepared : Sale Person   : Hello sir. How are you? Do you have a time, plzzz? Bald Person : (Almost confused and in social causality) OK OK what is it? I don't have time. Sale Person    : Here sir, do you want to by a comb?  Bald Person  : Can't you

Fearful Consumer Market

Consumer market is something, I always feared. During my engineering days, I knew it was one area where I would not find myself working. I always feared the harsh competition of the market. I worried if ever, anything I made would sustain in the market. Or how people would react to it? You can say, I feared criticism and all the yap yap of group of people, who knows only how to suggest but not to act. Thus, I kept my interest into custom projects and not related to anything that a single consumer would use, rather it was something of community service. But with changing time, I knew I had to make a plunge into the ocean of consumer market and face the competition. "Be a man! Dude" That is what I would say to myself. I knew I couldn't swim, but I had to give it a try.  Journey into the consumer market is like that of 20000 Leagues Under The Sea . There are so many different kinds of creatures around to look and be fascinated. Some are small living in tiny groups. Some are