Skip to main content

Working with Regression Analysis

When every variables are ready to be put into some software machines to be analysed, and the formula for the relations to be spit out, it is always tempting to believe that the answer is correct. But it isn't? We need human intelligence and analyses to come to the right result. 

Similar things happen when you are making linear models through regressions. As, I have written earlier, the choice of variable is very important. So how do we insure that the resultant choices made are justified. It is always easy to come to result but harder to justify. 

Lets look at some examples:


The above graph is the graph of a Revolving Value (Revolving Balance). This is the variable very important for the Bankers. Therefore, it will be interesting for them to know before hand the value of the Revolving Balance. 

There are many variables to be included for the analysis and modeling. By following the rules and methods mentioned in my previous blogs, I have constructed an initial model. Using that model, I have predicted the values. lets look at it below.
 

Remarkable!! The predicted lines, which is the red one, seems to follow the real line. But, this analysis in itself is insufficient to prove the validity of the model. We need to look at it sown the line further. Just for the case, the R-square Value for this model was around 0.98!

Graph of Error Versus the Revolving Value

Here, we are trying to look at the relationship of error and the real value. But why?? 

The error is by nature defined to be RANDOM and having zero correlation with any variable. Therefore, the error must not be predictable. In this figure, we see that the error is vibrating between the zero value with higher bias to the negative side. Hence, we have a line drawn to best fit the plots. Ideally, this line must pass through the zero line. The line seems to have deviated to -30 below. This must be reduced to have a better result. This analysis of error with time is necessary, as error are RANDOM.

Graph of Error Versus Time

This above graph is also almost the same as with the previous one, except the error is related to the real value. It seems the model was not able to predict the higher values with accuracy. Something must be done here. But What?? May be reduce the variables or validate the raw data to conform that there is no error in the data. Also, we can ignore this particular value.But BE CAREFUL, it might have a significance.

These kinds of analysis speaks about the model that you are building. 

Just to show that there are many ways to analyses the error, I am posting another graph.


OK, don't worry about the figure. Actually its quite simple. The linear graph with the time has been folded to make the a circle.

In idealistic situation, the plot should be a perfect circle at Zero line. In good and realistic model, the figure must still be circle but with certain constant thickness. In this case it is neither.

Last thing, there is one important graph to check the randomness of your error and it is done by plotting the histogram of the error. The plot must match the Normal Distribution Curve.

The curve above shows that the mean of the error is ZERO, which is good. But the biasness to the negative side has to be taken care of.

Therefore, in this way we can analyse the model being constructed and keep tinker until a better one is obtained.

Comments

Popular posts from this blog

Good Ad Versus Bad Ad

At InRev, for past few days we have been working on our new project. The project is about collaborative blogging, from the blogger around the world. As Bhupendra and I have been blogging for long time, with his immense experience, our team has been working to revamp the globalthoughtzand create a new blogging experience. In this site, we are planning to add a section where people can add their advertisement. We thought lets start by our own :), with already so many products on the line, it was obvious.

So there goes an effort to create a small 128 px by 128 px logo. If you are a designer, you know that designing is a very time consuming process. For hours, you just test around with colors. Remember there are 256X 256X 256combination of colors!! Its hard job selecting one.
Lets start with F-Cube: In short F-cube is a Free Economic Reporting Site. Let me exhibit some Ad made for it and its pros and cons. (Please don't click on the image. Wait till the end. Thank You)
OK, how does thi…

Selling a Comb to a Bald Person?

Here my friend, Ashay, put it very truly to me that the marketer's most challenge is to sell a comb to a bald. First, I am not trying to justify anything here. But I just couldn't help thinking how on earth am I going to sell a comb to a bald. How? Just how? I kept pondering upon it till late night. I actually had very few options with me, the first was obviously to use Google and Find? :)

But, I didn't do that. Some how I was still in confusion. Then just before going to sleep, I had an discussion with my other friend, on types of marketing on issues related to customer centric marketing. Hmm. Then some how it hit me. I went back to basic on my own philosophy, sell things that is needed. So here is a small anecdote I prepared :
Sale Person: Hello sir. How are you? Do you have a time, plzzz?
Bald Person: (Almost confused and in social causality) OK OK what is it? I don't have time.
Sale Person: Here sir, do you want to by a comb? 
Bald Person : Can't you see I am bald? …

Waiting for the right bus

Everyday, after college I would walk home with my friends. Wandering around and talking about future. What will we do? How will we be? How much will we change? Ideas! Ambitions! Life!!!

Everything always tumbled down to a cup of tea at a near by shop, where we were regular visitors. A sip of tea and bunch of thought provoking questions and contradictions. All intelligent and weird minds searching for the answer to a common question - the meaning of life. Trying to find that right path towards salvation. Complete Consciousness!!

Now and then we would simply get lost within ourselves, in the midst of the crowd. Thoughts wandering far beyond the time frame. Everyone building their life on their own dimensions. Confident. Lost. But hopeful.

Like some lost sailors on a boat, every one of us would be looking at different directions hoping to see some signs of calling. But then we wouldn't find any. "What are we searching for ?", would be one damning question in every one'…