Skip to main content

Information Theory

This is a very highly theoretical problem. What do you call an "Information"? To know that you have been informed. What does that mean? Analyst are always tyring to find the information from a mathematical functions and applying a probabilistic approach, from the trend or clusters of data.

But, what is information and how can you measure the value of the information. Just recently I had posted a article on modeling where, I talked about the Information Value. I might have skipped by saying that it has a mathematically rigorous process and needs in depth understanding of Information Theory. Well, let me try to explain it in as many few words as possible.

Information is something you don't know. It is something which you don't expect to happen. For example your future- so if someone tells your future, its an information. Is that confusing??

Actually, its quite simple. If someone tells you something you already know, then its not an information, cause it doesn't have any value, as you already know it. 

Therefore, even in a collection of data and in the correlation process, we try to figure out the best possible sets of variables that have the capability to predict the outcome variables. 


Lets take another example:

Lets say, you know that your schedule for train is at 12pm at night. Cause its in the ticket.

Now if someone says, that your departure time is 12pm....hmmm is that an information.

But, if someone comes to you and says, your train has been rescheduled due to the delay. Then that is an information- an information, that is useful. Anything not useful is not an information. (From what I have explained)

Mathematically, Information is inversely proportional to the probability of the occurrence of an event.

If p(E) is zero than it contains INFINITE information.
if p(E) is 1, which is the largest, then it contains ZERO information.


I hope that was simple enough.

Remember that the information that I am talking about is not the collection of a data. It is something that has value in terms of its existence.




Comments

Popular posts from this blog

Selling a Comb to a Bald Person?

Here my friend, Ashay, put it very truly to me that the marketer's most challenge is to sell a comb to a bald. First, I am not trying to justify anything here. But I just couldn't help thinking how on earth am I going to sell a comb to a bald. How? Just how? I kept pondering upon it till late night. I actually had very few options with me, the first was obviously to use Google and Find? :) But, I didn't do that. Some how I was still in confusion. Then just before going to sleep, I had an discussion with my other friend, on types of marketing on issues related to customer centric marketing. Hmm. Then some how it hit me. I went back to basic on my own philosophy, sell things that is needed. So here is a small anecdote I prepared : Sale Person   : Hello sir. How are you? Do you have a time, plzzz? Bald Person : (Almost confused and in social causality) OK OK what is it? I don't have time. Sale Person    : Here sir, do you want to by a comb?  Bald Person  : Can't you

Fearful Consumer Market

Consumer market is something, I always feared. During my engineering days, I knew it was one area where I would not find myself working. I always feared the harsh competition of the market. I worried if ever, anything I made would sustain in the market. Or how people would react to it? You can say, I feared criticism and all the yap yap of group of people, who knows only how to suggest but not to act. Thus, I kept my interest into custom projects and not related to anything that a single consumer would use, rather it was something of community service. But with changing time, I knew I had to make a plunge into the ocean of consumer market and face the competition. "Be a man! Dude" That is what I would say to myself. I knew I couldn't swim, but I had to give it a try.  Journey into the consumer market is like that of 20000 Leagues Under The Sea . There are so many different kinds of creatures around to look and be fascinated. Some are small living in tiny groups. Some are