Skip to main content

Information Theory

This is a very highly theoretical problem. What do you call an "Information"? To know that you have been informed. What does that mean? Analyst are always tyring to find the information from a mathematical functions and applying a probabilistic approach, from the trend or clusters of data.

But, what is information and how can you measure the value of the information. Just recently I had posted a article on modeling where, I talked about the Information Value. I might have skipped by saying that it has a mathematically rigorous process and needs in depth understanding of Information Theory. Well, let me try to explain it in as many few words as possible.

Information is something you don't know. It is something which you don't expect to happen. For example your future- so if someone tells your future, its an information. Is that confusing??

Actually, its quite simple. If someone tells you something you already know, then its not an information, cause it doesn't have any value, as you already know it. 

Therefore, even in a collection of data and in the correlation process, we try to figure out the best possible sets of variables that have the capability to predict the outcome variables. 


Lets take another example:

Lets say, you know that your schedule for train is at 12pm at night. Cause its in the ticket.

Now if someone says, that your departure time is 12pm....hmmm is that an information.

But, if someone comes to you and says, your train has been rescheduled due to the delay. Then that is an information- an information, that is useful. Anything not useful is not an information. (From what I have explained)

Mathematically, Information is inversely proportional to the probability of the occurrence of an event.

If p(E) is zero than it contains INFINITE information.
if p(E) is 1, which is the largest, then it contains ZERO information.


I hope that was simple enough.

Remember that the information that I am talking about is not the collection of a data. It is something that has value in terms of its existence.




Comments

Popular posts from this blog

Good Ad Versus Bad Ad

At InRev, for past few days we have been working on our new project. The project is about collaborative blogging, from the blogger around the world. As Bhupendra and I have been blogging for long time, with his immense experience, our team has been working to revamp the globalthoughtzand create a new blogging experience. In this site, we are planning to add a section where people can add their advertisement. We thought lets start by our own :), with already so many products on the line, it was obvious.

So there goes an effort to create a small 128 px by 128 px logo. If you are a designer, you know that designing is a very time consuming process. For hours, you just test around with colors. Remember there are 256X 256X 256combination of colors!! Its hard job selecting one.
Lets start with F-Cube: In short F-cube is a Free Economic Reporting Site. Let me exhibit some Ad made for it and its pros and cons. (Please don't click on the image. Wait till the end. Thank You)
OK, how does thi…

Selling a Comb to a Bald Person?

Here my friend, Ashay, put it very truly to me that the marketer's most challenge is to sell a comb to a bald. First, I am not trying to justify anything here. But I just couldn't help thinking how on earth am I going to sell a comb to a bald. How? Just how? I kept pondering upon it till late night. I actually had very few options with me, the first was obviously to use Google and Find? :)

But, I didn't do that. Some how I was still in confusion. Then just before going to sleep, I had an discussion with my other friend, on types of marketing on issues related to customer centric marketing. Hmm. Then some how it hit me. I went back to basic on my own philosophy, sell things that is needed. So here is a small anecdote I prepared :
Sale Person: Hello sir. How are you? Do you have a time, plzzz?
Bald Person: (Almost confused and in social causality) OK OK what is it? I don't have time.
Sale Person: Here sir, do you want to by a comb? 
Bald Person : Can't you see I am bald? …

The day I dreamt of becoming someone

Reading a story is like pealing an onion, each chapters reveal new secrets and show their hidden layers. Everyone has their own story to tell, that is mysteriously connected with the stories of millions of other people living or dead in this planet. We think ourselves as an individual with our own identity and conscience, but NO, we are connected beings not with DNA or through our blood lines - but through our stories. Stories are at the heart of our being, and they are our reasons of living. The physical being of us has no meaning, but as a connected being with millions of other stories, we individually play an important role. So here is my story of dreaming.

Story doesn’t begin when we are born, or when we are given a name by the almighty holy priest. It beings when we all hit by our consciences that pushes us to make a decision that transpires our story and defines our character and role in this world. For some it begins early, but for some it begins late. However, it always being…