Title: Information Technology Lecture 1

Essay Details  Subject: Technology Author: Ada R Date: August 18, 2014 Level: College Grade: A Length: 1 / 173 No of views: 0 Essay rating: good 0, average 0, bad 0 (total score: 0)

Essay text:

Information: is a function of probability -- f(p). Information is inversely proportional to p. Shannons def: info(p)=log2(1/p) Entropy = average information Ex: coin flip Pr(H)=Pr(T)=1/2 Info(H)=log2(1/(1/2))=log2(2)=1 bit Info(T)=1 bit If you flip a fair coin, either output gives you 1 bit. Since the entropy is defined as the average information, Entropy for a coin flip is a 1...

Showed first 250 characters

Do you need an essay?

Here are the options you can choose from:

• Order plagiarism free custom written essay
• All essays are written from scratch by professional writers according to your instructions and delivered to your email on time
• Prices start from \$12.99/page

Do you need many essays?

• This option gives you the immediate access to all 184 988 essays
• You get access to all the essays and can view as many of them as you like for as little as \$28.95/month

Since the entropy is defined as the average information, Entropy for a coin flip is a 1. Formal States 1…n Pr(i)=pi Info(i)=log2(1/pi)=-log2(pi) Entropy: H= Flipping a coin twice: Possible outcomes: HH, HT, TH, TT n=4, pi=(1/2)(1/2)=1/4 Info(HH)=log2(1/(1/4))=log2(4)=2 Entropy(HH)=2 ? H=-p1log(p1) ' p2log(p2) ' p3log(p3) ' p4log(p4) = ?(2) + ?(2) +?(2) +?(2) = 2 Example: 6 sided die States: 1…6 pi=1/6 Info(pi)=log2(6)=2...

Showed next 250 characters

If you cannot find any suitable paper on our site, which happens very rarely, you can always order custom written paper which will be written from scratch by our professional writers and deliver to you on requested time.
 Your research paper is written by certified writers Your requirements and targets are always met You are able to control the progress of your writing assignment You get a chance to become an excellent student! Total price: \$10.00

Common topics in this essay: