Generate the horse-shoe function using matlab

Assignment Help Other Engineering

Reference no: EM131477038

Information Theory Assignment

The concept of entropy can be applied to any language by assuming that the alphabetical characters are generated randomly by a data source. To better understand this concept, you need to do the following for both English and Arabic languages:

Part 1:

1. Copy form the internet an article of your choice, the article should be at least 1000 words, paste the article in a text file.

2. Convert all capital letters (for the English) to small letters and remove all punctuation marks from the article. Just leave the spaces.

3. Write a Matlab code that generates the probability distribution function (PDF) of your article.

4. Write a Matlab code that computes the entropy of the text.

5. Compare the results of both languages with each other.

Part 2:

During your studies of the Information Theory, you have seen that the entropy of a binary source follows the horse-shoe function given that we know the probability (p, 1 - p) of each event accurately. In this part you are required to:

1. Generate the horse-shoe function using Matlab assuming that p is known perfectly.

2. Generate the horse-shoe function using Matlab by generating N samples of a binary random variable. The function should be generated using four different values of N (10, 100. 1,000, 10,000).

3. Compare the results for the four cases (N = [10, 100. 1,000, 10,000]) with the ideal one by plotting them on the same figure.

4. Compute and draw the KL distance between the ideal case (p) and the other four cases where p is obtained using simulation. What is your conclusion? Show your solution in details.

Reference no: EM131477038

Questions Cloud

E-commerce is emerging markets is often hampered : With regarding to purchasing patterns and practices, it is crucial for global e-marketer to understand the world from their target market's perspective.

Conflict coltan in global electronics industry supply chain : What is conflict coltan? What groups benefited from the trade in conflict coltan? What groups were hurt by it?

How much will you need to have saved by your retirement date : Today is your 40th birthday. You expect to retire at age 65 and actuarial tables suggest that you will live to be 100. You want to move to Hawaii.

Identify the weaknesses in the internal control system : Analyse the ratios with reference to the additional information. Identify the potential impact for the audit and any particular audit steps that need to be undertaken to reduce audit risk.

Generate the horse-shoe function using matlab : Generate the horse-shoe function using Matlab assuming that p is known perfectly. Write Matlab code that generates probability distribution function of article.

Product for local tastes or introduce global product : Would you adapt your product for local tastes or introduce a "global" product? Support your reasoning.

What is the compound rate of interest being offered in fund : You have just invested $10,000 in a new fund that pays $1,500 at the end of the next 10 years. What is the compound rate of interest being offered in the fund?

Letter north american radio station call signs : How many different 4-letter North American radio station call signs (like CKUL, KNBC, WCBS, and XTHO) can be made if the first letter.

How much will john need to finance through the dealer : John is turning 13 today. His birthday resolution is to start saving towards the purchase of a car that he wants to buy on his 18th birthday.

User Account

All Pages