What is the mutual information

Assignment Help Computer Network Security

Reference no: EM131249621

One error only:-

Consider a source X that has two symbols. These are coded in binary as 00 and 11 respectively. Each X symbol (two-bit word) has probability 1/2. When these two-bit words are sent through a certain channel, there is a probability p that one of the two bits will be changed by an error to the opposite binary bit before it is received at Y.

For example, 00 may be received as 00 with probability 1 - p, 01 with probability p/2, or 10 with probability p/2. There is no probability of two errors in a word. (Throughout the exercise use the notation H( p) = -p log p - (1 - p) log (1 - p).)

(a) Find H(Y|X).

(b) Find H(Y).

Reference no: EM131249621

Questions Cloud

What is the mutual information of the source and receiver : A source X sends 0's and 1's with probabilities π and 1-π, respectively, to a receiver Y. - What is the mutual information of the source and receiver?

Define a business problem including problem statement : Define a business problem including problem statement, purpose, objective and any research questions you want to answer with the research..

Write a brief reflection over the writing process : Write a brief reflection (200 words) over the writing process and submission of Paper Some ideas students may consider How well do you feel you understood the aims and requirements of the assignment?

Foreign trade or technological change : What is more important in determining structural unemployment, foreign trade or technological change?

What is the mutual information : Consider a source X that has two symbols. - Find H(Y|X). - Find H(Y). - What is the mutual information I(X; Y)?

Implications of the factor price insensitivity theorem : Regarding the Hechscher Ohlin model, what are the implications of the factor price insensitivity theorem on the equilibrium real wages in the two countries (Home and Foreign) in a H-O model with two goods and two factors;

Emissions standards would reduce health-care : Suppose that stricter emissions standards would reduce health-care cost by $50 million butincrease the cost of fuel and emissions equipment by $30 million. Is it sensible to tighten theemissions standard.

How would you characterize winthrop conception of hierarchy : What does Winthrop mean in the passage: "For wee must consider that wee shall be as a citty upon a hill. The eies of all people are upon us"? What does this mean in context to the Protestant Christian world?

Maintain the fixed exchange rate : Explain whether in your opinion, the country will be able to maintain the fixed exchange rate. Carefully explain whether and what adjustments will occur.

User Account

All Pages