Which source is less predictable and why

Assignment Help Humanities
Reference no: EM131326475

Two discrete memory less information sources X and Y each have an alphabet with six symbols, X = Y = {1, 2, 3, 4, 5, 6}. The probabilities of the letters for X are 1/2, 1/4, 1/8, 1/16, 1/32, and 1/32. The source Y has a uniform distribution.

1. Which source is less predictable and why?

2. Design Huffman codes for each source. Which Huffman code is more efficient? (Efficiency of a Huffman code is defined as the ratio of the source entropy to the average codeword length.)

3. If Huffman codes were designed for the second extension of these sources (i.e., two letters at a time), for which source would you expect a performance improvement compared to the single-letter Huffman code and why?

4. Now assume the two sources are independent and a new source Z is defined to be the sum of the two sources, i.e., Z = X + Y . Determine the entropy of this source, and verify that H(Z)

5. How do you justify the fact that H(Z) < H(X) + H(Y )? Under what circumstances can you have H(Z) = H(X) + H(Y )? Is there a case where you can have H(Z) > H(X) + H(Y )? Why?

Reference no: EM131326475

Questions Cloud

How much would you have at the end of five years : You currently have 10,000,000 to invest and can earn 15% interest compounded annually. How much would you have at the end of 5 years, 10 years, 15 years, and 20 years?
National budget simulation : http://www.econedlink.org/national-budget-simulator.php , work through the National Budget Simulation (Links to an external site.) in an effort to achieve a budget deficit of $1100B dollars.
What is the resulting average codeword length : What is the resulting average codeword length? Compare the average codeword length with the entropy of the source. (In what base would you compute the logarithms in the expression for the entropy for a meaningful comparison?)
Probability of getting a ticket : In deciding to park in an illegal place, any individual knows that the probability of getting a ticket is p and the fine for receiving the ticket is f. Suppose that all individuals are risk averse (that is, U''(W)
Which source is less predictable and why : How do you justify the fact that H(Z) H(X) + H(Y )? Why?
What is gain or loss on the early extinguishment of the bond : ACCT311: What is the gain or loss on the early extinguishment of the bonds? Based on this information, what is the amount of net cash flows from financing activities?
Marginal principle for consumers : Equal Marginal Principle a. Write down the equal marginal principle for consumers. b. When does this condition hold?
What is your impression of some of the core buddhist beliefs : What is your impression of some of the core Buddhist beliefs and which Buddhist teachings caught your attention most
Actual future nominal exchange rate : Continue with the previous question: Suppose the actual future nominal exchange rate et+1 turns out to be higher than what you have calculated in Question #28. If you had already bought the foreign asset, you will ____ this mistake. Your purchase o..

Reviews

Write a Review

Humanities Questions & Answers

  Plan to improve correctional facilities

Women imprisonment should be facilitate with certain correctional facilities. In this paper, we have discussed about the plan for improving correctional facilities for the women prisoner in America.

  Situation analysis of food security in new zealand

This paper aims to present, discuss and analyse factors that are causing low food security, the management, current and proposed solutions in New Zealand (NZ).

  Social services on human traffic

The research study is limited to the understanding of  how social service agencies could approach or respond to the needs of the victim/ survivor of sex trafficking.

  Social deviance: the issue of risky sexual behaviour

The issue of deviant behaviour has been discussed by various sociologists from a number of perspectives.

  Race and racism

This paper is a brief description of the study, discrimination pertains to the prejudice perception and treatment of a person or demographical issues belonging to a category.

  Depth of challenges people face

Your own knowledge about the Depth of Challenges People face

  Project plan written report

Sufficient information to enable the organisation's Board of Executives to understand the rationale for the program and the activities required to design, implement and evaluate the program including any additional data that would need to be colle..

  Evaluation structure logical and achievable.

Health care organisational processes management, service administration, service provision and delivery

  Write an essay on locke''s theory of meaning

Write an essay on Locke's theory of meaning

  Leadership reflections paper

Write a paper on Leadership Reflections Paper Summarizes and reflects upon leadership ideas gleaned from the four required readings

  What role has feminism played

what role has feminism played in our appreciation of their work today.

  What subject matter choices were available to women artists

Prior to the beginning of the twentieth century, what subject matter choices were available to women artists? What cultural and historical influences placed limitations on their choices?

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd