Program to fit a single hidden layer neural network

Reference no: EM131044835

(a) Write a program to fit a single hidden layer neural network (ten hidden units) via back-propagation and weight decay.

(b) Apply it to 100 observations from the model

where σ is the sigmoid function, Z is standard normal, X = (X1, X2), each Xj being independent standard normal, and a1 = (3, 3), a2 = (3, -3). Generate a test sample of size 1000, and plot the training and test error curves as a function of the number of training epochs, for different values of the weight decay parameter. Discuss the overfitting behavior in each case.

(c) Vary the number of hidden units in the network, from 1 up to 10, and determine the minimum number needed to perform well for this task.

Reference no: EM131044835

Questions Cloud

Mean gmat score of mean of the sample : Find the probability that the mean GMAT score of mean of the sample pf 25 examinees is less than 480? Find the probability that exactly 10 out of 25 selected examinees achieved a score greater than 420.

Taxes payable-income tax expense : In early 2009 Sanborn Company must pay the tax authority €37,000 on the income it earned in 2008. Th is amount was recorded on the company's 31 December 2008 financial statements as:

Find the size of the equal payments if money is at present : $500 due in one year plus interest at 6% compounded semi-annually, $2000 due in two years (Interest is not given for this which means $2000 is a maturity value), $1000 due in three years plus interest at 5% compunded monthly. He wishes to discharge t..

Find the probability that the mean gmat score : 1) Suppose that 25 examinees are picked at random. Let X be the mean GMAT score of the 25 examinees selected. Find the mean and standard deviation of the sample mean GMAT score X. 2) Find the probability that the mean GMAT score X of the sample of ..

Program to fit a single hidden layer neural network : Vary the number of hidden units in the network, from 1 up to 10, and determine the minimum number needed to perform well for this task.

What threshold gmat score : What threshold GMAT score should the umkc business school set in order to ensure that 20 percent of the examinees who apply to their program will be accepted.

Identify type of financial market where-flow of funds occurs : Worcester Tool Company is a large, U.S.-based, multinational corporation with subsidiaries in eight different countries. Explain the various ways in which Citigroup could facilitate Worcester’s flow of funds, and identify the type of financial market..

Discuss at least one of the advantages of business forms : Discuss at least one of the advantages and one of the disadvantages of that form and potential legal forms that might be required.

Using the straight-line method of depreciation : Using the straight-line method of depreciation for reporting purposes and accelerated depreciation for tax purposes would most likely result in a:

User Account

All Pages