Multi-layer network architectures, Computer Engineering

Assignment Help:

Multi-Layer Network Architectures:

As we considered we saw in the previous lecture that perceptrons have limited scope in the type of concepts that they can learn - but they can only learn linearly separable functions. Moreover, we can think of constructing larger networks by building them out of perceptrons. So in generally such larger networks that we call the step function units the perceptron units are in multi-layer networks.

However as with individual perceptrons there multi-layer networks can be used for learning tasks. In fact, the learning algorithm in which we look at as the backpropagation routine is derived mathematically by utilising differential calculus. Hence the derivation relies on having a differentiable threshold function that effectively rules out using perceptron units so if we want to be sure that backpropagation works correctly. Conversely the step function in perceptrons is not continuous, thus non-differentiable. If there an alternative unit was therefore chosen that had similar properties to the step function in perceptron units but that was differentiable.


Related Discussions:- Multi-layer network architectures

How will this difference b interpreted, How will this difference b interpre...

How will this difference b interpreted? When one pointer is subtracted from another pointer, the number of elements between the two pointers always includes the element pointed

Explain how sap gui handles output screen for the user, Explain how SAP GUI...

Explain how SAP GUI handles output screen for the user. The SAP front-end s/w can either run on the similar computer or on dissimilar computers given for that purpose.  User t

Illustrate the following list of consideration of Laptop, Illustrate the fo...

Illustrate the following list of consideration of laptop computers The following is a list for consideration: -  The processor must consume as little power as possible thus

What are difference between mealy and moore state machine, What are differe...

What are difference between Mealy and Moore state machine? Difference between Mealy and Moore state machine: 1) Mealy and Moore models are the fundamental models of state ma

Expalin massively parallel system and scalability, Massively Parallel Syste...

Massively Parallel System Indicates to a "parallel computer system" involving a huge number of processors. The numbers in a huge number of processors keeps increasing and curre

Diiferentiate between ROM and PROM, Diiference between ROM and PROM. R...

Diiference between ROM and PROM. ROM: It also called Read Only Memory is a Permanent Memory. The data is permanently stored and cannot be changed in Permanent ROM. This can o

What is view, What is View? A simple view can be thought of as a subset...

What is View? A simple view can be thought of as a subset of a table. It can be used for retrieving data, as well as updating or deleting rows. Rows updated or deleted in the v

Manipulating numbers, Computers manipulate numbers - but decimalnumbers wit...

Computers manipulate numbers - but decimalnumbers with digits 0, 1, 2, 3, 4, 5, 6, 7, 8, 9 cannot be represented using two states of a digitalcircuit.Instead decimal numbers are co

C program, program to find minimum total number of shelfs

program to find minimum total number of shelfs

Transportation model, advantages and disadvantages of northwest corner meth...

advantages and disadvantages of northwest corner method and least cost method

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd