Sigmoid units, Computer Engineering

Assignment Help:

Sigmoid units:

Always remember that the function inside units take as input the weighted sum, S and of the values coming from the units connected to it. However the function inside sigmoid units calculates the following value that given a real-valued input S: is as

2248_Sigmoid units.png

Whereas e is the base of natural logarithms, e = 2.718... 

Where we plot the output from sigmoid units given various weighted sums as input that looks remarkably like a step function as: 

983_Sigmoid units1.png

Obviously by getting a differentiable function that looks like the step function was the whole point of the exercise. Moreover, not only is this function differentiable but  there the derivative is fairly simply expressed in terms of the function itself as: 

970_Sigmoid units2.png

So note that the output values for the σ function range between but never make it to 0 and 1. It means that e-S is never negative so the denominator of the fraction tends to 0 as S gets very big in the negative direction and then tends to 1 as it gets very big in the positive direction. In fact this tendency happens fairly quickly as: in the middle ground between 0 and 1 is rarely seen means the sharp or near step in the function. Just because of it looking like a step function that we can think of it firing and not-firing as in a perceptron as: if a positive real is input and the output will generally be close to +1 then a negative real is input the output will generally be close to -1.


Related Discussions:- Sigmoid units

Explain turing reducibility, Explain Turing reducibility?  Exponential ...

Explain Turing reducibility?  Exponential time algorithms typically happens when we solve by searching by a space of solutions known as brute -force search

101-key enhanced keyboard, With its newer range of PCs IBM introduced 101-k...

With its newer range of PCs IBM introduced 101-key Enhanced/Advanced keyboard.  This keyboard is fundamental keyboard behind modern QWERTY keyboards. This has function keys aligned

Minimization of the logic function using NORgates, Minimize the logic funct...

Minimize the logic function F(A, B, C, D) = ∑ m(1,3,5,8,9,11,15) + d(2,13) using NOR gates with help of K-map. Ans. Realization of given expression by using NOR gates: In POS

What is a linked list, What is a linked list? Linked list: A linked l...

What is a linked list? Linked list: A linked list is a self referential structure which having a member field that point to the similar structure type. In simple term, a link

What is a good resolution, Q. What is a good resolution? In fact it rel...

Q. What is a good resolution? In fact it relies on your hardware. Hence it's the maximum your hardware can allow you.  But one odd-looking resolution that has become popular is

Convert the decimal numbers into hexadecimal, Q Convert the following DECIM...

Q Convert the following DECIMAL numbers into HEXADECIMAL, double check by converting the result HEXADECIMAL to DECIMAL. a)    24 b)   547.56

Incorporating vbscript into htmlpage, To add scripts into your Web pages ta...

To add scripts into your Web pages tag is used. The tag signifies the start of the script section, whereas marks the end. An example of this is d

Define range which a normalised mantissa can signify, Now let's define rang...

Now let's define range which a normalised mantissa can signify. Let's presume that our present representations has normalised mantissa so left most bit can't be zero so it has to b

What will exactly the hide statement do, What will exactly the hide stateme...

What will exactly the hide statement do? For displaying the details on secondary lists needs that you have previously stored the contents of the selected line from within the

Explain advantages and disadvantages of macro pre-processor, What are the a...

What are the advantages and disadvantages of macro pre-processor? Advantages Any of existing conventional assembler can be improved in this way to incorporate macro proces

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd