Sigmoid units, Computer Engineering

Assignment Help:

Sigmoid units:

Always remember that the function inside units take as input the weighted sum, S and of the values coming from the units connected to it. However the function inside sigmoid units calculates the following value that given a real-valued input S: is as

2248_Sigmoid units.png

Whereas e is the base of natural logarithms, e = 2.718... 

Where we plot the output from sigmoid units given various weighted sums as input that looks remarkably like a step function as: 

983_Sigmoid units1.png

Obviously by getting a differentiable function that looks like the step function was the whole point of the exercise. Moreover, not only is this function differentiable but  there the derivative is fairly simply expressed in terms of the function itself as: 

970_Sigmoid units2.png

So note that the output values for the σ function range between but never make it to 0 and 1. It means that e-S is never negative so the denominator of the fraction tends to 0 as S gets very big in the negative direction and then tends to 1 as it gets very big in the positive direction. In fact this tendency happens fairly quickly as: in the middle ground between 0 and 1 is rarely seen means the sharp or near step in the function. Just because of it looking like a step function that we can think of it firing and not-firing as in a perceptron as: if a positive real is input and the output will generally be close to +1 then a negative real is input the output will generally be close to -1.


Related Discussions:- Sigmoid units

Explain the main tags of wireless markup language, Discuss the main tags of...

Discuss the main tags of WML. Tag Definition of Wireless Markup Language: This defines the starting and the ending of the page, as .   this explains

What are inertial and non-inertial frame of references, Q. What are inertia...

Q. What are inertial and non-inertial frame of references? (i) Inertial (or) unaccelerated frames: Bodies in this frame follow Newton's law of intertia as well as othe

Convert the given S-R flipflop to a D-flip flop., Convert the given S-R fli...

Convert the given S-R flipflop to a D-flip flop. Ans: The Truth Table for S-R Flip-Flop is illustrated in Fig.(a) and truth table of D Flip-Flop is illustrated in Fig.(b)

General purpose register - assembly language, General purpose register - as...

General purpose register - assembly language: Basic ISA Classes: Accumulator: 1 address add Aacc ←acc + mem [A] Stack: 0 address add to s ←to s+ next G

What is the last entry in all bdc tables, What is the last entry in all BDC...

What is the last entry in all BDC tables? In all BDC tables the last entry is to save the data by using the field name BDC_OKCODE and a field value of '/11'.

user to enter the weight, A red and blue car were involved in a head-on co...

A red and blue car were involved in a head-on collision. The red car was at a standstill and the blue car was possibly  speeding. Eye witness video recorded suddenly following the

Explain the term- cycle based simulator, Explain the term- Cycle Based Simu...

Explain the term- Cycle Based Simulator This is a Digital Logic Simulation method which eliminates unnecessary calculations to achieve huge performance gains in verifying Bool

Explain signed binary number system, Explain signed binary number system. ...

Explain signed binary number system. Ans. Signed Binary Numbers: In decimal number system positive numbers are signified by (+) sign and negative numbers are represented b

Graphics, what is bitmap and pixmap

what is bitmap and pixmap

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd