Explain advantage and disadvantage of online learning

Assignment Help Other Subject
Reference no: EM13850805

Question: An extreme version of gradient descent is to use a mini-batch size of just 1. That is, given a training input, x, we update our weights and biases according to the rules wk→w′k=wk-η∂Cx/∂wk and bl→b′l=bl-η∂Cx/∂bl. Then we choose another training input, and update the weights and biases again. And so on, repeatedly. This procedure is known as online, on-line, or incremental learning. In online learning, a neural network learns from just one training input at a time (just as human beings do). Name one advantage and one disadvantage of online learning, compared to stochastic gradient descent with a mini-batch size of, say, 20.?

Reference no: EM13850805

Questions Cloud

Describe how the statements relate to the ad-as model : Describe how the following statements relate to the AD-AS model:
Identify the dimensions of creativity at the organization : Identify the dimensions of creativity at the organization that you ranked the highest and the lowest. Evaluate how the rank of these dimensions explains the organizational climate for creativity
Compute the output of a sigmoid neuron : Write out Equation a′=σ(wa+b). in component form, and verify that it gives the same result as the rule 4 for computing the output of a sigmoid neuron.
What types of opportunities did you find : What types of opportunities did you find? What specific qualities or skill set are organizations looking for in interns or volunteers? What personally interests you most or least in these opportunities
Explain advantage and disadvantage of online learning : Explain one advantage and one disadvantage of online learning, compared to stochastic gradient descent with a mini-batch size of, say, 20.?
Compare and contrast the tidewater : Compare and contrast the Tidewater and the backcountry regions of the Southern Colonies.
Advantages of non-numeric and numeric selection models : Compare and contrast the advantages and disadvantages of non-numeric and numeric selection models. Describe how selection criteria are developed and used for the selection and prioritization of projects
Identifying a suitable new plant location for a company : This project is designed to provide an opportunity to apply what you have learned throughout the semester. It involves the completion of a two-part research project focusing on identifying a suitable new plant location for a company
What happens when c is a function of just one variable : What happens when C is a function of just one variable? Can you provide a geometric interpretation of what gradient descent is doing in the one-dimensional case?

Reviews

Write a Review

Other Subject Questions & Answers

  About conformity in groups

Conformity in Groups

  Product life cycle

Based on your knowledge of the product life cycle, what types of changes will occur to your selected product as it continues through the product life cycle?  How will this affect the marketing of your selected product?

  Take a position on whether or not managerial groups within

managerial decision makingnbspnbspplease respond to the followingtake a position on whether or not managerial groups

  Examine the concept of white privilege and how it might

the concept of white privilege was first proposed in 1935 and has since become a central concept of critical race

  Explain the judicial proactive mechanisms

Please list and describe the judicial proactive mechanisms to control prejudicial publicity? Please list and describe the judicial reactive mechanisms to control pretrial publicity?

  Reduce-Reuse and Recycle-Environmental science

In the 1980's it was the slogan, "Reduce, Reuse and Recycle" and now it is "Go Green." Consider the Reusable Grocery Bags sold in markets everywhere. What are the pros and cons that you see in this latest trend? Give examples of the potential environ..

  Bird without changing anything in his concept of bird

A young boy sees a peacock for the first time and correctly recognizes it as a "bird" without changing anything in his concept of "bird". Piaget would say that this is an example of

  Prediction trap is one of the phycological

Prediction trap is one of the phycological...we often are overconfident in our expectataions about future events. Have you fallen for this trap? How can we avoid it?

  The term construction management

The term " construction management " (CM) has caused some confusion in the construction industry over what CM represents. Some in the industry recognize CM as existing only in the construction phase as opposed to throughout the entire project. Knowin..

  Some cons of special events for nonprofit organization

What are some "cons" of special events for a nonprofit organization? One of the greatest strategies to obtain individual donations is special events. I want to talk a little more about special events because this is a fundraising strategy that my org..

  Foot-candles measure incident light

Lumen refers to the quantity of light that is given off in all directions by the lamp itself. Lumens are never compared to watts. Cndlepower describes the amount of light given off in a particular direction. Candela is the measurement applied to the ..

  In many cities throughout the united states the prevalence

in many cities throughout the united states the prevalence of hate crimes has increased. you have been asked to provide

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd