Competitive learning

Competitive learning

Competitive learning is a form of unsupervised learning in artificial neural networks, in which nodes compete for the right to respond to a subset of the input data.[1] A variant of Hebbian learning, competitive learning works by increasing the specialization of each node in the network. It is well suited to finding clusters within data.

Models and algorithms based on the principle of competitive learning include vector quantization and self-organising maps (Kohonen maps).

Example algorithm

Here is a simple competitive learning algorithm to find three clusters within some input data.

1. (Set-up.) Let a set of sensors all feed into three different nodes, so that every node is connected to every sensor. Let the weights that each node gives to its sensors be set randomly between 0.0 and 1.0. Let the output of each node be the sum of all its sensors, each sensor's signal strength being multiplied by its weight.

2. When the net is shown an input, the node with the highest output is deemed the winner. The input is classified as being within the cluster corresponding to that node.

3. The winner updates each of its weights, moving weight from the connections that gave it weaker signals to the connections that gave it stronger signals.

Thus, as more and more data is received, each node "listens" more and more carefully to the sensors that relate to one cluster, and "listens" less and less to sensors that relate to other clusters.

References

  1. ^ Rumelhart, David; David Zipser, James L. McClelland, et al. (1986). Parallel Distributed Processing, Vol. 1. MIT Press. pp. 151–193. 

Wikimedia Foundation. 2010.

Игры ⚽ Поможем написать реферат

Look at other dictionaries:

  • Competitive heterogeneity — is a concept from strategic management that examines why industries do not converge on one best way of doing things. Microeconomics predicts that competition will result in industries composed of identical firms offering identical products at… …   Wikipedia

  • Cooperative learning — is an approach to organizing classroom activities into academic and social learning experiences. Students must work in groups to complete tasks collectively. Unlike individual learning, students learning cooperatively capitalize on one another’s… …   Wikipedia

  • Collaborative Networked Learning — is a method developed by Dr. Charles A. Findley in the mid 1980s as part of his work on designing the classroom of the future for the knowledge worker. Collaborative Networked Learning (CNL) is that learning which occurs via electronic dialogue… …   Wikipedia

  • Constructivism (learning theory) — Jean Piaget: founder of Constructivism Constructivism is a theory of knowledge (epistemology)[1] that argues that humans generate knowledge and meaning from an interaction between their experiences and their ideas. During infancy, it was an… …   Wikipedia

  • Organizational learning — is an area of knowledge within organizational theory that studies models and theories about the way an organization learns and adapts. In Organizational development (OD), learning is a characteristic of an adaptive organization, i.e., an… …   Wikipedia

  • Concept learning — Concept learning, also known as category learning, concept attainment, and concept formation, is largely based on the works of the cognitive psychologist Jerome Bruner. Bruner, Goodnow, Austin (1967) defined concept attainment (or concept… …   Wikipedia

  • Science Learning Centres — Origins= In 2001, the [http://www.publications.parliament.uk/pa/ld200102/ldselect/ldsctech/47/4702.htm/ House of Lords Science Technology Select Committee Report] identified an urgent need for subject specific Continuing Professional Development… …   Wikipedia

  • Maine Learning Technology Initiative — The Maine Learning Technology Initiative is an initiative that gives Apple MacBooks (formerly Ibook G4 s And G3 s) to all of the 7th and 8th graders attending public schools in [[Maine][1]]. These laptops are fully equipped with high tech and… …   Wikipedia

  • Demand-side learning — is a phrase coined by Ramon Casadesus Masanell and Pankaj Ghemawat of Harvard Business School in the article Microsoft vs. Open Source: Who Will Win? by Sean Silverthorne from June 6, 2005. Demand side learning refers to open source software s… …   Wikipedia

  • cooperative learning —    Typically, small group learning activities that promote positive interaction resulting in improved learning. The teacher divides a class into groups of two to six, each group containing a mix of student types backgrounds, achievement levels,… …   Glossary of Art Terms

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”