Monday, July 20, 2015

A Brief History of Neural Networks



In computer science and specifically machine learning, programmers have been trying to simulate the behavior of the brain since the late 1940s.  The fundamental pattern of the brain is modeled by programmers as loosely connected nodes capable of learning and modifying their behavior as information is processed. 


In 1948 Alan Turing's paper Intelligent Machinery called these loosely connected nodes unorganized machines, and compared them to an infant's brain.
Neural Network used in a BioWall



In the 1950s Frank Rosenblatt developed the Perceptron, a binary classification algorithm and one of the first implementations of a Neural Network.  Programmers soon realized that neural networks were only very effective if they had 2 or more layers.  But machine processing power at the time prevented implementing anything useful.




By the 1970s machines had improved, and Neural Networks again gathered interest, but were soon surpassed in utility by simpler classification algorithms such as Support Vector Machines and linear classifiers.
Samples from two classes.  Samples on the margin between them are called support vectors.


This century, Neural Networks have made strides again with the invention of Deep LearningGeoffrey E. Hinton of the University of Toronto improved classification results by training each layer of a neural network separately.  As a result, many classification competitions are now won using Deep Neural Networks, often running on GPU processors.



Scilab , Python's Theano ,  Julia's Mocha,  and Caffe are all  focused on deep learning and neural networks.  Watch these projects evolve as deep learning gathers momentum.




15 comments:

Nainika Joseph said...

Thanks for this blog. provided great information. All the details are explained clearly with the great explanation. Thanks for this wonderful blog. Step by step processes execution are given clearly.Know the details about different thing.
SAP Training in Chennai

Suseela Susiee said...




Great and useful article. Creating content regularly is very tough. Your points are motivated me to move on.


SEO Company in Chennai

kitharington said...


very nice blogs we have to share it useful information.

Tableau Training |
Hadoop Training |
Informatica Training |
Angularjs Training

Jeffy said...

Thank you for sharing such a nice and interesting blog with us. Hope it might be much useful for us. keep on updating...!!
seo company in india
digital marketing company in india

Riya R said...

informative blog thanks for providing such a great information.
SharePoint jobs in Hyderabad
SharePoint jobs in Chennai

LauraMedley said...

I am so much excited after www.write-my-essay-for-me.com reading your blog. Your blog is very much innovative and much helpful for any industry as well as for person.

Packers And Movers Bangalore said...

Packers and Movers Bangalore as a Services providing company can make all the difference to your ###Home Relocation experience. Bangalore based Company which offers versatile solutions, Right team that easily reduce the stress associated with a ✔✔✔ Household Shifting, ***Vehicle Transportation. we help things run smoothly and reduce breakages and offer you seamless, Affordable, Reliable Shifting Services, Compare Shifting Charges @

Packers And Movers Bangalore

pexejurer said...

This is really awesome... I like your post and looking forward to it.. wifikill link2sd apk editor

Packers and Movers Pune said...


Packers and Movers Pune Provide High Quality ***Household Shifting, Home/Office Relocation, Insurance, Packing, Loading, ###Car Transportation Service Pune and High experiences, Top Rated, Safe and Reliable, Best and Secure Packers and Movers Pune Team List. Get ✔✔✔ Affordable Rate Charts and Compare Quotation and Save Money and Time .
Packers And Movers Pune

Packers And Movers Mumbai said...

Hire Best Packers And Movers Mumbai for hassle-free Household Shifting, ***Office Relocation, ###Car Transporation, Loading Unloading, packing Unpacking at affordable ✔✔✔ Price Quotation. Top Rated, Safe and Secure Service Providers who can help you with 24x7 and make sure a Untroubled Relocation Services at Cheapest/Lowest Rate
Packers And Movers Mumbai

Packers Movers Delhi said...

Get Shifting/Relocation Quotation from ###Packers and Movers Delhi. Packers and Movers Delhi 100% Affordable and Reliable ***Household Shifting Services. Compare Transportation Charges and Save Time, Verified and Trusted Packers and Movers in Delhi, Cheap and Safe Local, Domestic House Shifting @
Packers and Movers Delhi

Packers Movers Delhi said...

Packers And Movers Delhi to Jaipur

Packers And Movers Delhi to Gurgaon

Packers And Movers Delhi to Kolkata

Packers And Movers Delhi to Chennai

Packers And Movers Delhi to Pune

Packers And Movers Delhi to Bhubaneswar

Packers And Movers Delhi to Bhopal

Packers And Movers Delhi to Lucknow

Packers Movers Chennai said...

Packers and Movers Chennai Give Safe and Reliable ***Household Shifting Services in Chennai with Reasonable ###Packers and Movers Price Quotation. We Provide Household Shifting, Office Relocation, ✔✔✔Local and Domestic Transportation Services, Affordable and Reliable Shifting Service Charges @
Packers And Movers Chennai

Packers And Movers Bangalore said...

Packers And Movers Bangalore to Chandigarh
Packers And Movers Bangalore to Bhopal
Packers And Movers Bangalore to Indore
Packers And Movers Bangalore to Surat
Packers And Movers Bangalore to Bhubaneswar

Packers And Movers Mumbai said...

Hire Best Packers And Movers Mumbai for hassle-free Household Shifting, ***Office Relocation, ###Car Transporation, Loading Unloading, packing Unpacking at affordable ✔✔✔ Price Quotation. Top Rated, Safe and Secure Service Providers who can help you with 24x7 and make sure a Untroubled Relocation Services at Cheapest/Lowest Rate
Packers And Movers Mumbai

Popular Articles