Neural Networks

Neural networks, which are also called artificial neural networks, are an information processing paradigm that imitates biological nervous systems, such as the brain. The biological neural network inside the human brain is composed of a group or groups of chemically connected or functionally associated neurons, which could perform a specific physiological function, such as pattern recognition and decision making. Similarly, the artificial neural network system is composed of many simple processing elements operating in parallel. The function of the processing elements is for example determined by network structure and connection strengths.

First attempt of neural network research goes back to 1943 when the first artificial neuron was produced by the neurophysiologist McCulloch and the logician Walter Pits. However the computing technology was limited at that era, and they couldn’t do anything further; but their studies laid foundations for later work in neural network research. [1]

So far, the neural network has been a real movement of the discipline in three different directions:

Artificial neural networks (ANNs)
Neuromorphic Systems
Computational Neuroscience

Sunday, May 4, 2008

Artificial neural networks (ANNs)

The power and usefulness of artificial neural networks have been demonstrated successfully in several real world applications including speech synthesis, diagnostic problems, biomedicine, business and finance, robotic control, signal processing, computer vision and many other problems that fall under the category of pattern recognitions [2,3].

Example: Artificial Neural Networks(ANNs) in medicine and cancer research

Artificial Neural Networks are currently a popular research field in medicine. At the moment, the research is mostly focused on modeling and recognizing disease or cancers inside the human body. For example, many complex factors are involved in the prediction of several diseases or cancers. Therefore, ANNs could be utilized to evaluate complex nonlinear relations among many single variables and have been demonstrated to be promising tools for improving diagnosis, staging, and prognosis of prostate cancer with the accuracy of 79–84%.[4]

Interview with Prof. Azzam F.G. Taktak in Department of Clinical Engineering at Royal Liverpool University Hospital, UK. His research areas focus on computation and biomedicine, and he has served as the reviewer for various scientific journals, such as Artificial Intelligence in Medicine, International Journal of Artificial Intelligence Tools, Neural Networks, and European Journal of Neurology. He had published several papers and one of those is a review article to discuss the advantages of using ANNs as decision making tools in the field of cancer. [5][Dr. Azzam F.G. Taktak’s professional link]

In the interview I conducted with Prof. Taktak to discuss the development and future of ANNs in biomedicine, he first clarified that many people have some misconception about the ANNs because they think ANNs work like “black magic”. He said that in real case ANNs technologies have solid theoretic foundation and he also emphasized that ANNs and other Machine learning algorithms are very useful tools in analyzing problems that are too complex for the human brain to solve. They have a major role to play in high-dimensional datasets (such as micro array data) where traditional statistical models fail. Nevertheless, the only drawback is that a very large number of samples are required to make sure that the answers they provide is a sensible one. “And such datasets are not yet widely available” he said.

Since the limitation lies with the quality of the data rather than the model, Prof. Taktak is hoping to see more emphasis on real-world applications on the use of AI/ANNs rather than focusing on developing the methodology alone. And he anticipated that ANNs could be of great value to medical application when the accumulated clinical dataset is available in the future.

Other useful websites or links:
Artificial Neural Networks in Medicine World Map
Field distribution of ANNs
Real world application of ANNs
Experts in ANNs
Neural betwork centers worldwide

Neuromorphic Systems

Other than ANNs which are mainly software computation for solving static problems on computers, the area of neuromorphic systems is concerned with implementations of sensory and neural systems on silicon and mimics the architecture and design of biological neurons. This area offers possibilities to emulate human senses and pattern recognition capabilities and then create so called intelligence.

Example: Synthetic brain project conducted by Dr. Kwabena Boahen

Dr. Boahen is a professor in Department of Bioengineering at Stanford University who received the NIH Director’s Pioneer Award (2006). His main research goal is to design computer chips to mimic how human’s brain works and learn cognitive abilities. They adopted MEMS approaches, such as CMOS and VLSI (very large scale integrated circuit), to mimic neurons with transistors in the electronic medium. They have successfully built a simulation platform called Neurogrid. It is a multi-chip system that consists of 56-by-256 array of silicon neurons in each neurocores, and able to emulate a million neurons in the cortex with computing capability comparable to 200 racks of world famous Blue Gene supercomputers. [6,7]

Other useful websites or links:
Neuromorphic Engineering Links
Center for Neuromorphic Systems Engineering, California Institute of Technology
Institute of Neuroinformatics (INI), University of Zurich, Switzerland


Computational Neuroscience

Computational Neuroscience is an interdisciplinary science aiming to combine the ANNs and neurophysiology and attempting to unravel biological neural networks of the brains. Also, Computational Neuroscience focuses on studying the relationship between functional neurons and their physiology. Therefore, it could provide a better understanding of network behaviors and consciousness development.

Example: Blue brain Project

Lead by IBM and EPFL (Ecole Polytechnique Fédérale de Lausannethe), the project attempts to study the brain and explores how the brain works, which could possibly build accurate models of the brain. In November 2007, they announced the completion of Phase I of the Blue Brain Project to demonstrate a proof-of-principle simulation. Their results of model simulation achieve the biological fidelity with the consistency of neurobiological data, and they claims that the next step is to completely model the entire mammal brain within three years, and a human brain within the next decade. And ultimately the established models will be able to allow neuroscientists to study the brains. [8-10]
Published interview with Dr. Beatrice Bressan [11]

Other useful websites or links:
Other available software to simulate realistic environments for neuron systems constructing:
GENESIS (The GEneral NEural SImulation System)
NEURON
Computational Neuroscience on the World Wide Web
Research groups worldwide


Conclusion

Neural networks possess the ability to learn from examples, which makes them very powerful, and have extended the world of computing and improved a lot for real life application as well. Neural networks also contribute to areas of neuroscience and neurophysiology, which shed the light on mimicking or synthesizing human brains. Future application of neural networks will have more potential when it is integrated with other AI computing approaches, such as fuzzy logics and robotics, and provide the better environment for human life.

Bibliography

1. Müller, Berndt, Joachim Reinhardt, and Michael Thomas Strickland. Neural Networks: An Introduction. 2nd ed. New York: Springer-Verlag, 2002.

2. Lisboa, Paulo J., Emmanuel C. Ifeachor, and Piotr S. Szczepaniak. Artificial Neural Networks in Biomedicine. London: Springer-Verlag, 2000.

3. Krogh, Anders. “What are Artificial Neural Networks?” Nature Biotechnology 26 (2008): 195-197.

4. Carsten, Stephan, Henning Cammann, and Klaus Jung. “Artificial Neural Nnetworks: Has the Time Come for Their Use in Prostate Cancer Patients?” Nature Clinical Practice. Urology 2 (2005): 262-263.

5. Lisboa, Paulo J., and Azzam F.G. Taktak. “The Use of Artificial Neural Networks in Decision Support in Cancer: A Systematic Review” Neural Networks 19 (2006): 408–415.

6. Silver, Rae, Kwabena Boahen, Sten Grillner, Nancy Kopell, and Kathie L. Olsen. “Neurotech for Nneuroscience: Unifying Concepts, Organizing Principles, and Emerging Tools” Journal of Neuroscience 27 (2007):11807-11819.

7. Boahen, Kwabena. “Brains in Silicon.” Department of Bioengineering at Stanford University. 28 Apr. 2008

8. Lynch, Zack. “Blue Brain Project Moves onto Whole Brain, Really?” Corante.com 28 Nov. 2007. 26 Apr. 2008. 2007/11/28/ blue_brain_project_moves_onto_whole_brain_really.php>

9. MArkram, Henry. “The Blue Brain Project.” Nature Reviews Neuroscience 7 (2006): 153-160.

10. Blue Brain Project. 2008. IBM and EPFL 20 Apr. 2008

11. Bressan, Beatrice. “The Greatest Challenge: Computing the Brain.” Interview. Cerncourier.com 20 Aug. 2007