Deep learning is a popular topic among machine learning researchers nowadays, with great strides being made in recent years to develop robust artificial neural networks for faster convergence to a reasonable accuracy. Network architecture and hyperparameters of the model are fundamental aspects of model convergence. One such important parameter is the initial values of weights, also known as weight initialization. In this paper, we perform two research tasks concerned with the weights of neural networks. First, we develop three novel weight initialization algorithms inspired by the neuroscientific construction of the mammalian brains and then test them on benchmark datasets against other algorithms to compare and assess their performance. We call these algorithms the lognormal weight initialization, modified lognormal weight initialization, and skewed weight initialization. We observe from our results that these initialization algorithms provide state-of-the-art results on all of the benchmark datasets. Second, we analyze the influence of training an artificial neural network on its weight distribution by measuring the correlation between the quantitative metrics of skewness and kurtosis against the model accuracy using linear regression for different weight initializations. Results indicate a positive correlation between network accuracy and skewness of the weight distribution but no affirmative relation between accuracy and kurtosis. This analysis provides further insight into understanding the inner mechanism of neural network training using the shape of weight distribution. Overall, the works in this paper are the first of their kind in incorporating neuroscientific knowledge into the domain of artificial neural network weights.
The paper stresses the universal role that Cellular Nonlinear Networks (CNNs) are assuming today. It is shown that the dynamical behavior of 3D CNN-based models allows us to approach new emerging problems, to open new research frontiers as the generation of new geometrical forms and to establish some links between art, neuroscience and dynamical systems.
In nonlinear systems, where explicit analytic solutions usually cannot be found, visualization is a powerful approach which can give insights into the dynamical behavior of models; it is also crucial for teaching this area of mathematics. In this paper, we present new software, Fireflies, which exploits the power of graphical processing unit (GPU) computing to produce spectacular interactive visualizations of arbitrary systems of ordinary differential equations. In contrast to typical phase portraits, Fireflies draws the current position of trajectories (projected onto 2D or 3D space) as single points of light, which move as the system is simulated. Due to the massively parallel nature of GPU hardware, Fireflies is able to simulate millions of trajectories in parallel (even on standard desktop computer hardware), producing “swarms” of particles that move around the screen in real-time according to the equations of the system. Particles that move forwards in time reveal stable attractors (e.g. fixed points and limit cycles), while the option of integrating another group of trajectories backwards in time can reveal unstable objects (repellers). Fireflies allows the user to change the parameters of the system as it is running, in order to see the effect that they have on the dynamics and to observe bifurcations. We demonstrate the capabilities of the software with three examples: a 2D “mean field” model of neuronal activity, the classical Lorenz system, and a 15D model of three interacting biologically realistic neurons.
Symmetries in the external world constrain the evolution of neuronal circuits that allow organisms to sense the environment and act within it. Many small “modular” circuits can be viewed as approximate discretizations of the relevant symmetries, relating their forms to the functions they perform. The recent development of a formal theory of dynamics and bifurcations of networks of coupled differential equations permits the analysis of some aspects of network behavior without invoking specific model equations or numerical simulations. We review basic features of this theory, compare it to equivariant dynamics, and examine the subtle effects of symmetry when combined with network structure. We illustrate the relation between form and function through examples drawn from neurobiology, including locomotion, peristalsis, visual perception, balance, hearing, location detection, decision-making, and the connectome of the nematode Caenorhabditis elegans.
Many systems of partial differential equations (PDEs) have been proposed as simplified representations of complex collective behaviors in large networks of neurons. In this survey, we briefly discuss their derivations and then review the mathematical methods developed to handle the unique features of these models, which are often nonlinear and nonlocal. The first part focuses on parabolic Fokker–Planck equations: the Nonlinear Noisy Leaky Integrate and Fire neuron model, stochastic neural fields in PDE form with applications to grid cells and rate-based models for decision-making. The second part concerns hyperbolic transport equations, namely, the model of the Time Elapsed since the last discharge and the jump-based Leaky Integrate and Fire model. The last part covers some kinetic mesoscopic models, with particular attention to the kinetic Voltage-Conductance model and FitzHugh–Nagumo kinetic Fokker–Planck systems.
Background: Isometric exercise is important to cardiac rehabilitation, but understanding how different tasks can interfere with the Heart Rate Variability (HRV) still needs some clarification. Objective: To compare the Autonomic Nervous System (ANS) behavior during submaximal isometric tasks involving different muscle groups. Methods: Six healthy males (21±2 years old) performed two submaximal isometric tasks (30%) of knee extension and handgrip, sustained for 3min each, using visual feedback to maintain force levels. Successive RR intervals were recorded along the task, as well as for 5min before the task. Linear and nonlinear methods were used to obtain HRV parameters from successive RR intervals. Student t test was used to compare the data with significant level set as p<0.05. Results: Time domain parameters as well as the nonlinear parameters were significantly higher during the handgrip task. Conclusions: Submaximal isometric handgrip task is associated with a lower vagal withdrawal, when compared to submaximal isometric knee extension, suggesting that handgrip task promotes greater cardioprotection during exercise, while the isometric knee extension task could induce better adaptations to training.
Australia Announces Funding for Cutting Edge Biotechnology.
Australian Plant Research Facility Enables World Class Research.
China-UN Joint Project to Improve Agriculture Product Processing.
World Bank Lends China US$104 Million for Anti-TB Program.
Taking Singapore Ahead in the Realm of Neuroscience.
Stem Cell Expert Moves to Singapore.
Singapore to Set up New Bioengineering Institute.
Thailand Bids for More Rice Export Quota to China.
Collaboration of the Two Giants—A*STAR and RIKEN.
Duke's Perspective—The New Graduate Medical School in Singapore.
Singapore Life Sciences Sector Benefits from India's Patent Laws.
Mu-ming Poo: The Janusian Neurobiologist.
MVA: A promising viral vector platform for Asian Infectious Diseases.
International, Scientific, Environmental and Analytical Technology Business Event at Suntec, Singapore.
INDIA – Bioven starts BV-NSCLC-001 Phase III trial in NSCLC.
INDIA – Initiative in Chemical Biology and Therapeutics.
PHILLIPPINES – Asia–Pacific Analysis: The slow road to green energy.
SINGAPORE – Takeda progressing well in Asia with New Drug Applications.
SINGAPORE – NTU and University of Warwick boost brainpower in global neuroscience research.
THAILAND – Thai PhD. student awarded Monsanto's Beachell–Borlaug International Scholarship for rice improvement research.
EUROPE – Open access will change the world, if scientists want it to.
UNITED STATES & CANADA – Verisante places Aura Beta Units for safety, verification testing in B.C., Alberta and Ontario clinics.
UNITED STATES & CANADA – Life Technologies sets new worldwide standard for criminal forensic testing with introduction of GlobalFilerTM Express Kit.
UNITED STATES & CANADA – How immune cells can nudge nerves to regrow.
UNITED STATES & CANADA – Improved Genomic Target Selection Using IDT Oligos.
UNITED STATES & CANADA – US team uncover non-invasive method for diagnosing epilepsy.
2013 – A Year of Access, Convergence and Technology.
The Chinese Boom – Predictions for 2013.
The IVD Market from an Investor's Perspective.
Changing Paradigms of the Pharma Industry: Global Economy or Tougher Regulatory Standards to Blame?
Neuroscience – The Search Continues.
Neuroscience and the Law.
Neurological Impairment and the Capacity to Consent to Participate in Research.
Ethical Responsibility to Manage Incidental Findings in Brain Imaging Research.
The Impact of Discrimination on Research into Depression.
SINGAPORE – IBN Executive Director Professor Jackie Y. Ying Elected Fellow of the American Association for the Advancement of Science.
SINGAPORE – NUS Researchers Develop Highly Efficient Nature-inspired Membrane that Can Potentially Lower Cost of Water Purification by 30 per cent.
SINGAPORE – APACMed Implements Universal Code of Ethical Conduct for Corporate Members.
CANADA – Victoza(R) (liraglutide) provides greater glycaemic control than SGLT-2 inhibitors.
UNITED STATES – Neuroscientists Now Can Read the Mind of a Fly.
UNITED STATES – Composting Food Waste remains your Best Option, new study says.
UNITED STATES – How Music and Language Shape the Brain.
UNITED KINGDOM – Cypralis Limited Announces Collaboration with Johnson & Johnson Innovation in the field of Neurodegenerative Diseases.
JAPAN – Avantium reserves capacity in its first FDCA production plant for Mitsui.
JAPAN – Takeda, Kyoto University start joint research on iPS drugs targeting six maladies.
GE Healthcare Life Sciences take part in Life-Saving, Olivier Loeillot (GM of Bioprocess Asia).
Cennerv Pharma: A Company that Fights Along with Mental Illnesses.
How Can Cord Blood be Used to Save Lives? Life-Saving Mission of SCBB: An Interview with Dr. William Hwang.
An Interview with Mr. Stephen Ooi, Senior Executive Advisor Zimmer Biomet Asia Pacific.
APACMed – Serving Unmet Healthcare Needs in Asia Pacific, Fredrik Nyberg (CEO of APACMed).
Vaccination, One of the Solutions to Prevent Dengue Infection.
MonaLisa Touch® Advanced Laser Treatment for Better Life Quality.
Mundipharma and Helsinn Group Expand Exclusive Licensing and Distribution Agreements for Leading Anti-emetic Products in Middle East, Africa, Latin America and Indonesia.
Leading Regional Medical Technology Trade Associations Reinforce their Commitment to Evidence-based Healthcare.
Lonza Expands Airway Disease Portfolio with Addition of IPF Airway Cells.
Boston Scientific Launches Interventional Cardiology Online Education Portal for Physicians.
Pfizer Presented Data from PALOMA-2 Phase 3 Study Demonstrating Clinical Benefit of IBRANCE® (palbociclib) in Asian Women with ER+, HER2- Metastatic Breast Cancer.
Global Healthcare Systems at Pivotal Point as Technology Offers Solutions to Industry Challenges – The Economist Intelligence Unit.
Cellectricon and Censo Biotechnologies Introduce a Joint Technology Access Program Utilizing High-Quality Human iPSC-based Discovery Services for CNS and Pain Research.
Healthcare heads into the digital future.
Digital technology improves research and management of functional gastrointestinal disorders in babies.
Welcome to the healthcare revolution.
Doctor Robot will see you now.
Maximising human potential in the age of AI.
The Internet of Things in healthcare - A double-edged sword?.
Data could help Asia cope with its ageing population.
A vision of connected healthcare delivery in Asia.
The following topics are under this section:
For the month of August 2020, APBN explores the wonders of the human brain and how researchers and scientists are leveraging on technological advancements to gain insights to its inner mechanisms. In the Columns section, scientists from ACT Genomics discuss the topic of Precision Oncology and patient selection for PARP inhibitor treatment in BRCA- & HRR-associated cancers. This month APBN interviewed Dr Ling Kai Yi, co-founder and Chief Science/Technology Officer of Singapore-based clean meat company, ShiokMeats to take a closer look at how the team is fighting for sustainability in the seafood industry.
For the months of September and October 2022, APBN looks at toxins from the natural world and consider its benefits to humanity despite the negative connotation.
First up, we have a contribution from Vanessa Lunardi on snake venoms in venom therapy. Then Tara Ng dives into plant secondary metabolites, its properties, and potential applications.
While not wholly related to venom therapy, Chang Wei and Dr Mohd Redzwan Sabran from the University of Putra Malaysia, discuss a family of fungal toxins called aflatoxins, its toxic effects, and how probiotics might have aflatoxin-reducing properties.
Other highlights in this issue include a column by Dr Chen Min Wei, Consultant Surgeon from the National Neuroscience Institute, and Samuel Choo, Co-Founder and Head of Product at Kyalio, on how immersive virtual reality is bridging the gap between studying and performing surgery, and an interview with Andreas Joergensen, Managing Director of the SEA Cluster at Organon, on women’s healthcare and reproductive health awareness in Asia.
Weak electrical noise applied in the water around small paddlefish, Polyodon spathula, increases the spatial range over which they can detect and capture planktonic prey (Daphnia), demonstrating stochastic resonance at the level of an animal's feeding behavior. Here we show that optimal-amplitude (~ 0.5 μ V·cm-1) noise causes a fish to prefer more vertical angles of attack when striking at prey, as revealed in polar graphs. Increased spatial range is also seen in horizontal directions, as outlying shoulders in the probability distribution of horizontal strike distances. High levels of noise increased the distance that approaching prey travelled along the rostrum (an elongated appendage anterior to the head, functioning as an electrosensitive antenna), before the fish first showed a visible fin or body motion in response. There was no significant effect of optimal-amplitude noise on the rate of strikes, although high-amplitude noise reduced the strike rate. The behavioral data were confirmed in neurophysiological experiments demonstrating that stochastic resonance occurs in individual electroreceptors, and in fact occurs at a similar optimal noise level as in behavioral experiments. We conclude that stochastic resonance can be demonstrated in the behavior of animals, and that animals can make use of the increased sensory information available during near-threshold environmental noise.
Please login to be able to save your searches and receive alerts for new content matching your search criteria.