NERV

In this talk, Frans Cronje will be speaking about the journey towards autonomous manufacturing. He will demonstrate how artificial intelligence (AI) can be implemented to achieve a reduction in poor quality costs in manufacturing. The talk will showcase the power of applied AI.

The efficacy of images to create quantitative measures of urban perception has been explored in psychology, social science, urban planning and architecture over the last 50 years. The ability to scale these measurements has become possible only in the last decade, due to increased urban surveillance in the form of street view and satellite imagery, and the accessibility of such data. This talk will present a series of projects which make use of imagery and CNNs to predict, measure and interpret the social and physical environments of our cities.

Computer AI thinks differently from us, which is why it's such a useful tool. Thanks to the ingenuity of human programmers, AI's different method of thinking has made humans redundant at certain human tasks, such as chess. Yet there are mechanical limits to how far AI can replicate the products of human thinking. In this talk, we'll trace one such limit by exploring how AI and humans create differently. Humans create by reverse-engineering tools or behaviors to accomplish new actions. AI creates by mix-and-matching pieces of preexisting structures and labeling which combos are associated with positive and negative results. This different procedure is why AI cannot (and will never) learn to innovate technology or tactics and why it also cannot (and will never) learn to generate narratives (including novels, business plans, and scientific hypotheses). It also serves as a case study in why there's no reason to believe in "general intelligence" and why computer AI would have to partner with other mechanical forms of AI (run on non-computer hardware that, as of yet, does not exist, and would require humans to invent) for AI to take over the globe.

Does that title put you to sleep or pique your interest? The goal of my presentation is to introduce a powerful yet under-utilized mathematical equation that is surprisingly effective at uncovering spatiotemporal patterns that are embedded in data -- but that might be inaccessible in traditional analysis methods due to low SNR or sparse spatial distribution. If you flunked calculus, then don't worry: the math is really easy, and I'll spend most of the time discussing intuition, simulations, and applications in real data. I will also spend some time in the beginning of the talk providing a bird's-eye-view of the empirical research in my lab, which focuses on mesoscale brain dynamics associated with error monitoring and response competition.

To understand how the brain can perform complex tasks such as perception, we have to understand how information enters the brain, how it is transformed and how it is transferred. But, how do we measure information transfer in the brain? This presentation will start with a general introduction of what mutual information is and how to measure it in an experimental setup. Next, the talk will focus on how this can be used to develop brain models at different (spatial) levels, from the microscopic single neuron level to the macroscopic network and behavioural level. How can we incorporate the knowledge about single neurons, that already show complex dynamics, into network activity and link this to behaviour?

The cerebellum contains more than half of the brain’s neurons and it is essential for motor control. Its neural circuits have a distinctive architecture comprised of a large, sparse expansion from the input mossy fibres to the granule cell layer. For years, theories of how cerebellar architectural features relate to cerebellar function have been formulated. It has been shown that some of these features can facilitate pattern separation. However, these theories don’t consider the need for it to learn fast in order to control smooth and accurate movements. Here, we confront this gap. This talk will show that the expansion to the granule cell layer in the cerebellar cortex improves learning speed and performance in the context of motor control by considering a cerebellar-like network learning an internal model of a motor apparatus online. By expressing the general form of the learning rate for such a system, this talk will provide a calculation of how increasing the number of granule cells diminishes the effect of noise and increases the learning speed. The researchers propose that the particular architecture of cerebellar circuits modifies the geometry of the error function in a favourable way for learning faster. Their results illuminate a new link between cerebellar structure and function.

This talk will focus on different aspects of the Local Field Potential (LFP) signal. Classically, LFP fluctuations are related to changes in the functional state of the cortex. Yet, the mechanisms linking LFP changes with the state of the cortex are not well understood. The presentation will start with a brief explanation of the main oscillatory components of the LFP signal, how these different oscillatory components are generated at cortical microcircuits, and how their dynamics can be studied across multiple areas. Thereafter, a case study of a patient with akinetic mutism will be presented, linking cortical states with the behavior of the patient, as well as some preliminary results about how the LF cortical microcircuit dynamic changes modulate different cortical states and how these changes are reflected in the LFP signal

Distinct synapses influence one another when they undergo changes, with unclear consequences for neuronal dynamics and function. Here we show that synapses can interact such that excitatory currents are naturally normalised and balanced by inhibitory inputs. This happens when classical spike-timing dependent synaptic plasticity rules are extended by additional mechanisms that incorporate the influence of neighbouring synaptic currents and regulate the amplitude of efficacy changes accordingly. The resulting control of excitatory plasticity by inhibitory activation, and vice versa, gives rise to quick and long-lasting memories as seen experimentally in receptive field plasticity paradigms. In models with additional dendritic structure, we observe experimentally reported clustering of co-active synapses that depends on initial connectivity and morphology. Finally, in recurrent neural networks, rich and stable dynamics with high input sensitivity emerge, providing transient activity that resembles recordings from the motor cortex. Our model provides a general framework for codependent plasticity that frames individual synaptic modifications in the context of population-wide changes, allowing us to connect micro-level physiology with behavioural phenomena.

Multi-agent reinforcement learning (MARL) has recently shown great promise as an approach to networked system control. Arguably, one of the most difficult and important tasks for which large scale networked system control is applicable is common-pool resource (CPR) management. Crucial CPRs include arable land, fresh water, wetlands, wildlife, fish stock, forests and the atmosphere, of which proper management is related to some of society’s greatest challenges such as food security, inequality and climate change. This talk will consist of three parts. In the first, we will briefly look at climate change and how it poses a significant threat to life on our planet. In the second, we will consider the potential of multi-agent systems for climate change mitigation and adaptation. And finally, in the third, we will discuss recent research from InstaDeep into better understanding the behaviour of networked MARL systems used for CPR management. More specifically, we will see how the tools from empirical game-theoretic analysis may be harnessed to analyse the differences in networked MARL systems. The results give new insights into the consequences associated with certain design choices and provide an additional dimension of comparison between systems beyond efficiency, robustness, scalability and mean control performance.

The work to be presented in this talk proposes a novel framework seamlessly providing key properties of both neural nets (learning) and symbolic logic (knowledge and reasoning). Every neuron has a meaning as a component of a formula in a weighted real-valued logic, yielding a highly interpretable disentangled representation. Inference is omnidirectional rather than focused on predefined target variables, and corresponds to logical reasoning, including classical first-order logic theorem proving as a special case. The model is end-to-end differentiable, and learning minimizes a novel loss function capturing logical contradiction, yielding resilience to inconsistent knowledge. It also enables the open-world assumption by maintaining bounds on truth values which can have probabilistic semantics, yielding resilience to incomplete knowledge.

Non-traumatic brain injury due to stroke, cerebral palsy and HIV often result in serious long-term disability worldwide, affecting more than 150 million persons globally; with the majority of persons living in low and middle income countries. These diseases often result in varying levels of motor and cognitive impairment due to brain injury which then affects the person’s ability to complete activities of daily living and fully participate in society. Increasingly advanced technologies are being used to support identification, diagnosis, assessment, and therapy for patients with brain injury. Specifically, robot and mechatronic systems can provide patients, physicians and rehabilitation clinical providers with additional support to care for and improve the quality of life of children and adults with motor and cognitive impairment. This talk will provide a brief introduction to the area of rehabilitation robotics and, via case studies, illustrate how computer/technology-assisted rehabilitation systems can be developed and used to assess motor and cognitive impairment, detect early evidence of functional impairment, and augment therapy in high and low-resource settings.

The possibilities of machine learning and neural networks in particular are ever expanding. With increased opportunities to do good, however there are just as many opportunities to do harm and even in the case that good intentions are at the helm, evidence suggests that opportunities for good may eventually prove to be the opposite. The greatest threat to what machine learning is able to achieve and to us as humans, is machine learning that does not reflect the diversity of the users it is meant to serve. It is important that we are not so pre-occupied with advancing technology into the future that we have not taken the time to invest the energy into engineering the security measures this future requires. It is important to investigate now, as thoroughly as we investigate differing deep neural network architectures, the complex questions regarding the fact that humans and the society in which they operate is inherently biased and loaded with prejudice and that these traits find themselves in the machines we create (and increasingly allow to run our lives).

The question of free will has been topical for millennia, especially considering its links to moral responsibility and the ownership of that responsibility. Free will, or volition, is an incredibly complex phenomenon - and cannot easily be reduced to a single empirical paradigm. Roskies (2010) proposes that there are five cognitive aspects to be considered when developing a more complete understanding of volition. These are: intention, initiation, feeling, executive control and decision-making. Decision-making will be the focus of this talk, which steps through aspects of the philosophy of free will; highlights experimental paradigms stemming from the seminal work of Benjamin Libet et al., and proposes machine learning as a promising method in progressing the empirical studies of decision-making and free will.

Cases with visuospatial abnormalities provide opportunities for understanding the underlying cognitive mechanisms. Three cases of visual mirror-reversal have been reported: AH (McCloskey, 2009), TM (McCloskey, Valtonen, & Sherman, 2006) and PR (Pflugshaupt et al., 2007). This research reports a fourth case, BS -- with focal occipital cortical dysgenesis -- who displays highly unusual visuospatial abnormalities. They initially produced mirror reversal errors similar to those of AH, who -- like the patient in question -- showed a selective developmental deficit. Extensive examination of BS revealed phenomena such as: mirror reversal errors (sometimes affecting only parts of the visual fields) in both horizontal and vertical planes; subjective representation of visual objects and words in distinct left and right visual fields; subjective duplication of objects of visual attention (not due to diplopia); uncertainty regarding the canonical upright orientation of everyday objects; mirror reversals during saccadic eye movements on oculomotor tasks; and failure to integrate visual with other sensory inputs (e.g., they feel themself moving backwards when visual information shows they are moving forward). Fewer errors are produced under conditions of certain visual variables. These and other findings have led the researchers to conclude that BS draws upon a subjective representation of visual space that is structured phenomenally much as it is anatomically in early visual cortex (i.e., rotated through 180 degrees, split into left and right fields, etc.). Despite this, BS functions remarkably well in their everyday life, apparently due to extensive compensatory mechanisms deployed at higher (executive) processing levels beyond the visual modality.

The Georgia Tech Brain Music Lab is a community gathered around a unique facility combining EEG and other physiological measurement techniques with new music technologies. Their mission is to engage in research and creative practice that brings health and well-being. This talk will present an overview of the activities at the Brain Music Lab, including sonification of physiological signals, acoustic design for health and well-being, therapeutic applications of musical stimulation, and brain-body music performance.

David Chalmers’s (1995) hard problem famously states: “It is widely agreed that experience arises from a physical basis, but we have no good explanation of why and how it so arises.” Thomas Nagel (1974) wrote something similar: “If we acknowledge that a physical theory of mind must account for the subjective character of experience, we must admit that no presently available conception gives us a clue about how this could be done.” This presentation will point the way towards the long-sought “good explanation” -- or at least it will provide “a clue”. I will make three points: (1) It is unfortunate that cognitive science took vision as its model example when looking for a ‘neural correlate of consciousness’ because cortical vision (like most cognitive processes) is not intrinsically conscious. There is not necessarily ‘something it is like’ to see. (2) Affective feeling, by contrast, is conscious by definition. You cannot feel something without feeling it. Moreover, affective feeling, generated in the upper brainstem, is the foundational form of consciousness: prerequisite for all the higher cognitive forms. (3) The functional mechanism of feeling explains why and how it cannot go on ‘in the dark’, free of any inner feel. Affect enables the organism to monitor deviations from its expected self-states in uncertain situations and thereby frees homeostasis from the limitations of automatism. As Nagel says, “An organism has conscious mental states if and only if there is something that it is like to be that organism—something it is like for the organism.” Affect literally constitutes the sentient subject.

The Neural Engineering Framework has been used to create a wide variety of biologically realistic brain simulations that are capable of performing simple cognitive tasks (remembering a list, counting, etc.). This includes the largest existing functional brain model. This talk will describe this method, and show some examples of using it to take high-level cognitive algorithms and convert them into a neural network that implements those algorithms. Overall, this approach gives us new ways of thinking about how the brain works and what sorts of algorithms it is capable of performing.

In his bestseller 'Thinking, Fast and Slow', Daniel Kahneman popularized the idea that there are two fundamentally different process of thought: a 'System 1' process that is unconscious and instinctive, and a 'System 2' process that is deliberative and requires conscious attention. There is a growing recognition that machine learning is mostly stuck at the 'System 1' level of cognition, and that moving to 'System 2' methods are key to solving long-standing challenges such as out-of-distribution generalization. In this talk, AlphaZero will be used as a case-study of the power of combining 'System 1' and 'System 2' processes. The similarities and differences between AlphaZero and human learning will be explored, along with drawing lessons for the future of machine learning.