Skip to main content

A graph-theoretic approach to multitasking

Author(s): Alon, Noga; Reichman, Daniel; Shinkar, Igor; Wagner, Tal; Musslick, Sebastian; et al

Download
To refer to this page use: http://arks.princeton.edu/ark:/88435/pr14q9s
Abstract: © 2017 Neural information processing systems foundation. All rights reserved. A key feature of neural network architectures is their ability to support the simultaneous interaction among large numbers of units in the learning and processing of representations. However, how the richness of such interactions trades off against the ability of a network to simultaneously carry out multiple independent processes - a salient limitation in many domains of human cognition - remains largely unexplored. In this paper we use a graph-theoretic analysis of network architecture to address this question, where tasks are represented as edges in a bipartite graph G = (A ⊃ B,E). We define a new measure of multitasking capacity of such networks, based on the assumptions that tasks that need to be multitasked rely on independent resources, i.e., form a matching, and that tasks can be multitasked without interference if they form an induced matching. Our main result is an inherent tradeoff between the multitasking capacity and the average degree of the network that holds regardless of the network architecture. These results are also extended to networks of depth greater than 2. On the positive side, we demonstrate that networks that are random-like (e.g., locally sparse) can have desirable multitasking properties. Our results shed light into the parallel-processing limitations of neural systems and provide insights that may be useful for the analysis and design of parallel architectures.
Publication Date: 1-Jan-2017
Citation: Alon, N, Reichman, D, Shinkar, I, Wagner, T, Musslick, S, Cohen, JD, Griffiths, TL, Dey, B, Ozcimder, K. (2017). A graph-theoretic approach to multitasking. Advances in Neural Information Processing Systems, 2017-December (2101 - 2110)
ISSN: 1049-5258
Pages: 2101 - 2110
Type of Material: Journal Article
Journal/Proceeding Title: Advances in Neural Information Processing Systems
Version: Final published version. This is an open access article.



Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.