Treffer: Queuing Network Modeling of the Psychological Refractory Period (PRP)
CC BY 4.0
Sauf mention contraire ci-dessus, le contenu de cette notice bibliographique peut être utilisé dans le cadre d’une licence CC BY 4.0 Inist-CNRS / Unless otherwise stated above, the content of this bibliographic record may be used under a CC BY 4.0 licence by Inist-CNRS / A menos que se haya señalado antes, el contenido de este registro bibliográfico puede ser utilizado al amparo de una licencia CC BY 4.0 Inist-CNRS
FRANCIS
Weitere Informationen
The psychological refractory period (PRP) is a basic but important form of dual-task information processing. Existing serial or parallel processing models of PRP have successfully accounted for a variety of PRP phenomena; however, each also encounters at least 1 experimental counterexample to its predictions or modeling mechanisms. This article describes a queuing network-based mathematical model of PRP that is able to model various experimental findings in PRP with closed-form equations including all of the major counterexamples encountered by the existing models with fewer or equal numbers of free parameters. This modeling work also offers an alternative theoretical account for PRP and demonstrates the importance of the theoretical concepts of queuing and hybrid cognitive networks in understanding cognitive architecture and multitask performance.
Queuing Network Modeling of the Psychological Refractory Period (PRP)
<cn> <bold>By: Changxu Wu</bold>>
> <bold>Yili Liu</bold>
>
<bold>Acknowledgement: </bold>Changxu Wu is now at the Department of Industrial and Systems Engineering, State University of New York at Buffalo.We appreciate the support from the National Science Foundation (NSF) for this work (NSF Grant 0308000).
Performing multiple tasks at the same time is common in daily life; for example, drivers can steer a car and at the same time talk with friends in the car, and telephone operators can answer customer phone calls and type textual information into a computer. Among the wide range of multiple task situations, the psychological refractory period (PRP) is one of the most basic and simplest forms of a dual-task situation. In a PRP experiment, two reaction-time (RT) tasks are presented close together in time, and participants are asked to perform the two tasks as quickly as possible. Typically, participants' response to the second of the two RT tasks is performed more slowly than to the first when the interval between the presentation times of these two tasks is short. PRP has been studied in laboratories over 100 years, from the behavioral (Creamer, 1963; Kantowitz, 1974; Oberauer & Kliegl, 2004; Pashler, 1984, 1994b; Schumacher et al., 1999; Solomons & Stein, 1896; Welch, 1898; Welford, 1952) to the neurological level (Jiang, Saxe, & Kanwisher, 2004; Sommer, Leuthold, & Schubert, 2001). It is also the subject of extensive theoretical work and the focal point of an important theoretical controversy between several computational models of cognition. There are several important cognitive models of PRP, including the response-selection bottleneck (RSB) or central bottleneck model proposed by Pashler (1984, 1990, 1994a, 1994b, 1994c), the executive-process interactive control (EPIC) model proposed by Meyer and Kieras (1997a, 1997b), and the model based on the ACT-R/perceptual-motor system (ACT-R/PM) proposed by Byrne and Anderson (2001). Each of these models is able to account for some of the important aspects of PRP; however, each appears to encounter at least one experimental counterexample to its predictions (Jiang et al., 2004; Meyer & Kieras, 1997a, 1997b; Oberauer & Kliegl, 2004; Ruthruff, Pashler, & Klaassen, 2001). Therefore, the questions remain about how to model these experimental results, provide a unified account of the discoveries in behavioral and neuroscience studies, and gain further insights into the mechanisms of dual-task performance.
This article takes further steps toward addressing these important questions with a queuing network-based computational cognitive architecture (Liu, 1996, 1997; Liu, Feyen, & Tsimhoni, 2006; Wu & Liu, 2007a, 2007b, 2008; Wu, Liu, & Walsh, in press; Wu, Tsimhoni, & Liu, in press). First, we introduce the major experimental results in PRP studies and the major PRP effects. Second, the major existing models of PRP are described, including their advantages and their counterexamples. Third, we describe the queuing network model, including its major assumptions and components. In the fourth section, we describe how the queuing network model mathematically accounts for and theoretically explains the PRP phenomena. Finally, we discuss the implications of the model, as well as its extension in future research.
EXPERIMENTAL STUDIES IN PRP
>
In the following section, we introduce the major findings in experimental studies of PRP, including the basic PRP experiment paradigm and the major PRP effects that have been the subject of theoretical controversy—the subadditive difficulty effect, the response grouping effect, the practice effect, and brain imaging patterns in PRP.
<h31 id="rev-115-4-913-d71e213">Basic PRP Experiment Paradigm</h31>The basic PRP experiment paradigm requires the participants to perform two tasks called Task 1 (T1) and Task 2 (T2) concurrently. The delay between the presentation of the stimuli of T1 and T2 is called the stimulus onset asynchrony (SOA). Two stimuli (S1 and S2) are presented to the participants in rapid succession, and each requires a quick response (R1 and R2). RT of each task (RT1 and RT2) is measured from the time when the stimulus is presented to the time when the corresponding response is made. In the basic PRP paradigm in which the tasks are choice RT tasks and participants do not receive extensive practice on the dual task, responses to S1 typically are unimpaired, but responses to S2 are slowed by 200–300 ms or more in the short SOA conditions. For instance, Figure 1 shows the experimental results of the basic PRP paradigm in Schumacher et al. (1999).
>
><anchor name="fig1"></anchor>
Schumacher et al.'s (1999) study consisted of a series of PRP experiments, of which their Experiments 3 and 4 are described here for illustration and modeling purposes. T1 was an auditory–manual task in Experiment 3 but an auditory–vocal task in Experiment 4. Participants heard either a low- or a high-pitched tone and responded by pressing the left middle or the left index finger on a keypad, respectively (Experiment 3), or making a corresponding vocal response (Experiment 4). T2 was always a visual–manual task involving compatible or incompatible situations. In each trial of T2, an
Several PRP experiments (Hawkins, Rodriguez, & Reicher, 1979; Karlin & Kestenbaum, 1968; Schumacher et al., 1999; Sommer et al., 2001) have found that if the difficulty level of T2 at its central processing stage (i.e., at the response-selection stage occurring after the perceptual stage and before the motor stage) is manipulated, the difference of RT2 between the easy and the hard T2s in the short SOA conditions is smaller than that in the long SOA conditions. This pattern or effect is called the subadditive difficulty effect.
<bold>Schumacher et al.'s (1999) Study</bold>
The subadditive difficulty effect appeared in Experiments 3 and 4 of Schumacher et al.'s (1999) study described above, in which the level of difficulty of T2 was manipulated via the degree of stimulus–response compatibility in T2. In both experiments, Schumacher et al. found a subadditive interaction between the SOA and the response-selection difficulty on the mean RTs of T2, showing the subadditive difficulty effect.
<bold>Hawkins, Rodriguez, and Reicher's (1979) Study</bold>
The subadditive difficulty effect can also be found in the experimental results of Hawkins et al.'s (1979) study, in which the difficulty level of T2 was manipulated by changing the number of stimuli in a category for making the same response. In the easy T2 condition, the stimuli were the digits
<bold>Karlin and Kestenbaum's (1968) Study</bold>
Karlin and Kestenbaum (1968) found the subadditive difficulty effect by manipulating the difficulty level of T2 via changing the number of stimulus–response pairs—one was a simple reaction task, and the other was a two-choice reaction task. In their experiment, T1 was a visual–manual task: Participants were asked to respond to the digits (
>
><anchor name="fig2"></anchor>
<bold>Sommer et al.'s (2001) Study</bold>
Sommer et al. (2001) replicated Karlin and Kestenbaum's (1968) experiment and used one of the electrophysiological measurements—the event-related potential (ERP) techniques—to measure stimulus-lateralized readiness potential (S-LRP), which is a measure of response preparation or activation at the cerebral motor cortex, including the premotor cortex (Sommer et al., 2001; Wildgruber, Ackermann, & Grodd, 2001). They not only found the subadditive difficulty results in RT but also found that when T2 was a simple reaction task, there was an early onset of S-LRP before S2 was presented (its onset time was 15 ms before S2 was presented), which meant that the motor component of the cognitive system started to prepare the processing of S2 before it was presented. Moreover, their results showed that the percentage of negative RT2s (RT2 < 0 ms) increased with an increase in the SOA, which was consistent with the results of another study (Van Selst & Jolicoeur, 1997) that showed the same pattern of result.
<h31 id="rev-115-4-913-d71e327">Brain Imaging Patterns (Jiang et al., 2004)</h31>
Jiang et al. (2004) conducted the first functional magnetic resonance imaging (fMRI) study that followed the experimental paradigm of PRP and tested a large number of participants in an effort to find neural correlates of the basic PRP with fMRI techniques. They did not find any increase in activation in the brain regions corresponding to executive control in the short SOA conditions compared with the long SOA conditions. In their experiment, both T1 and T2 were visual–manual two-choice reaction tasks. In T1, squares or circles were presented on a display, and participants pressed with the left hand
Ruthruff, Pashler, and Klaassen (2001) designed a new PRP experiment paradigm in which the stimuli of T1 and T2 were presented at the same time (SOA = 0) with equal emphasis and the participants were asked to emit both responses at the same time (i.e., grouping the responses; the corresponding finding is called the response grouping effect in this article). They found that RT1 and RT2 in the dual-task situations were significantly longer than those in the single-task situations. In their experiment, one of the two tasks was a tone-counting task—participants were asked to count the number of tones (one or two). In the easy version, the participants vocally reported this number aloud; in the hard version, they vocalized the opposite number aloud (i.e., they reported “two” if they heard one tone and “one” if they heard two tones). The other task was a spatial working memory task—participants responded whether upside-down letter stimuli were normal or mirror images by pressing the
In Oberauer and Kliegl's (2004) experimental study, one experimental task was a spatial working memory task. Spatial operations were indicated by red arrows with a length of 2.5 cm, displayed in the central cell of a 5 × 5 grid and pointing in one of eight possible directions horizontally, vertically, or diagonally. Participants were asked to mentally shift a dot from its current location (Cell 1) to another location (Cell 2) in the indicated direction. Another task was a numerical operations task in which a given digit from
Participants were divided into two practice groups—a single-task and a dual-task practice group. In the single-task practice group, participants practiced only one task at a time, and the two stimuli of the two tasks were never presented at the same time. In the dual-task practice group, the two stimuli of the two tasks were always presented at the same time (SOA = 0). Participants in the single-task and the dual-task groups went through the same number of trials and operations for T1 and T2. Each group received a pretest and a posttest of their performance before and after extensive practice (12 sessions). There were two conditions in each test—a sequential and a simultaneous condition. In the sequential condition, the test started with a complete sequence of operations of one kind (either spatial or numerical, selected at random from trial to trial), followed by the same number of successive operations of the other kind. The maximum RT of the numerical and the spatial tasks was regarded as the RT of the two tasks in this sequential condition. In the simultaneous condition, one numerical operation and one spatial operation were displayed at the same time. RT in the two tasks was the duration between the time when the stimuli of the two tasks appeared on the display and the time when the space bar was hit in each operation. After extensive practice, the PRP effect in the dual-task practice group was much smaller than that in the single-task practice group.
<h31 id="rev-115-4-913-d71e385">Summary of Experimental Results</h31>As a basic form of multitasking, PRP has received extensive attention in experimental psychology because of the vital role it plays in understanding multitasking performance and related cognitive mechanisms. To explore the processing mechanisms underlying the various PRP effects summarized above, one may ask how well these PRP effects can be accounted for by existing cognitive models. After reviewing all of these major PRP effects, we now turn to a review of existing models of PRP, including their assumptions.
EXISTING MODELS OF PRP
>
Over the past decades, several computational models have been developed to model the experimental results in PRP, including the RSB model or central bottleneck model (Pashler, 1984, 1990, 1994a, 1994b, 1994c), the EPIC-strategic response deferment (EPIC-SRD) model (Meyer & Kieras, 1997a, 1997b), and the PRP model based on the ACT-R/PM system (Byrne & Anderson, 2001). Among these representative models, RSB and ACT-R/PM assume serial processing at the cognitive stage, while EPIC-SRD assumes that cognitive processing is parallel. Each of these models has successfully accounted for a number of experimental studies reviewed above; however, it appears that each of them also encounters at least one experimental study as a counterexample to their predictions or modeling mechanisms (see Table 1).
>
><anchor name="tbl1"></anchor>
The RSB model was developed by Pashler (1984, 1990, 1994a, 1994b, 1994c). The basic assumption of the RSB model is that multiple stimuli may be identified simultaneously and stored in short-term memory but that the process of response selection (i.e., converting symbolic stimulus codes to symbolic response codes, also called the central process, cognitive process, or central stage) is able to accommodate only one task at a time.
Overall, the RSB model is a very parsimonious model, and its serial processing assumption at the central stage of cognition is able to explain the experimental result of the basic PRP paradigm (Pashler, 1984a, 1984b, 1989, 1990, 1994a, 1994b, 1994c; Pashler, Johnston, & Ruthruff, 2001; Pashler et al., 1994). According to the RSB model, when the interval between the times when the two tasks reach the central cognition stage is very short, T1 is processed first without affecting its RT, and T2 has to wait for the completion of T1 in the cognition stage. As this time interval increases, the chance that T2 has to wait for the completion of T1 at the cognition stage decreases, producing the basic PRP effect (i.e., RT1 remains as a constant, while RT2 decreases as the SOA increases from 0 and then becomes a constant in the long SOA conditions).
However, two major PRP effects appear to be contradictory to the predictions or assumptions of the RSB model.
First, the subadditive difficulty effect reviewed in the earlier section indicates that if we manipulate the difficulty level of T2 at its central processing stage, the difference of RT2 between the easy and the hard T2s under the short SOA conditions is smaller than that under the long SOA conditions. However, according to the prediction of the RSB model, if the duration of the cognitive process of T2 increases, the difference between the easy and hard T2s under the short SOA conditions should be the same as that under the long SOA conditions (see the detailed description in Byrne & Anderson, 1998).
Second, the practice effect of PRP reported in Oberauer and Kliegl (2004) demonstrates that the dual-task practice group produces smaller PRP effect than the single-task practice group. In Oberauer and Kliegl's study, the dual- and single-task practice groups went through the same number of trials for T1 and T2. Since the PRP effect in the RSB model equals 1A + 1B − 2A − SOA (Pashler & Johnston, 1989)<anchor name="b-fn2"></anchor><sups>2</sups> and the improvement of each single processing stage (1A, 1B, and 2A) is solely determined by the amount of practice of each task (there should be no interaction between any of the terms), each of these terms (1A, 1B, and 2A) decreases with the same magnitude in both the dual- and single-task practice groups. Therefore, on the basis of this prediction of the RSB model, there is no difference in the PRP effect between the dual- and the single-task practice groups after extensive practice. However, Oberauer and Kliegl's study found that the PRP effect in the dual-task practice group was around only 59 ms, which was much smaller than the PRP effect in the single-task practice group (409 ms). The RSB model might have difficulty explaining this relatively large difference (350 ms) in the mean PRP effect between these two groups.
ACT-R/PM was developed by Byrne and Anderson (2001) on the basis of the original structure of ACT-R (Anderson & Lebiere, 1998) and the perceptual and motor part of EPIC. At the central processing stage, ACT-R/PM assumes that cognition is serial. To support this assumption, Byrne and Anderson (2001) conducted a series of experiments that provided evidence that people cannot perform two complex cognitive tasks at the same time. Because the motor part of ACT-R/PM is adapted from EPIC, which assumes serial processing at each motor module, a second serial processing or bottleneck in ACT-R/PM is located at its motor module (movement feature preparation; Byrne & Anderson, 1998).
As one of the major cognitive architectures with applications in various basic and real-world task settings, ACT-P/PM offers an accurate quantification of the basic PRP paradigm and the subadditive difficulty effect in PRP. First, ACT-R/PM simulates the result of the basic PRP paradigm in Karlin and Kestenbaum's (1968) experiment with the bottleneck at the motor module (Byrne & Anderson, 1998). In this simulation, ACT-R/PM acts as the RSB model but with a structural bottleneck in the motor module (motor feature preparation), producing the experimental results in the basic PRP paradigm. Furthermore, the multiple-bottleneck assumption enables ACT-R/PM to model the subadditive difficulty effect in Experiment 3 of Schumacher et al.'s (1999) study with the same multiple-bottleneck mechanism originally proposed by Dejong (1993). ACT-R/PM simulates the subadditive difficultly effect found in Experiment 4 of Schumacher et al.'s study with a scheduling strategy similar to that used in EPIC-SRD (Meyer & Kieras, 1997a, 1997b).<anchor name="b-fn3"></anchor><sups>3</sups>
In Oberauer and Kliegl's (2004) study, within each trial, participants went through a sequence of seven to nine dual-task operations (the stimuli of the dual tasks were presented in the visual and auditory modalities, respectively); however, participants were asked to make one manual response at the end of each trial by hitting the space bar. Therefore, this experiment eliminates the second bottleneck in ACT-R in the motor module, which suggests that ACT-R works in a single bottleneck format like the RSB model in this case. As we described in our discussion of the RSB model's limitation, ACT-R may also have difficulty in accounting for Oberauer and Kliegl's results (a relatively large difference [350 ms] in the mean PRP effect between the single-practice and the dual-practice groups).
<h31 id="rev-115-4-913-d71e533">EPIC-SRD</h31>In contrast to the RSB model, EPIC does not assume a hardware bottleneck in the cognitive process and regards the observed bottleneck in PRP as the result of strategic or voluntary control in the cognitive process as well as serial processing in peripheral motor output processes (i.e., each motor processor processes information in a serial manner; Meyer & Kieras, 1997a, 1997b, 1999). With this architecture, Meyer and Kieras (1997a, 1997b) developed the strategic response deferment (SRD) model (called executive control) to model the PRP phenomena—the executive control in EPIC needs to monitor the progress of both T1 and T2, using scheduling strategies to lock and unlock T1 and T2 in certain processing stages to produce the PRP effects. The strategic scheduling methods of the EPIC-SRD model provide great flexibility and allow the model to simulate several major effects in PRP, for example, the basic PRP and the subadditive difficulty effect as introduced in the previous section. Moreover, EPIC itself is a comprehensive architecture that unifies many findings in psychological studies, and it has been employed to model dual-task performance in both theoretical (Meyer & Kieras, 1997a, 1997b) and applied research (Kieras & Meyer, 1997).
In comparing the EPIC-SRD's basic assumption with the major effects reviewed in the introductory section, it appears that EPIC-SRD also encounters several counterexamples found in the existing experimental studies.
First, the response grouping effect reviewed above (Ruthruff, Pashler, & Klaassen, 2001) might contradict EPIC's prediction. Ruthruff, Pashler, and Klaassen (2001) eliminated the potential strategic postponement bottleneck by emphasizing the two tasks equally, using a 0-ms SOA, and urging participants to emit both responses at the same time. They also eliminated potential perceptual bottleneck by using different perceptual modalities. If there is no strategic bottleneck at the central processing stage, then according to the assumption of EPIC, the central processor should be able to process the information of the two tasks at the same time; furthermore, since there is no other noncentral interference (interferences in perceptual or motor process), dual-task performance should be similar to single-task performance. However, they still found that RT1 and RT2 in the dual-task condition were significantly longer than in the single-task situations. This experimental result appears to be contradictory to the prediction of EPIC in central processing.
Second, according to the assumptions of EPIC, dual-task interference arises when the SOA becomes shorter, since participants need to monitor the progress of T1, halt T2, resume T1, and so on. Therefore, the brain areas corresponding to the central executive should increase their activation level in the short SOA conditions compared with the long SOA conditions. However, the fMRI study of Jiang et al. (2004) found virtually no increase in these brain regions in the short SOA conditions compared with the long SOA conditions. “These data suggest that passive queueing, rather than active monitoring, occurs during the PRP” (Jiang et al., 2004, p. 390).
Third, Sommer et al. (2001) replicated Karlin and Kestenbaum's (1968) experiment with ERP techniques and measured the RT, percentage of negative RT2s, and lateralized readiness potential (LRP). Ample research in ERP studies found that the onset time of LRP reflects the starting stage of motor preparation in the cognitive system (Leuthold & Jentzsch, 2001; Ulrich, Leuthold, & Sommer, 1998). When T2 was a simple RT (SRT) task, Sommer et al. found two phenomena: First, the average onset time of LRP occurred before S2 was presented, which indicated that the cognitive system started to prepare the processing of S2 before it was presented. Second, the percentage of negative RT2s (RT2 < 0 ms) increased as the SOA increased. However, according to the EPIC-SRD model, S2 is processed by the model after it is presented (Meyer & Kieras, 1997b, p. 756: “When Task 2 involves just one S–R pair (i.e., it is a simple-reaction task), detection of the auditory stimulus triggers the SRD model's Task 2 production rules”), so the onset time of LRP in this simple reaction condition should be after the arrival of S2, and RT2 at the behavioral level should be positive. On the basis of these two contradictions, Sommer et al. believed that their experimental results might reject the modeling mechanism of EPIC-SRD (a post-RSB) in generating the RT of Karlin and Kestenbaum's experiment with some confidence (Sommer et al., 2001, p. 87).
In summary, each existing PRP model encounters at least one experimental study that can be regarded as a counterexample to its predictions. Moreover, closed-form equations are regarded as a more rigorous form of reasoning and modeling than simulation, and most PRP experimental findings summarized in Table 1 have not been modeled by closed-form mathematical models yet. In the following, we describe our queuing network-based architecture and how it is used to develop closed-form mathematical equations to quantify various PRP phenomena summarized in Table 1.
QUEUING NETWORK ARCHITECTURE
>
To model human performance and electrophysiological activities of the brain, the current modeling approach represents the human cognition system as a queuing network-based on several similarities between them. First, ample research evidence has shown that major brain areas with certain information-processing functions are localized and connected with each other in the brain cortex via neural pathways (Bear, Connors, & Paradiso, 2001; Faw, 2003; Kaufer & Lewis, 1999; Roland, 1993; Smith & Jonides, 1998; Zysset, Muller, Lehmann, Thone-Otto, & von Cramon, 2001), which is highly similar to a queuing network of servers (information-processing units) that can process entities (to-be-processed pieces of information) traveling through the routes serially or/and in parallel depending on specific network arrangements. Therefore, brain regions with similar functions can be represented as servers and neural pathways connecting them as routes in the queuing network. Second, for different tasks and learning stages, the to-be-processed information sometimes is processed by the related brain regions (servers) immediately; sometimes, information has to be maintained in certain regions, to wait while some other information is being processed (Braus, 2004; Bullock, 1968; Chklovskii, Mel, & Svoboda, 2004; Eagleman, Jacobson, & Sejnowski, 2004; Habib, 2003; Rieke, Warland, van Steveninck, & Bialek, 1997; Smith & Jonides, 1998; Taylor et al., 2000). Hence, these to-be-processed pieces of information are represented as entities in the queuing network, and entities are processed in the network through certain queuing processes, which represent the waiting and servicing processes of the information entities.
The servers in the queuing network model are defined as the information-processing units in the brain, which includes both the related brain regions and the connections among them. Servers are not passive storage for information but active processing units that perform their functions in the psychological process of transforming stimulus into response.
There are several similarities between the queuing network model and the brain itself. First, both are structures that are composed of multiple servers (in the model) or modules (in the brain). Second, in both structures, servers or modules are connected to, rather than isolated from, each other, and behavior emerges from the coordinated activities of the connected servers/modules. Third, both queuing network servers and brain modules take a certain amount of time to perform their respective information-processing functions. Fourth, both structures contain a processing aspect and a waiting (or queuing) aspect (information being maintained in the brain for processing), which correspond to the situations when information is being processed and when it is waiting for a processing unit to be available.
The difference between the queuing network model and the brain comes from the fact that the model is an abstraction or representation of the brain rather than the brain itself. The brain is composed of billions of neurons, which form an extremely complex network. There are different ways to represent the brain, at different levels of granularity. For example, neural network models represent and analyze the brain at the level of neurons, while the RSB model represents the brain activities as three stages (perception, cognition, and motor stages). This three-stage architecture is also assumed in a human performance model called the model human processor (MHP), which is widely adopted in the field of human–computer interaction (Card, Moran, & Newell, 1983). The queuing network model divides each stage into a subnetwork of a small number of servers and thus has a level of granularity that falls between the neural network and the RSB and MHP models.
In modeling human performance, mathematical models based on queuing networks have successfully integrated a large number of mathematical models in response time (Liu, 1996) and in multitask performance (Liu, 1997) as special cases of queuing networks. A computational cognitive architecture called the queuing network-MHP (QN-MHP; see Figures 3 and 4) has been developed as an integration of queuing networks and MHP for both mathematical modeling and real-time generation of psychological behavior (Liu et al., 2006). QN-MHP has been successfully used to generate human performance and mental workload in real time, including driver performance (Liu et al., 2006) and driver workload (Wu & Liu, 2007a, 2007b; Wu, Tsimhoni, & Liu, in press), transcription typing (Wu & Liu, 2008), and visual–manual tracking performance and mental workload measured by ERP techniques (Wu & Liu, 2008).
>
><anchor name="fig3 fig4"></anchor>
QN-MHP consists of three subnetworks: perceptual, cognitive, and motor subnetworks, as described in the following sections.
<h31 id="rev-115-4-913-d71e706">Perceptual Subnetwork</h31>The perceptual subnetwork includes a visual and an auditory perceptual subnetwork, each of which is composed of four servers. In the visual perceptual subnetwork, visual entities enter the network at Server 1, representing the eye, the lateral geniculate nucleus, the superior colliculus, the primary visual cortex, and the secondary visual cortex (Bear et al., 2001). Then, these entities are transmitted in parallel visual pathways—the parvocellular stream (represented by Server 2) and the magnocellular stream (Server 3)—where the object content features (e.g., color, shape, labeling, etc.) and location features (e.g., spatial coordinates, speed, etc.) are processed (Bear, et al., 2001; Smith & Jonides, 1998; Ungerleider & Haxby, 1994). The distributed parallel area (represented by Server 4)—including the neuron connections between V3 and V4 as well as V4 and V5, the superior frontal sulcus, and the GFi—integrate the information of these features from the two visual pathways and generate integrated perception of the objects (Bear et al., 2001). These brain regions also serve as the visual sensory memory storage for the visual information (Bear et al., 2001; Simon et al., 2002). On the basis of the mechanism of working memory of Baddeley (1992) and the functions of these brain regions (Ohbayashi, Ohki, & Miyashita, 2003; Smith & Jonides, 1998), the majority of the graphical visual information is transmitted to the left and right hemisphere posterior parietal cortex (Server B and Server A, respectively; Bear et al., 2001; Smith & Jonides, 1998).
The auditory perceptual subnetwork also contains four servers: The middle and inner ear (represented by Server 5) transmit auditory information to the parallel auditory pathways, including the neuron pathway from the ventral cochlear nucleus to the superior olivary complex (represented by Server 7) and the neuron pathway from the dorsal and ventral cochlear nuclei to the inferior colliculus (Server 6), where location, pattern, and other aspects of the sound are processed (Bear et al., 2001). The auditory information in the auditory pathways is integrated at the primary auditory cortex and the planum temporale (represented by Server 8; Mustovic et al., 2003). These brain regions also serve as the auditory sensory memory storage place for the auditory information (Mustovic et al., 2003). On the basis of the mechanism of working memory of Baddeley (1992) and functions of multimodal areas (neuron pathways between the primary auditory cortex and the posterior parietal cortex and the angular and supramarginal gyri), the auditory information is transmitted to the left-hemisphere posterior parietal cortex (Server B) as well as the right-hemisphere posterior parietal cortex (Server A; Faw, 2003).
<h31 id="rev-115-4-913-d71e765">Cognitive Subnetwork</h31>The cognitive subnetwork includes a working memory system, a goal execution system, a long-term memory system, and a complex cognitive processing system. An important feature of QN-MHP, compared with EPIC and ACT-R, is its hybrid structure of the cognitive subnetwork, and it includes both serial processing at Server F and parallel processing in the other servers in the cognitive subnetwork.
Following Baddeley's (1992) working memory model, QN-MHP contains four components in the working memory system: a visuospatial sketchpad (Server A), representing the right-hemisphere posterior parietal cortex; a phonological loop (Server B), standing for the left-hemisphere posterior parietal cortex; a central executor (Server C), representing the DLPFCs, the ADPFCs, the right ventral frontal cortex, and the GFm; and a performance monitor (Server E), standing for the ACC. The visuospatial sketchpad and the phonological loop store and maintain visuospatial and phonological information in working memory (Smith & Jonides, 1998). The brain regions represented by Server C play a crucial role in suppressing automatic responses (Burle, Vidal, Tandonnet, & Hasbroucq, 2004; Koski & Paus, 2000; Smith & Jonides, 1998) and categorization information (Grossman et al., 2002; Shafritz, Kartheiser, & Belger, 2005; Vartanian & Goel, 2005). In the model, it is assumed that suppressing an automatic response takes one additional cycle (18 ms; Liu et al., 2006) at Server C; the number of cycles to search for a target stimulus is proportional to the size of a search category, that is, if one category is composed of
The goal execution system (Server G) represents the orbitofrontal region and the amygdala complex, which are typically involved in goal initiation and motivation (Rolls, 2000).
The long-term memory system represents two types of long-term memory in the human brain: (a) declarative (facts and events) and spatial memory (Server H), standing for the medial temporal lobe, including the hippocampus and the diencephalons (these brain areas store various kinds of production rules in choice reaction, long-term spatial information, perceptual judgment, decision making, and problem solving), and (b) nondeclarative memory (procedural memory and motor program; Server D), representing the striatal and the cerebellar systems, which store all of the steps in task procedure and motor programs related to motor execution (Bear et al., 2001).
On the basis of Byrne and Anderson's (2001) experimental finding that humans cannot perform two arithmetic operations at once, the complex cognitive processing system (Server F) is assumed to perform complex cognitive functions in a serial manner. Such functions include multiple-choice decision, phonological judgment, anticipation of stimuli in simple reaction tasks, spatial working memory operations, visuomotor choices, and mental calculation (excluding the functions of Server C, e.g., information categorization and suppression of automatic responses). Correspondingly, Server F represents brain areas responsible for these functions, and these areas include the intraparietal sulcus (IPS), the superior frontal gyrus (SFS), the GFi, the inferior parietal cortex, the ventrolateral frontal cortex, and the superior parietal gyrus (Fletcher & Henson, 2001; Kazui, Kitagaki, & Mori, 2000; Manoach et al., 1997; Smith & Jonides, 1998).
<h31 id="rev-115-4-913-d71e834">Motor Subnetwork</h31>The motor subnetwork includes five servers corresponding to the major brain areas in retrieval, assembly, and execution of motor commands, as well as sensory information feedback. First, Server V represents the premotor cortex in Brodmann Area 6, which plays an important role in sensorimotor and sensory cue detection, especially in a single RT task (Kansaku, Hanakawa, Wu, & Hallett, 2004; Mitz, Godschalk, & Wise, 1991; Roland, 1993); moreover, the premotor cortex is one of the generators of LRP (Leuthold & Jentzsch, 2001, 2002; Ulrich et al., 1998), and it also has the function in processing spatial working memory information after practice (Mitz et al., 1991). Second, the basal ganglia (Server W) retrieve motor programs and long-term procedural information from long-term procedural memory (Server D; Bear et al., 2001; Cook & Woollacott, 1995; Gilbert, 2001). Third, the supplementary motor area (SMA) and the pre-SMA (Server Y) have the major function of assembling motor programs and ensuring movement accuracy (Gordon & Soechting, 1995). Fourth, the function of the primary motor cortex (Server Z) is to address the spinal and bulbar motorneurons and transmit the neural signals to different body parts as motor actuators (mouth, left and right hands, left and right feet server, etc.; Roland, 1993). In addition, the primary motor cortex is also one of the origins of LRP (Leuthold & Jentzsch, 2001, 2002; Ulrich et al., 1998). Fifth, S1 (the somosensory cortex, Server X) collects motor information of efference copies from the primary motor cortex (Server Z) and sensory information from body parts and then relays them to the prefrontal cortex (Server C) as well as the SMA (Server Y; Roland, 1993).
MODELING MECHANISMS AND RESULTS
>
On the basis of the major assumptions of QN-MHP, in the following section, we describe how a queuing network model is able to mathematically model a wide range of PRP effects, including all of the counterexamples to the existing models reviewed above. For each PRP effect, we introduce the experimental results, the route of entities in the network, the corresponding mathematical modeling mechanism, and a comparison between the modeling and experimental results.
<h31 id="rev-115-4-913-d71e892">Basic PRP</h31>Modeling the experimental results in the basic PRP paradigm provides an introduction to the modeling approach of the queuing network model in this article, including how the routes of entities in the network are selected, how the mathematical models are developed, how the parameters in the model are set, and how the modeling results are validated with the experimental results.
<bold>Routes of Entities</bold>
The route of entities in the queuing network is determined on the basis of the previous queuing network modeling work in modeling the connectivity of brain regions (Wu & Liu, 2004a, 2004b): In general, depending on the task to be performed, the servers whose functions are related to the target task are included in the route of entities, which is consistent with the concept of
In T1, entities representing the auditory stimulus enter the auditory perceptual subnetwork first (Server 5→6/7→8); then, they are transmitted to the cognitive subnetwork, including Servers B, C, and F, responsible for making the phonological judgment. After that, since T1 involves vocalization (produces vocal response to the tones), Servers Y, Z, and Mouth are in the route of entities according to the neuron pathways among the brain regions represented by these servers (as described in the introductory section of this article). Therefore, according to the connection between these brain regions, the route of T1 is <anchor name="eq1"></anchor>
For T2, entities representing the visual stimulus enter the visual perceptual subnetwork first (Servers 1→2/3→4). Via Server 4, the entities are transmitted to the cognitive subnetwork, including Servers A, C, and F, in which the judgment is made. After that, they travel to the motor subnetwork (Servers W, Y, and Z and the hand server), which retrieves motor programs, assembles the motor programs, and initiates the motor response. As a result, according to the connection between these brain regions, the route of T2 is <anchor name="eq2"></anchor>
<bold>Modeling Mechanisms</bold>
Entities of both tasks travel through Server F, which works as a structural bottleneck based on the assumption of QN-MHP about the cognitive subnetwork. Accordingly, for the task situation in Experiment 4 of Schumacher et al. (1999), entities of T1 are not delayed in receiving processing, but entities of T2 have to wait for the entities of T1 to leave Server F before they can be processed at Server F (see the short SOA condition compared with the long SOA condition in Figure 5).
>
><anchor name="fig5"></anchor>
<bold>Mathematical Modeling of the Expected Reaction Time</bold>
The expected RT of T1—
where
The expected RT of T2—
Equation 2 above can be rewritten as Equation 3, shown at the bottom of this page.
Figure 6 shows the expected pattern of RT1 and RT2 as the SOA increases. Equation 1 for RT1 shows that the expected RT1 is a constant and its value is independent of the SOA. Equation 3 of RT2 shows that when
>
><anchor name="fig6"></anchor>
<bold>Parameter Setting</bold>
The expected pattern of RT in the basic PRP conditions shown above ( Equations 1 and 3 and Figure 6) is consistent with the pattern of data observed in basic PRP experiments. To fit particular data, we need to set the parameters on the right hand side of the equations. In modeling all of the experimental studies, we follow the same parameter-setting method used in ACT-R/PM (Byrne & Anderson, 2001; see the introduction of ACT-R/PM in this article). For example, in modeling the basic PRP, two free parameters in QN-MHP (the processing times of Server F in T1 and T2) are set to fit the experimental data in the long SOA conditions. The same values of these parameters are used for the short SOA conditions to predict the RT1 and RT2. Therefore, for the short SOA conditions, there are no free parameters to fit the experimental results. Moreover, the values of these two free parameters set for the long SOA conditions are not set arbitrarily but are constrained by the tasks in the experiment: The processing times of T1 and T2 at Server F are close to each other (the difference between these two processing times is less than 120 ms) since the difficulty levels of T1 and T2 in the experiment are similar (see Appendix A, Table A1).
>
><anchor name="tbl2"></anchor>
The other processing times adopt the same values in the original version of QN-MHP, which has been used to model a wide range of human performance in various tasks (Liu et al., 2006; Wu & Liu, 2007a, 2007b, 2008; Wu, Liu, & Walsh, in press). In addition, the setting of the key closure time and voice key closure time is directly based on the study of Byrne and Anderson (2001).
<bold>Modeling Results and Their Validation</bold>
Figure 7 shows the modeling results compared with the basic PRP experimental results. The
>
><anchor name="fig7"></anchor>
Modeling of the subadditive difficulty effect includes quantifications of the four experimental studies described above, in which the difficulty level of T2 was manipulated by the degree of compatibility (Schumacher et al., 1999), the number of stimuli in a category in making the same response (Hawkins et al., 1979), or the number of stimulus–response pairs (Karlin & Kestenbaum, 1968; Sommer et al., 2001). <anchor name="eq5"></anchor>
As described earlier in this article, through changing the degree of compatibility of T2. Schumacher et al. (1999) found subadditive difficulty effects, which can be modeled by the queuing network model in the following manner.
<bold>Routes of Entities</bold>
Routes of Entities in Experiment 3
>
Similar to the routes in the modeling mechanism of the basic PRP paradigm of Schumacher et al. (1999), as described in the basis PRP modeling section above, based on the task and corresponding functions of the brain areas, the routes of T1 and T2 (both compatible and incompatible conditions) are <anchor name="eq6"></anchor>
and <anchor name="eq7"></anchor>
Routes of Entities in Experiment 4
>
Following the same route-setting logic, the routes of entities in Experiment 4 are <anchor name="eq8"></anchor>
and <anchor name="eq9"></anchor>
<bold>Modeling Mechanisms</bold>
The queuing network model is able to account for the subadditive difficulty effect without using scheduling or lock/unlock strategies. In the short SOA conditions, entities in both compatible and incompatible conditions of T2 have to wait in front of Server F until entities of T1 complete the processing at Server F. On the basis of the function of Server C in inhibiting incompatible responses, it takes Server C one additional cycle to inhibit the incompatible responses. Server C takes less time to process the entities of compatible T2 than those of incompatible T2; as a result, entities of compatible T2 wait a longer time than entities of incompatible T2. However, since this extra waiting time of compatible T2 in front of Server F is absorbed in Server F's processing time in the short SOA conditions, the difference between RTs in the compatible and incompatible conditions is smaller than that in the long SOA conditions, in which this extra waiting time of the compatible T2 is not absorbed (see Figures 8 and 9). Therefore, it is predicted that the difference between RTs in the compatible and incompatible tasks in the short SOA conditions is smaller than that in the long SOA conditions, which is consistent with the subadditive difficulty effect. The same mechanism can also be applied to explain the experimental results of Experiment 4, in which different motor output modalities were used. Therefore, the subadditive difficulty effect can be modeled as a natural outcome of the interactions of the servers providing service to entities in the queuing network without using any lock/unlock strategies or executive control processes.
>
><anchor name="fig8 fig9"></anchor>
<bold>Mathematical Modeling of the Expected Reaction Time</bold>
Similar to the equations in quantifying RT in the basic PRP, the mathematical quantification of the expected RT1 and RT2 in Experiment 3 is <anchor name="eq10"></anchor>
<anchor name="eq11"></anchor>
and <anchor name="eq12"></anchor>
The mathematical quantification of the expected RT1 and RT2 in Experiment 4 is <anchor name="eq13"></anchor>
<anchor name="eq14"></anchor>
and <anchor name="eq15"></anchor>
where
On the basis of the equations developed above, the expected pattern of RTs in the compatible and incompatible conditions of T2 in Schumacher et al. (1999) is shown in Figure 10. The difference of RT2 between the compatible and incompatible conditions is larger in the long SOA conditions (
>
><anchor name="fig10"></anchor>
<bold>Parameter Setting</bold>
ACT-R/PM uses three free parameters to model the experimental results in the long SOA conditions (tone recording time and activation of stimulus–response mapping chunks in the easy and hard T2 conditions in Experiments 3 and 4; see Byrne & Anderson, 2001, Table 1; in addition, any free parameters adjusted can be regarded as task-specific assumption in general). Using the same parameter-setting method as in ACT-R/PM, QN-MHP also uses three free parameters to model the experimental results in the long SOA conditions. Except for the 3 free parameters, the values of the other parameters are the same as those in Table A1 (see Appendix A). Moreover, the values of these free parameters in the long SOA conditions are constrained by the task properties: Within each experiment, the processing time of entities at Server F in the compatible condition is shorter than that in the incompatible condition. Across different experiments, in the two compatible conditions of T2 in Experiments 3 and 4, the processing times of entities at Server F are close to each other since the difficulty level of T1 in Experiment 3 is similar to that in Experiment 4 (the difference between these two processing times is less than 120 ms); this constraint also applies to the processing time of T2 at Server F in the incompatible condition in Experiments 3 and 4 (see Appendix A, Table A2).
>
><anchor name="tbl3"></anchor>
<bold>Modeling Results and Their Validation</bold>
Figures 11 and 12 show the modeling results compared with the experimental results in Experiments 3 and 4: In Experiment 3, the
>
><anchor name="fig11 fig12"></anchor>
The difficulty level of T2 in Hawkins et al. (1979) was manipulated by changing the number of stimuli in a category for making the same response (for a detailed description of their experimental setting and findings, see the introductory section of this article).
<bold>Routes of Entities</bold>
The four experiments in Hawkins et al.'s (1979) study included four different combinations of the perceptual and motor modalities of T1: auditory stimulus–manual response, auditory stimulus–vocal response, visual stimulus–vocal response, and visual stimulus–manual response. Following the same route-selection method in modeling the basic PRP, the routes of the entities in these four experiments are <anchor name="eq16"></anchor>
<anchor name="eq17"></anchor>
<anchor name="eq18"></anchor>
<anchor name="eq19"></anchor>
In all four of the experiments, T2 was a visual stimulus–manual response task. Hence, the route of entities of T2 in these four experiments is <anchor name="eq20"></anchor>
<bold>Modeling Mechanisms</bold>
Similar to the mechanisms of modeling Schumacher et al.'s (1999) experiments, based on the function of Server C in categorizing the stimuli, Server C takes additional cycles to locate the target stimulus into the right category (in the easy condition of T2 in Hawkins et al.'s, 1979, experiment, one cycle time is needed since the category size is one; in the difficult condition of T2, four cycle times are needed because the category size is four); hence, Server C takes a longer time to process the entities of T2 that require this categorization process than entities of T1 without the categorization process. However, since this extra waiting time of compatible T2 in front of Server F is absorbed in Server F's processing time in the short SOA conditions, the difference between the easy and hard RTs is smaller than that in the long SOA conditions.
<bold>Mathematical Modeling of the Expected Reaction Time</bold>
Similar to mathematical modeling of the basic PRP, the equations quantifying the expected RT in the four experiments in Hawkins et al.'s (1979) experiment are developed as follows: <anchor name="eq21"></anchor>
<anchor name="eq22"></anchor>
<anchor name="eq23"></anchor>
<anchor name="eq24"></anchor>
In all four of the experiments, T2 is a visual stimulus–manual response task; hence, the expected RT2 in these four experiments is <anchor name="eq25"></anchor>
and <anchor name="eq26"></anchor>
where
Since the mechanisms of modeling RT and the equations of RT1 and RT2 in Hawkins et al.'s (1979) experimental study are similar to those of Schumacher et al.'s (1999) experimental study, the expected pattern of RT in Hawkins et al.'s experiment is similar to Schumacher et al.'s experimental study except that the difficulty level of T2 includes easy and hard conditions rather than compatible and incompatible conditions.
<bold>Parameter Setting</bold>
In modeling the four experiments of Hawkins et al. (1979), compared with EPIC, which uses five free parameters (unlocking onset latency, suspension waiting times under the easy and difficult conditions, preparation waiting time, and ocular orientation time; Meyer & Kieras, 1997a, p. 45), QN-MHP uses three free parameters (
>
><anchor name="tbl4"></anchor>
<bold>Modeling Results and Their Validation</bold>
Figure 13 shows the modeling results compared with experimental results in Experiments 1–4: In Experiment 1, the
>
><anchor name="fig13"></anchor>
As described earlier in this article, in Karlin and Kestenbaum's (1968) study, T1 was a visual–manual choice reaction task, and T2 was an auditory–manual reaction task including two difficulty levels: One was a simple reaction task, and the other was a two-choice reaction task.
<bold>Routes of Entities</bold>
Similar to the routes in modeling the basic PRP, based on the task and the corresponding functions of the brain areas, the routes of T1 and T2 (choice reaction condition) are <anchor name="eq27"></anchor>
and <anchor name="eq28"></anchor>
Kansaku et al. (2004) found a specific neural network that characterizes simple reaction tasks irrespective of the input modalities and output effectors. This network includes the premotor cortex (Server V) and the right posterior superior temporal cortex (Server F). This is also consistent with the functions of the premotor cortex (included in Server V) and right posterior superior temporal cortex (included in Server F) since a simple reaction task involves sensorimotor processing/integration (Server V), sensory cue detection (Server V), and working memory (phonological) information processing and judgment (Server F). On the basis of the connection between these brain regions, the route of entities in T2 under the simple reaction task condition is <anchor name="eq29"></anchor>
<bold>Modeling of the Expected Reaction Time</bold>
The expected RT in T1 and T2 (choice reaction condition) can be derived on the basis of the same mechanism as in the basic PRP (see Equations 16 and 17). <anchor name="eq30"></anchor>
and <anchor name="eq31"></anchor>
The expected RT2 in the simple reaction condition is shown at the bottom of the page in Equation 18, whose derivation is shown in Appendix B(see Equation B15 in Appendix B), where
On the basis of the equations developed above, the expected pattern of the RT in Karlin and Kestenbaum's (1968) experiment is shown in Figure 14. On the basis of Equation 18, in the short SOA conditions, RT2 (simple reaction) shows the same pattern as RT2 in the choice reaction condition; meanwhile, in the long SOA conditions, according to Equation B16 in Appendix B, there is a nonlinear negative relationship between RT2 (simple reaction) and SOA.
>
><anchor name="fig14"></anchor>
This mechanism of modeling the subadditive difficulty effect described above is consistent with the findings from several behavioral and physiological studies of the same task. In the studies of Karlin and Kestenbaum (1968) and De Jong (1993), the stimulus of the second task was always presented after the first stimulus, increasing the conditional probability of the presentation of the second stimulus with an increase of the SOA (Luce, 1986; Naatanen, 1971; Niemi & Naatanen, 1981). Other behavioral studies (Nickerson, 1965, 1967) also found an increased probability of anticipatory reactions in a simple reaction task in the long SOA conditions under such experimental conditions. The result of these behavioral studies was also confirmed in an ERP study (Sommer et al., 2001) in which the LRP provided direct evidence that the subadditive difficulty effect is due to an increase of response anticipation in the simple response condition if the secondary task is a simple reaction task. In addition, fMRI studies (Brass & Cramon, 2002) also found that the frontolateral frontal cortex at the junction of the precentral sulcus and the inferior frontal sulcus (represented by Server F) is the crucial frontal component in task preparation.
QN-MHP is able to model the subadditive difficulty effect found in Karlin and Kestenbaum's (1968) experiment without using task-specific scheduling assumptions. When the SOA is longer than certain durations, before S1 appears, Server F starts the anticipation process and prepares its response selection (see Appendix B for the modeling mechanism in detail). The response selection might occur earlier than the actual presentation of stimulus, which also allows QN-MHP to model the other dependent variables in Sommer et al.'s (2001) experiment—percentage of negative responses and onset time of the brain waves of LRP (see the modeling of Sommer et al.'s, 2001, experimental results in Appendix C in detail). This modeling mechanism in stimulus anticipation is a component of the QN-MHP and has been successfully implemented in modeling a driving task (Liu et al., 2006); it is not an additional task-specific assumption added for the current study.
<bold>Parameter Setting</bold>
All of the parameters used in the model are listed in Table A4 in Appendix A. Compared with EPIC, which uses nine free parameters<anchor name="b-fn4"></anchor><sups>4</sups> in simulating the experiment of Karlin and Kestenbaum (1968; see Meyer & Kieras, 1997b, Table 1), QN-MHP uses five free parameters with the same parameter-setting method as in ACT-R/PM. The values of the other parameters are the same as those in Tables A1–A3 in Appendix A. The two parameters in Equation B4 in Appendix B are directly based on a psychophysical study (
>
><anchor name="tbl5"></anchor>
<bold>Modeling Results and Their Validation</bold>
Figure 15 shows the modeling results compared with experimental results. The
>
><anchor name="fig15"></anchor>
Van Selst and Jolicoeur (1997) conducted a behavioral experiment to replicate Karlin and Kestenbaum's (1968) experiment. Van Selst and Jolicoeur's experiment had three conditions: SRT, two-alternative forced choice (2AFC), and three-alternative forced choice (3AFC). They found that (a) the difference of RTs between 2AFC and 3AFC remains a constant across the SOAs (Van Selst & Jolicoeur, 1997, regarded this result as one that did not replicate the results of Karlin & Kestenbaum's, 1968, experiment; this additive effect can also be found in McCann & Johnston, 1992; Ruthruff, Miller, & Lachmann, 1995) and (b) the difference of RTs between 2AFC and SRT decreases as the SOA decreases (this is consistent with Karlin & Kestenbaum's, 1968, experimental results). Their finding related to the additive effect can also be explained by the queuing network model: (a) When RT in the 2AFC condition is compared with that in the 3AFC condition, the only difference is the prolonging of service time at Server F in the 3AFC condition, and the whole model is simplified into a single bottleneck, producing the same results as the RSB model (the difference of RTs between 2AFC and 3AFC keeps constant across the SOAs); (b) in the SRT versus 2AFC situation, the anticipation process facilitates the simple response task, which is exactly the same modeling mechanism used in modeling Karlin and Kestenbaum's experiment, as described above in this section.
<h31 id="rev-115-4-913-d71e1827">Sommer et al.'s (2001) Study</h31>Sommer et al. (2001) replicated Karlin and Kestenbaum's (1968) experiment with the ERP techniques, and they measured RT, percentage of negative RT2s, and LRP, as described in detail in the introductory section of this article. Their experimental setting was the same as that in Karlin and Kestenbaum's experiment except that T1 in Sommer et al.'s experiment was an auditory–manual task and T2 was a visual–manual task. Therefore, the same modeling mechanisms were used in our study to model Sommer et al.'s experiment.
<bold>Routes of Entities</bold>
Similar to the routes of entities in modeling Karlin and Kestenbaum's (1968) experiment, according to the functions and connections of the related brain regions, the routes of task entities in modeling Sommer et al.'s experiment are <anchor name="eq33"></anchor>
<anchor name="eq34"></anchor>
and <anchor name="eq35"></anchor>
<bold>Modeling of the Expected Reaction Time, Percentage of Negative Responses, and S-LRP</bold>
The expected RTs in Sommer et al.'s (2001) experiment were modeled with the same formula as in modeling Karlin and Kestenbaum's (1968) experiment except for the processing time of Server A, Server B, and the perceptual subnetwork (see Equations 19–21). <anchor name="eq36"></anchor>
<anchor name="eq37"></anchor>
See top of page for Equation 21. <anchor name="eq38"></anchor>
In the simple reaction condition of T2, the expected <anchor name="eq39"></anchor>
percentage of negative responses (
The expected pattern of the percentage of negative responses is shown in Figure 16. In the simple reaction condition, in the short SOA conditions (
>
><anchor name="fig16"></anchor>
Since the LRP reflects motor preparation taking place within the premotor area (Server V) or the primary motor cortex (Server Z; H. Leuthold & Jentzsch, 2001, 2002; Ulrich et al., 1998) and Server V is located before Server Z in the route of the simple reaction task, the arrival time of entities at Server V is regarded as the LRP onset time in this simple reactionsituation.<anchor name="b-fn5"></anchor><sups>5</sups>Equation 23, shown at the top of the next page, quantifies the onset time of S-LRP (see Appendix F for its development), which is shown in Figure 17 as the expected pattern of S-LRP with an increase of SOA.
>
><anchor name="fig17"></anchor>
LRP reflects motor preparation taking place within the premotor area (Server V) or the primary motor cortex (Server Z). Hence, in the choice reaction condition of T2, the premotor area (Server V) is not in the route of entities; therefore, the arrival time of entities at Server Z is the expected S-LRP onset time (see Equation 24 and Figure 17). The expected pattern of S-LRP is similar to the expected pattern of RT in this condition (see Figure 6). <anchor name="eq41"></anchor>
<bold>Parameter Setting</bold>
All of the parameters used in the model are listed in Table A5 in Appendix A. Except for the four4 free parameters set for the long SOA conditions following ACT-R/PM's parameter-setting method, all of the values of the other parameters are the same as those in Tables A1–A4. The three dependent variables, including RT, ratio of correct response and S-LRP onset time, are modeled on the basis of the same set of parameters shown in Table A5. Moreover, the values of these free parameters set for long SOA conditions are constrained by the task properties: The processing time at Server F in the simple reaction condition is at least 18 ms (one cycle time) less than that in the choice reaction condition.
>
><anchor name="tbl6"></anchor>
<bold>Modeling Results and Their Validation</bold>
Figure 18 shows the modeling results in comparison with experimental results. The
>
><anchor name="fig18"></anchor>
The modeling results of the percentage of negative responses in comparison with the experiment result are shown in Figure 19. The
>
><anchor name="fig19"></anchor>
In addition, the modeling result of S-LRP exhibits a pattern similar to the experimental results (see Figure 20 for the comparison of the S-LRP onset time between the prediction of the model and the experimental results; SRT condition:
>
><anchor name="fig20"></anchor>
The predicted S-LRP shows the same pattern as the experimental results, especially for the negative and close-to-zero S-LRP values in the SRT condition (SOA = 700 ms). The large RMS in predicting S-LRP in this experimental study might be due to two reasons: First, the majority of the QN-MHP parameters are based on MHP parameters, which are derived from behavioral rather than neurological experiments (Card et al., 1983). Second, the free parameters are set corresponding to RT data in the long SOA condition rather than the S-LRP results.
<h31 id="rev-115-4-913-d71e2062">Brian Imaging Pattern (Jiang et al., 2004)</h31>Jiang et al.'s (2004) experiment provides another challenging counterexample to the strategic scheduling mechanism in EPIC. In their experiment, both Tasks 1 and 2 were visual–manual choice reaction tasks (see the detailed experiment description in the introductory section of this article).
<bold>Routes of Entities</bold>
Similar to the routes in modeling the basic PRP, on the basis of the task and the corresponding functions of the brain areas, the routes of T1 and T2 are <anchor name="eq42"></anchor>
and <anchor name="eq43"></anchor>
<bold>Modeling of the Expected Reaction Time</bold>
Experiment 1 in Jiang et al.'s (2004) study can be modeled by the queuing mechanism in the basic PRP directly: In the short SOA conditions, entities of T2 will not be able to enter Server F until entities of T1 leave Server F. In this process, Server F processes only the entities of individual tasks rather than scheduling the entities of two tasks actively. The mathematical equations of behavioral performance in this experiment are the same as those formulas used in modeling the basic PRP effect except for the change of the perceptual and motor subnetworks to correspond to Jiang et al.'s experimental setting (see Equations 25 and 26). The expected pattern of RT is the same as that in the basic PRP effect. <anchor name="eq44"></anchor>
and <anchor name="eq45"></anchor>
<bold>Modeling of BOLD Signal and Its Percentage of Change</bold>
The integrated BOLD (blood oxygen level dependent) signal—
where
where ρ
For the same brain region, the percentage signal change (fMRI
Therefore, according to Equations 27–29,
For the same brain regions measured by the same fMRI techniques,
<anchor name="eq50"></anchor>
and <anchor name="eq51"></anchor>
In other words, in this queuing process, since the amount of information processed by each brain region remains the same in the short and long SOA conditions, the integrated BOLD signal remains the same in the short and long SOA conditions.
<bold>Parameter Setting</bold>
Except for the two free parameters set for the long SOA condition, the values of the other parameters are the same as in those in Tables A1–A5 in Appendix A. Moreover, the values of the free parameters set for the long SOA conditions are constrained by the nature of the tasks: The processing times of entities at Server F in both T1 and T2 are close to each other (the difference between these two processing times is less than 120 ms) since the difficulty levels of the two choice reaction tasks are similar (see Appendix A, Table A6).
>
><anchor name="tbl7"></anchor>
<bold>Modeling Results and Their Validation</bold>
Using the equations derived in the previous sections, the predicted results of both RT and the percentage of change of fMRI signal are presented and validated with the target experiment results.
Reaction Time
>
Figure 21 shows the modeling results in comparison with experimental results in RT: The
>
><anchor name="fig21"></anchor>
fMRI Signal
>
Figure 22 shows the modeling results in comparison with experimental results of the fMRI signal (RMS = 0.03).
>
><anchor name="fig22"></anchor>
For both RT and brain imaging data (
The experimental study of Ruthruff, Pashler, and Klaassen (2001) found the response grouping effect by asking the participants to emit the responses of two tasks at the same time. The two tasks in their experiment were a tone-counting task and a spatial working memory task (see the detailed experiment description in the introductory part of this article).
<bold>Routes of Entities</bold>
Considering the experimental task and the corresponding functions of the brain areas, it is possible that the lateral BA 6 (represented by Server V), the SFS (represented by Server F), or both can be involved in processing the spatial working memory task (see the introductory section of this article). According to the neuron pathways and connections between these two brain regions and other regions, the two possible routes to process the spatial working memory task are as follows: <anchor name="eq52"></anchor>
<anchor name="eq53"></anchor>
According to the function of Server F (IPS in Server F is active for the mental calculation and numerical operation task), the route for the numerical operations (i.e., tone-counting) task is <anchor name="eq54"></anchor>
Two modeling methods have been used to quantify the response grouping effect. In this section, we introduce the first method, considering only the route without the practice effect on performance (1→2/3→4→A→C→F→C→W→→Y→Z→Hand). In modeling the practice effect of PRP, we introduce the second method, which considers the practice effect on performance as well as the two possible routes in this spatial working memory task.
<bold>Modeling of the Expected Reaction Time</bold>
If the practice effect is not considered in Ruthruff, Pashler, and Klaassen's (2001) experiment, entities of the spatial working memory task and the tone-counting task both pass through the bottleneck server (Server F), which is similar to the basic PRP situation. In general, there are five possible conditions of the expected RT—
>
><anchor name="fig23"></anchor>
On the basis of the equations developed in Appendix G and the modeling mechanism above, the expected patterns of RT in these five conditions are shown in Figure 24. The expected RT in the dual-task condition is longer than that in the single reaction condition, and the expected RT in Conditions 1 and 3 is shorter than that in Conditions 2, 4, and 5.
>
><anchor name="fig24"></anchor>
<bold>Parameter Setting</bold>
Only two free parameters (
>
><anchor name="tbl8"></anchor>
<bold>Modeling Results and Their Validation</bold>
Figure 25 shows the modeling results compared with experimental results: Without considering the practice effect, the
>
><anchor name="fig25"></anchor>
In the experimental studies of Ruthruff, Johnston, and Van Selst (2001) and Oberauer and Kliegl (2004), participants received relatively extensive practice, and there are two possible routes of the spatial working memory task in the cognitive system (see the two routes in modeling Ruthruff, Pashler, & Klaassen's, 2001, study in the previous section). To model the practice effect in general, QN-MHP makes two task-independent assumptions, which have been used in our work on modeling the practice effect in transcription typing (Wu, Liu, & Walsh, in press). The first assumption quantifies the change of routing probability of entities in the network during the practice process, and the second assumption quantifies the increase of servers' processing speed via practice.
<bold>Routes Rewiring Via Practice</bold>
It is well recognized that the human brain is not only a network of brain regions but also a system that is able to change itself dynamically in the process of development and learning (Chklovskii et al., 2004; Habib, 2003). On the one hand, the brain traffic concept in neuroscience suggests that information flow (possibly represented by spike trains) in the brain also exhibits features of traffic flow in the network. On the other hand, different brain areas are activated during the visual–motor practice process (Aizawa et al., 1991; Petersen, van Mier, Fiez, & Raichle, 1998; van Mier, Tempel, Perlmutter, Raichle, & Petersen, 1998). This plasticity aspect of the human brain concerns the change of synaptic connection strengths between neurons and rewiring among neural pathways—information flow changes from one neuron pathway to another, with a stronger synaptic connection strength and a higher efficiency in information processing. This rapid regulation is related to a brain-derived neurotrophic factor regarded as a signal of synaptic plasticity in adults (Black, 1999; Braus, 2004).
The routing probability equation (see Equation 30) in the queuing network is developed on the basis of the brain traffic concept above (see Appendix E for its derivation) and Black's (1999) study, where the routing probability (
In other words, the synaptic connection strength, which depends on the practice processes that improve the effectiveness of information processing in the brain regions along the neuron pathway (route), determines the probability that the information entities enter one of multiple neuron pathways (routes). If the majority of entities change their route from one to another, rewiring of routes (neuron pathways) occurs.
<bold>Reduction of Processing Time at Individual Servers Via Practice</bold>
Because the exponential function fits the practice processes in various tasks, including memory search, motor learning, visual search, and mathematical operations, better than the power law (Heathcote, Brown, & Mewhort, 2000), it is applied to model the practice process in each server (see Equation 31). <anchor name="eq56"></anchor>
where
In Ruthruff, Johnston, and Van Selst's (2001) experiment, participants received extensive single- and dual-task practices; hence, there are two routes of entities in performing the same spatial working memory task (see the description above of the two routes in modeling of Ruthruff, Johnston, & Van Selst's, 2001, experiment). In the dual-task practice condition,<anchor name="b-fn6"></anchor><sups>6</sups> sojourn time at Server C increased from the processing time only to the sum of waiting time (entities maintained at Server C to wait for the previous entities finished processing at Server F) and processing time. Therefore, according to Equation 30 in the route rewiring, the probability of entities entering Server C decreases and the probability of entering Server V increases because of the increased sojourn time, which causes the processing time at Server V to decrease further. As a result, entities take two routes in the dual-task practice condition: A→V or A→C→F. The higher the probability of entities taking the route from Server A to V, the higher the probability that the Server F bottleneck is bypassed and the PRP effect disappears. Therefore, QN-MHP is able to model the disappearance of the PRP effect in dual-task practice based on the queue network architecture.
In the situation in which entities of the two tasks take the two separate routes without any conflict with each other, the expected RT of both tasks—
where
>
><anchor name="fig26"></anchor>
Specifically,
Suppose
On the basis of the equations developed above, Figure 27 shows the expected pattern of RT in the single- and dual-task conditions (the expected RTs of Conditions 1 and 2 in Figure 26 in the modeling mechanism overlap in Figure 27).
>
><anchor name="fig27"></anchor>
<bold>Parameter Setting</bold>
Only three free parameters are used when the practice effect is taken into consideration (see Appendix A, Table A8). The values of these free parameters set for the long SOA conditions are also constrained by the task properties: The spatial working memory task involving mental rotations and the tone-counting task involving mathematical addition are more complex than the choice reaction task in the previous experimental studies in PRP, increasing the number of cycles at Server F compared with the processing times at regular choice reaction conditions; since Server V processes spatial working memory information after extensive practice (Mitz et al., 1991; see the introductory section of this article), the processing time of Server V without extensive practice is longer than that after extensive practice.
>
><anchor name="tbl9"></anchor>
<bold>Modeling Results and Their Validation</bold>
Figure 28 shows the modeling results compared with the experimental results considering the practice effect: The
>
><anchor name="fig28"></anchor>
As described earlier in this article, Oberauer and Kliegl's (2004) experimental study found that the dual-task practice group produced a smaller PRP effect than the single-task practice group (Oberauer & Kliegl, 2004).
<bold>Routes of Entities</bold>
Similar to the route selection in the modeling of Ruthruff, Johnston, and Van Selst's (2001) experiment, the two possible routes to process the spatial working memory task are as follows: <anchor name="eq60"></anchor>
<anchor name="eq61"></anchor>
According to the function of Server F (IPS in Server F is active for the mental calculation task), the route for the numerical operations task is <anchor name="eq62"></anchor>
<bold>Modeling Mechanisms</bold>
On the basis of the two possible routes in performing the spatial memory task, starting at Server A, we have Route 1 (A→C→F→C→W→Y→Z→Hand) and Route 2 (A→V→W→Y→Z→Hand). In the single-task practice condition, entities at Server A always enter Server C and then enter Server V because sojourn time at Server C is shorter than Server V (the mean processing time at Server C = 18 ms; sojourn time at Server C = 18 ms; mean processing time at Server V = 1,540 ms; see the value of these parameters in Ruthruff, Johnston, & Van Selst's, 2001, experiment; sojourn time at Server V = 1,540 ms).
Since very few entities enter Server V and its processing time does not decrease much in the single-task practice task condition, the majority of entities still take the same route throughout the practice sessions. As a result, Server F bottleneck is not bypassed by the majority of entities, the PRP effect does not disappear under the single-task practice condition, and the reduced the PRP effect is due to reduced processing time at Server F and the other servers.
In the dual-task practice condition, there is a 50% chance that sojourn time at Server C increases from the processing time to the sum of waiting time (entities maintained at Server C to wait for the previous entities to finish processing at Server F) and processing time. Therefore, similar to the modeling of Ruthruff, Johnston, and Van Selst's (2001) experiment, according to Equation 30 above, the probability of entity entering Server C decreases and the probability of entering Server V increases because of the increased sojourn time, thus decreasing the processing time at Server V further. The higher the probability of entities taking the route from Server A to Server V, the higher the probability that Server F bottleneck is bypassed and the PRP effect disappears.
<bold>Mathematical Modeling of Expected Reaction Time</bold>
Sequential Test
>
In both the sequential pretest and posttest, the expected RT—
where all of the server processing times refer to the current processing times determined by Equation 31.
Simultaneous Test
>
Pretest RT
>
In the simultaneous test of the pretest, the expected RT—
Posttest RT: Dual-task practice group
>
At the end of practice, there are two situations in estimating the expected RT in Oberauer and Kliegl's (2004) experiment: First, when the entities of the two tasks take two independent routes (A→V→Z and B→CμF→C→W→Y→Z), the expected RT—
Second, when the entities of both tasks enter Server F in the cognitive subnetwork, the expected RT—
Therefore, similar to the quantification of RT in Ruthruff, Johnston, and Van Selst's (2001) experiment, the expected RT in Oberauer's experiment—
>
><anchor name="fig29"></anchor>
Posttest RT: Single-task practice group
>
The expected RT of the single-task practice group—
On the basis of the equations developed above and the modeling mechanism, Figure 30 shows the expected patterns of RT for the single-task and dual-task practice groups. The inverse relation between the probability of routing and sojourn time in Equation 30 produces a nonlinear relation between the SOA and RT, and the slope of the curve of the dual-task practice group is greater than that of single-task practice group because of the higher probability of longer sojourn times at Server C in the dual-task practice condition than the single-task practice condition (see the modeling mechanism in this section). Therefore, it is predicted that the dual-task practice group will improve their dual-task performance faster than the single-task practice group.
>
><anchor name="fig30"></anchor>
<bold>Parameter Setting</bold>
Only two free parameters were used in the parameter-setting process (see Appendix A, Table A9):
>
><anchor name="tbl10"></anchor>
<bold>Modeling Results and Their Validation</bold>
Figure 31 shows the modeling results compared with experimental results in the single- and dual-task practice groups. For the single-task practice group, the
>
><anchor name="fig31"></anchor>
DISCUSSION
>
In this article, we have described how the queuing network model is able to account for various experimental findings in PRP, including those counterexamples to the existing models. In this modeling work, we have demonstrated the important theoretical contributions and unique features of the queuing network architecture in understanding cognitive architecture and modeling multiple-task performance.
A unique theoretical position and a corresponding feature of the queuing network architecture compared with other cognitive architectures is its hybrid cognitive network structure with both serial and parallel information-processing components in its cognitive subnetwork and the concept of queuing as a coordination mechanism without the need for any executive process. First, on the basis of neuroscience findings that different brain areas (e.g., DLPFC, IPS, and ACC) serve different functions in the cognitive stage and psychological research on different cognitive modules, QN-MHP decomposes the cognitive stage into a network, and each of its servers performs a distinct role in cognitive processing. This network structure allows QN-MHP to quantify the experimental results of Schumacher et al. (1999) and Hawkins et al. (1979) showing the subadditive difficulty effect.
Second, on the basis of Byrne and Anderson's (2001) finding that humans cannot perform two arithmetic tasks at once, QN-MHP assumes that Server F is serial while other cognitive servers are parallel. As pointed out in Liu et al. (2006),
The current work on PRP modeling with closed-form mathematical equations offers a strong support to this theoretical position since the modeling results would not appear and the mathematical equations would break down if we did not assume F to be serial or if we assigned serial processing to any other servers.
Third, as the first word of the name of the queuing network architecture and the title of this article indicate, queuing is a unique and central theoretical concept in our work. Queuing (waiting for service) at the various servers while task entities compete for service allows multitask interference and performance patterns to emerge without the need for any executive process (Liu, 1996, 1997; Liu et al., 2006), whether a specialized (Meyer & Kieras, 1997a, 1997b) or a general one (Salvucci & Taatgen, 2008).
The hybrid cognitive structure and queuing allow QN-MHP to model a range of PRP phenomena without the need for any executive process, including the brain imaging patterns and the response grouping effect; they also explain why dual-task practice can improve human performance in two simultaneous complex mental operations (e.g., mathematical calculations) faster than single-task practice. The parallel information-processing activities in the cognitive servers other than Server F enable QN-MHP to model the disappearance of the PRP effect after extensive practice.
The overall mathematical structure of the queuing network model and entity-based information processing are also unique properties of the queuing network model. As shown in this article, these properties enable QN-MHP to mathematically quantify the interactions among the servers and to derive and predict behavior patterns and general trends without the need for simulation. In this article, all of the empirical PRP data have been modeled with closed-form mathematical equations, without any reliance on simulation. Using the mathematical structure of queuing networks and entity-based processing, the model is also able to explain why the PRP effect disappears only via dual-task practice and how competition for service between the two streams of entities representing T1 and T2 through the network can yield the PRP effects without devising a task-specific procedure to interleave production rules into a serial program or an executive process to interactively control task processes (Liu et al., 2006).
Furthermore, these features of the queuing network model are consistent with the findings of neuroscience in dual tasks. For example, on the basis of a comprehensive review of more than 10 fMRI studies in dual tasks, Collette and Linden (2002) concluded that “no specific area could be associated with any cognitive processor for dual-task performance and that dual-task performance coordination depends mainly on the interaction between cerebral areas already activated in the single task” (pp. 117–118). McIntosh (2000) stated that
QN-MHP modeled all of the major counterexamples to RSB, EPIC-SRD, and ACT-R/PM with fewer or the same number of free parameters, and there is no task-specific assumption in the current modeling work. It should be noted here that the settings of the entities' routes in modeling each experimental study in this modeling work are not task-specific assumptions. The routes of entities are selected on the basis of a task-independent rule—the function of brain regions (represented by the servers) determines which regions (servers) are selected in the route, and the anatomical connections among these regions determine the directions of information flow (represented by entities) in the route. This task-independent rule is consistent with the method of determining the information flow in different brain regions in neuroscience (Taylor et al., 2000). In all of the choice RT conditions, the routes of entities in the cognitive subnetwork are the same, except Server A or B, depending on the content of stimuli (phonological or visual), and their routes are changed only in the perceptual and the motor subnetworks according to the particular task setting. In the SRT and spatial working memory task conditions, the routes are determined by the findings in brain imaging studies. Even though fMRI techniques are not powerful in measuring brain activity along the time dimension, ample research shows that they can be used to determine the route of information processing in the brain with the anatomic connection of neuron pathways among these regions (Horwitz et al., 1999; McIntosh, 1999, 2000; Sporns et al., 2000; Taylor, 2003; Taylor et al., 2000).
While QN-MHP demonstrates its unique features in modeling the various PRP phenomena, a concern may be raised that if entities of T2 arrive at Server F earlier than entities of T1 in the short SOA conditions, Server F will process entities of T2 first, and the order of the responses might be reversed. We should point out that in the experimental studies modeled in this article, except for the experiment related to the response grouping effect and Hawkins et al.'s (1979) experiment, the SOAs are positive and greater than 50 ms. QN-MHP uses the same parameter value (τ
We plan to continue our QN-MHP modeling work in the future. For example, we plan to explore how QN-MHP may be used to explain and quantify the activation patterns of brain regions in various kinds of dual-task situations summarized by Collette and Linden (2002). Because the functions of the cognitive system in QN-MHP are distributed among the servers in the network and QN-MHP does not rely on a certain conductor server in coordinating or controlling the processing of other servers, we envision it possible to model these fMRI results with the natural interaction among servers. We also plan to extend our QN-MHP work of modeling task switching performance in basic psychological studies (Schneider & Logan, in press) and complex performance of dual tasks in daily life, for example, driving or flying. Liu et al. (2006) initiated the first step in modeling dual-task performance without using task-specific procedures to interleave production rules into a serial program or an executive process to interactively control task processes. In other words, once the task procedures of each individual task are implemented in the model, the model will generate dual-task performance by letting the two streams of entities representing the two individual tasks in a dual task run through the model. With this modeling approach, we have successfully modeled a range of complex tasks, including driving (Liu et al., 2006; Wu & Liu, 2007a) and transcription typing (Wu & Liu, 2008). The PRP modeling work reported in this article is one of our modeling efforts along this direction, focusing on the most basic and fundamental aspect of multitask performance and using closed-form mathematical equations as the modeling method.
In summary, this modeling work accounts for dual-task performance in PRP with fewer or equal numbers of free parameters compared with existing models and is consistent with findings in a brain imaging study (Jiang et al., 2004) and an electrophysiological study (Sommer et al., 2001) regarding the neural mechanisms involved in generating basic dual-task performance in PRP. This modeling work offers an alternative theoretical explanation for various PRP phenomena, and it also demonstrates the importance of the concepts of queuing and hybrid network structure in understanding cognitive architecture and in modeling multitask performance.
Footnotes
<anchor name="fn1"></anchor>
<sups>
1
</sups> To provide a more precise estimate, Ruthruff, Pashler, and Klaassen (2001) ran a control experiment (
<sups> 2 </sups> 1A indicates processing time of T1 at the perceptual stage; 1B is the processing time of T1 at the cognitive stage; 2A indicates the processing time of T2 at the perceptual stage.
<anchor name="fn3"></anchor><sups> 3 </sups> ACT-R/PM uses an objective and systematic method to set the values of free parameters: Free parameters are adjusted in the long SOA conditions to fit the simulation results with the experimental results, and then, without changing their values, these parameters are used in the model in the short SOA conditions to generate the simulation results. Therefore, in this parameter-setting method, no free parameter is used to fit the experiment results of the short SOA conditions.
<anchor name="fn4"></anchor><sups> 4 </sups> The nine free parameters used by EPIC are auditory identification time, auditory detection time, visual identification time, number of selection cycles of T1 and T2, ocular orientation time, unlocking onset latency, suspension waiting time, and preparation waiting time.
<anchor name="fn5"></anchor><sups> 5 </sups> Because of the high temporary accuracy of the ERP techniques (1 ms), the conduction time from the activation of brain regions to the instant when the S-LRP is observed can be ignored (Ilvonen et al., 2003).
<anchor name="fn6"></anchor><sups> 6 </sups> The modeling mechanism of Oberauer and Kliegl's (2004) experiment explains why only dual-task practice forms the two routes in processing the spatial working memory task.
<anchor name="fn7"></anchor><sups> 7 </sups> Even though the absolute value of RMS is higher than the modeling results of previous studies, the relative RMS compared with the whole range of RTs (0–3,000 ms) is still small.
References
<anchor name="c1"></anchor>Aizawa, H., Inase, M., Mushiake, H., Shima, K., & Tanji, J. (1991). Reorganization of activity in the supplementary motor area associated with motor learning and functional recovery.
Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., & Qin, Y. (2004). An integrated theory of the mind.
Anderson, J. R., & Lebiere, C. (Eds.). (1998).
Anderson, J. R., Qin, Y. L., Sohn, M. H., Stenger, V. A., & Carter, C. S. (2003). An information-processing model of the BOLD response in symbol manipulation tasks.
Anderson, J. R., Qin, Y. L., Stenger, V. A., & Carter, C. S. (2004). The relationship of three cortical regions to an information-processing model.
Ashby, G., Ennis, J., & Spiering, B. (2007). A neurobiological theory of automaticity in perceptual categorization.
Baddeley, A. D. (1992, January31). Working memory.
Bear, M. F., Connors, B. W., & Paradiso, M. A. (2001).
Ben-Shachar, M., Hendler, T., Kahn, I., Ben-Bashat, D., & Grodzinsky, Y. (2003). The neural reality of syntactic transformations: Evidence from functional magnetic resonance imaging.
Black, I. B. (1999). Trophic regulation of synaptic plasticity.
Brass, M., & Cramon, D. (2002). The role of the frontal cortex in task preparation.
Braus, D. F. (2004). Neurobiology of learning: The basis of an alteration process.
Bullock, T. (1968). Representation of information in neurons and sites for molecular participation.
Burle, B., Vidal, F., Tandonnet, C., & Hasbroucq, T. (2004). Physiological evidence for response inhibition in choice reaction time tasks.
Byrne, M. D., & Anderson, J. R. (1998). Perception and action. In J. R.Anderson & C.Lebiere (Eds.),
Byrne, M. D., & Anderson, J. R. (2001). Serial modules in parallel: The psychological refractory period and perfect time-sharing.
Card, S., Moran, T. P., & Newell, A. (1983).
Chklovskii, D. B., Mel, B. W., & Svoboda, K. (2004, October14). Cortical rewiring and information storage.
Cohen, M. S. (1997). Parametric analysis of fMRI data using linear systems methods.
Collette, F., & Linden, M. V. (2002). Brain imaging of the central executive component of working memory.
Cook, A. S., & Woollacott, M. H. (1995).
Creamer, L. R. (1963). Event uncertainty, psychological refractory period, and human data processing.
De Jong, R. (1993). Multiple bottlenecks in overlapping task performance.
Eagleman, D., Jacobson, J., & Sejnowski, T. (2004, April22). Perceived luminance depends on temporal context.
Eisler, H. (1975). Subjective duration and psychophysics.
Eisler, H. (1976). Experiments on subjective duration 1968–1975: A collection of power function exponents.
Faw, B. (2003). Pre-frontal executive committee for perception, working memory, attention, long-term memory, motor control, and thinking: A tutorial review.
Feyen, R. (2002).
Fletcher, P. C., & Henson, R. N. A. (2001). Frontal lobes and human memory: Insights from functional neuroimaging.
Gilbert, P. F. C. (2001). An outline of brain function.
Gordon, A. M., & Soechting, J. F. (1995). Use of tactile afferent information in sequential finger movements.
Gross, D., & Harris, C. M. (1998).
Grossman, M., Smith, E. E., Koenig, P., Glosser, G., DeVita, C., Moore, P., et al. (2002). The neural basis for categorization in semantic memory.
Habib, M. (2003). Rewiring the dyslexic brain.
Hawkins, H. L., Rodriguez, E., & Reicher, G. M. (1979).
Heathcote, A., Brown, S., & Mewhort, D. J. K. (2000). The power law repealed: The case for an exponential law of practice.
Horwitz, B., Tagamets, M. A., & McIntosh, A. R. (1999). Neural modeling, functional brain imaging, and cognition.
Ilvonen, T. M., Kujala, T., Kiesilainen, A., Salonen, O., Kozou, H., Pekkonen, E., et al. (2003). Auditory discrimination after left-hemisphere stroke: A mismatch negativity follow-up study.
Jiang, Y. H., Saxe, R., & Kanwisher, N. (2004). Functional magnetic resonance imaging provides new constraints on theories of the psychological refractory period.
Kansaku, K., Hanakawa, T., Wu, T., & Hallett, M. (2004). A shared neural network for simple reaction time.
Kantowitz, B. H. (1974). Double stimulation. In B. H.Kantowitz (Ed.),
Karlin, L., & Kestenbaum, R. (1968). Effects of number of alternatives on the psychological refractory period.
Kaufer, D. I., & Lewis, D. A. (1999). Frontal lobe anatomy and cortical connectivity. In B. L.Miller & J. L.Cummings (Eds.),
Kazui, H., Kitagaki, H., & Mori, E. (2000). Cortical activation during retrieval of arithmetical facts and actual calculation: A functional magnetic resonance imaging study.
Kieras, D. E., & Meyer, D. E. (1997). An overview of the EPIC architecture for cognition and performance with application to human-computer interaction.
Koski, L., & Paus, T. (2000). Functional connectivity of the anterior cingulate cortex within the human frontal lobe: A brain-mapping meta-analysis.
Leuthold, H., & Jentzsch, I. (2001). Neural correlates of advance movement preparation: A dipole source analysis approach.
Leuthold, H., & Jentzsch, I. (2002). Distinguishing neural sources of movement preparation and execution: An electrophysiological analysis.
Liu, Y. (1996). Queueing network modeling of elementary mental processes.
Liu, Y. (1997). Queueing network modeling of human performance of concurrent spatial and verbal tasks.
Liu, Y., Feyen, R., & Tsimhoni, O. (2006). Queueing network-model human processor (QN-MHP): A computational architecture for multitask performance in human-machine systems.
Luce, R. D. (1986).
Manoach, D. S., Schlaug, G., Siewert, B., Darby, D. G., Bly, B. M., Benfield, A., et al. (1997). Prefrontal cortex fMRI signal changes are correlated with working memory load.
McCann, R., & Johnston, J. (1992). Locus of the single-channel bottleneck in dual-task interference.
McIntosh, A. R. (1999). Mapping cognition to the brain through neural interactions.
McIntosh, A. R. (2000). Towards a network theory of cognition.
Meyer, D. E., & Kieras, D. E. (1997a). A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms.
Meyer, D. E., & Kieras, D. E. (1997b). A computational theory of executive cognitive processes and multiple-task performance: Part 2. Accounts of psychological refractory-period phenomena.
Meyer, D. E., & Kieras, D. E. (1999). Precis to a practical unified theory of cognition and action: Some lessons from EPIC computational models of human multiple-task performance. In D.Gopher & A.Koriat (Eds.),
Mitz, A. R., Godschalk, M., & Wise, S. P. (1991). Learning-dependent neuronal activity in the premotor cortex: Activity during the acquisition of conditional motor associations.
Mustovic, H., Scheffler, K., Di Salle, F., Esposito, F., Neuhoff, J. G., Hennig, J., et al. (2003). Temporal integration of sequential auditory events: Silent period in sound pattern activates human planum temporale.
Naatanen, R. (1971). Non-aging foreperiods and simple reaction time.
Nickerson, R. S. (1965). Response time to the second of two successive signals as a function of absolute and relative duration of intersignal interval.
Nickerson, R. S. (1967). Expectancy, waiting time and the psychological refractory period.
Niemi, P., & Naatanen, R. (1981). Foreperiod and simple reaction time.
Oberauer, K., & Kliegl, R. (2004). Simultaneous cognitive operations in working memory after dual-task practice.
Ohbayashi, M., Ohki, K., & Miyashita, Y. (2003, July11). Conversion of working memory to motor sequence in the monkey premotor cortex.
Pashler, H. (1984). Processing stages in overlapping tasks: Evidence for a central bottleneck.
Pashler, H. (1989). Chronometric evidence for central postponement in temporally overlapping tasks.
Pashler, H. (1990). Do response modality effects support multiprocessor models of divided attention?
Pashler, H. (1994a). Divided attention: Storing and classifying briefly presented objects.
Pashler, H. (1994b). Dual-task interference in simple tasks: Data and theory.
Pashler, H. (1994c). Overlapping mental operations in serial performance with preview.
Pashler, H., & Johnston, J. C. (1989). Attentional limitations in dual-task performance. In H.Pashler (Ed.),
Pashler, H., Johnston, J. C., & Ruthruff, E. (2001). Attention and performance.
Pashler, H., Luck, S. J., Hillyard, S. A., Mangun, G. R., O'Brien, S., & Gazzaniga, M. S. (1994). Sequential operation of disconnected cerebral hemispheres in split-brain patients.
Petersen, S. E., van Mier, H., Fiez, J. A., & Raichle, M. E. (1998). The effects of practice on the functional anatomy of task performance.
Rieke, F., Warland, D., van Steveninck, R. de R., & Bialek, W. (1997).
Roland, P. E. (1993).
Rolls, E. T. (2000). Memory systems in the brain.
Ruthruff, E., Johnston, J. C., & Van Selst, M. (2001). Why practice reduces dual-task interference.
Ruthruff, E., Miller, J., & Lachmann, T. (1995). Does mental rotation require central mechanisms?
Ruthruff, E., Pashler, H. E., & Klaassen, A. (2001). Processing bottlenecks in dual-task performance: Structural limitation or strategic postponement?
Salvucci, D. D., & Taatgen, N. A. (2008). Threaded cognition: An integrated theory of concurrent multitasking.
Schneider, D. W., & Logan, G. D. (in press).
Schubotz, R. I., Friederici, A. D., & von Cramon, D. Y. (2000). Time perception and motor timing: A common cortical and subcortical basis revealed by fMRI.
Schubotz, R. I., & von Cramon, D. Y. (2001). Functional organization of the lateral premotor cortex: fMRI reveals different regions activated by anticipation of object properties, location and speed.
Schumacher, E. H., Lauber, E. J., Glass, J. M., Zurbriggen, E. I., Gmeindl, L., Kieras, D. E., & Meyer, D. E. (1999). Concurrent response-selection processes in dual-task performance: Evidence for adaptive executive control of task scheduling.
Shafritz, K. M., Kartheiser, P., & Belger, A. (2005). Dissociation of neural systems mediating shifts in behavioral response and cognitive set.
Simon, S. R., Meunier, M., Piettre, L., Berardi, A. M., Segebarth, C. M., & Boussaoud, D. (2002). Spatial attention and memory versus motor preparation: Premotor cortex involvement as revealed by fMRI.
Smith, E. E., & Jonides, J. (1998). Neuroimaging analyses of human working memory.
Solomons, L. M., & Stein, G. (1896). Normal motor automatism.
Sommer, W., Leuthold, H., & Schubert, T. (2001). Multiple bottlenecks in information processing? An electrophysiological examination.
Sporns, O., Tononi, G., & Edelman, G. M. (2000). Connectivity and complexity: The relationship between neuroanatomy and brain dynamics.
Taylor, J. (2003). Paying attention to consciousness.
Taylor, J., Horwitzc, B., Shaha, N. J., Fellenzb, W. A., Mueller-Gaertnera, H.-W., & Krausee, J. B. (2000). Decomposing memory: Functional assignments and brain traffic in paired word associate learning.
Ulrich, R., Leuthold, H., & Sommer, W. (1998). Motor programming of response force and movement direction.
Ungerleider, L., & Haxby, J. V. (1994). “What” and “where” in the human brain.
van Mier, H., Tempel, L. W., Perlmutter, J. S., Raichle, M. E., & Petersen, S. E. (1998). Changes in brain activity during motor learning measured with PET: Effects of hand of performance and practice.
Van Selst, M., & Jolicoeur, P. (1997). Decision and response in dual-task interference.
Vartanian, O., & Goel, V. (2005). Task constraints modulate activation in right ventral lateral prefrontal cortex.
Wearden, J. H., Edwards, H., Fakhri, M., & Percival, A. (1998). Why “sounds are judged longer than lights”: Application of a model of the internal clock in humans.
Welch, J. (1898). On the measurement of mental activity through muscular activity and the determination of a constant of attention.
Welford, A. T. (1952). The “psychological refractory period” and timing of high speed performance: A review and a theory.
Wildgruber, D., Ackermann, H., & Grodd, W. (2001). Differential contributions of motor cortex, basal ganglia, and cerebellum to speech motor control: Effects of syllable repetition rate evaluated by fMRI.
Wu, C., & Liu, Y. (2004a, July–August).
Wu, C., & Liu, Y. (2004b, July–August).
Wu, C., & Liu, Y. (2007a). Queueing network modeling of driver workload and performance.
Wu, C., & Liu, Y. (2007b). A new software tool for modeling human performance and mental workload.
Wu, C., & Liu, Y. (2008). Queuing network modeling of transcription typing.
Wu, C., Liu, Y., & Walsh, C. (in press). Queueing network modeling of a real-time psychophysiological index of mental workload: P300 in event-related potential (ERP).
Wu, C., Tsimhoni, O., & Liu, Y. (in press). Development of an adaptive workload management system using queueing network-model of human processor.
Zysset, S., Muller, K., Lehmann, C., Thone-Otto, A. I. T., & von Cramon, D. Y. (2001). Retrieval of long and short lists from long term memory: A functional magnetic resonance imaging study with human subjects.
Tables A1–A9 list the parameters (including their values, descriptions, and sources) used in modeling different psychological refractory period experimental results.
<anchor name="B"></anchor> <h31 id="rev-115-4-913-d71e6405">APPENDIX B: Mathematical Modeling of Expected Reaction Time to Task 2 (Simple Reaction Task) in the Experiments of Karlin and Kestenbaum (1968) and Sommer, Leuthold, and Schubert (2001)</h31>Since Task 2 (T2) in Karlin and Kestenbaum (1968) and Sommer, Leuthold, and Schubert (2001) is a simple reaction task, its mathematical modeling methods can be described in the following section.
There are two conditions in modeling the expected reaction time to T2 (RT2) at the simple reaction condition. At short stimulus onset asynchrony (SOA) conditions (entities of T2 arrive at Server F before Server F starts its anticipation process, ta = 0; see Figure B1), entities of T2 have to wait until entities of Task 1 (T1) leave Server F; after entities of T1 leave Server F, entities of T2 enter Server F immediately. Since Server F is occupied by the entities of T2 (participants are busy in performing judgment of T2), the anticipation process does not occur in this condition. At long SOA conditions, Server F starts its anticipation process before entities of T2 arrive at Server F. The mathematical models of RT2 (simple reaction condition) are constructed based on these two conditions in the following sections.
Under short SOA conditions of T2 (simple reaction condition), the expected RT2 is also modeled with the same form of equation as in the choice reaction condition of RT2, except that the motor subnetwork's servers are replaced by the servers involved in the simple reaction time (see Equation B1 and Figure B1). <anchor name="eq69"></anchor>
where T1,AP¦VP is the processing time at the auditory perceptual subnetwork (Karlin & Kestenbaum's, 1968, experiment) or visual perceptual subnetwork (Sommer et al.'s, 2001, experiment) and T1,B¦A is the processing time at Server B (Karlin & Kestenbaum's, 1968, experiment) or Server A (Sommer et al.'s, 2001, experiment).
The anticipation process (Response 2 [R2] is made without seeing Stimulus 2 [S2]) at Server F is quantified by the following mechanisms in time perception. According to the function of Server F in anticipating a sensory event in a simple reaction task (Schubotz, Friederici, & von Cramon, 2000; Schubert & von Cramon, 2001; see the introductory section in the main text of this article), the longer Server F anticipates S2 (defined as perceived waiting time, tperc), the higher the probability (defined as p) of trigging motor response without seeing S2 (anticipation process) (see Equation B2). <anchor name="eq70"></anchor>
where Tperc is the duration between when the anticipation process starts and the probability when participants make the motor response equal to 1.
On the basis of psychophysical research in studying the relationship between perceived waiting time (tperc) and actual waiting time (ta) in very short time periods, there is considerable support for a psychophysical law for perceptual duration described by a power function following Steven's power law (Eisler, 1975, 1976). Thus, <anchor name="eq71"></anchor>
where ta is the duration between when Server F starts the anticipation process and when S2 arrives at the perceptual subnetwork. k and β are the parameters in Steven's power law (Wearden, Edwards, Fakhri, & Percival, 1998). Combining Equations B2 and B3 results in <anchor name="eq72"></anchor>
We can also get <anchor name="eq73"></anchor>
Moreover, since p is defined as the probability that the response of T2 is made with the anticipation process (R2 is made without seeing S2), there are two conditions in which expected RT2 is modeled: RT2 with or without the anticipation process.
On the basis of Figure B1, we can develop the expected RT2 with the anticipation process—E(RT2,ANTI)—into <anchor name="eq74"></anchor>
where TFst is the time point when Server F starts its anticipation process (see Equation B7 and Figure B1). <anchor name="eq75"></anchor>
From Equation B3, ta can be rewritten into <anchor name="eq76"></anchor>
Moreover, since participants end their waiting process of S2 when they perceive the time reaches the perceived SOA, the perceived waiting time (tperc) equals the perceived SOA (SOAperc) minus the perceived TFst (TFst_perc), that is, <anchor name="eq77"></anchor>
where SOAperc and TFst_perc can be derived from Equation B3, that is, SOAperc = kSOAβ, and TFst_perc = kTFstβ, resulting in <anchor name="eq78"></anchor>
Combining Equations B4, B8, and B10 results in <anchor name="eq79"></anchor>
and <anchor name="eq80"></anchor>
Under the condition that there is no anticipation, the expected RT2—E(RT2,NOAN)—is modeled with the same form of the equation as in the choice reaction condition, except that the motor subnetwork's servers are replaced by the servers involved in the simple reaction task (see Equation B13 and Figure B1). <anchor name="eq81"></anchor>
Hence, the expected RT2 in long SOA conditions (ta > 0) can be quantified by Equation B14: <anchor name="eq82"></anchor>
In sum, the expected RT2 under the simple reaction condition is <anchor name="eq83"></anchor>
Combing Equations B4, B11, B13, and B14, Equation B15 can be rewritten into <anchor name="eq84"></anchor>
Negative response of reaction time to Task 2 (RT2)—(RT2 < 0)—means that Response 2 (R2) occurs prior to the arrival of Stimulus 2 (S2), that is, the arrival of S2 is stimulus onset asynchrony (SOA). On the basis of Figure B1 (see Appendix B), the interval between the arrival of Stimulus 1 (time = 0) and the occurrence of R2 is TFst + ta + T2,C + T2,V + T2,Z + T2,K.
Supposing u = T2,C + T2,V + T2,Z + T2,K results in <anchor name="eq85"></anchor>
Since ta ranges from 0 to SOA − TFSt (ta ends when S2 arrives according to its definition), the probability of the RT2 < 0 (Pn) is <anchor name="eq86"></anchor>
Solving the integral then results in <anchor name="eq87"></anchor>
Using Cohen's (1997) model, Anderson, Qin, Sohn, Stenger, and Carter (2003; Anderson, Bothell, et al., 2004; Anderson, Qin, Stenger, & Carter, 2004) proposed that the integrated BOLD signal—CB(t)—in a certain brain region is mainly determined by several factors: the length of time the current buffer/server occupied throughout time t (i[x]: at time x, if the current buffer/server is occupied, i[x] = 1; otherwise, i[x] = 0), latency scale s, and magnitude scale M (see Equation D1; Anderson et al., 2003; Anderson, Bothell, et al., 2004; Anderson, Qin, et al., 2004). <anchor name="eq88"></anchor>
where B(T) = kTae−T/b (Cohen, 1997). In the queuing network model, assuming the length of time Server i is being used is η, Equation D1 can be further developed into <anchor name="eq89"></anchor>
Suppose
, and combine Equation D2 with Cohen's equation B(T) = kTae−T/b; then, Equation D2 can be rewritten into Equation D3: <anchor name="eq90"></anchor>
Solving the integer above results in Equation D4, at the top of the page, <anchor name="eq91"></anchor>
where the result of the Whittaker function—WhittakerM(m, n, z)—can be obtained by solving the following differential equation:
.
Equation 30 in the main text is derived on the basis of Black's study (1999) as well as other neuroscience findings. Brain-derived neurotrophic factor (BDNF) regulates synaptic plasticity in adults: BDNF increases the activity of N-methyl-d-aspartate receptors, increases neuron channel open probability by increasing opening frequency, and then increases the velocity of information flow travel (V) through these neuron channels. Hence, the stronger synaptic connection strength (the amount of presynaptic transmitter released and the degree of postsynaptic responsiveness) of an individual route, the greater the probability (Pi) that information flow (represented by entities) travels through that route (Ashby, Ennis, & Spiering, 2007; Black, 1999; Braus, 2004; Chklovskii, Mel, & Svoboda, 2004; Habib, 2003; see Equation E1 and Figure E1) in total U multiple routes. <anchor name="eq92"></anchor>
where the numerator (STi) stands for the standardized synaptic connection strength of Route i (STi ∈ [0, 1]). The denominator represents the sum of the standardized synaptic connection strength of all the multiple routes starting from the original brain region (Server 0 in Figure E1). Moreover, the standardized synaptic connection strength of Route i (STi) is in direct proportion to the standardized velocity (Vi) that the information flow travels through that route (Black, 1999; Bullock, 1968; Chklovskii et al., 2004; see Equation E2). <anchor name="eq93"></anchor>
where r0 is a parameter that stands for the ratio between STi and Vi.
Since the queuing network is able to capture several properties of information processing in the human brain—information flow (represented by entities) travels through different brain regions and forms brain traffic, including the possible waiting of the previous information flow to be processed (see the first assumption in modeling the practice effect)—the travel time of the information flow (represented by entities) in Route i is composed of both waiting and processing time, and therefore, this travel time can be regarded as the sum of waiting time (Wi) and processing time (Ti) of entities, that is, sojourn time (Si) in that route. Furthermore, this sojourn time or travel time (sum of waiting and processing time) is in inverse proportion to the standardized velocity (Vi) of the travel process (see Equation E3). <anchor name="eq94"></anchor>
where γ is a parameter that represents the inverse ratio between Wi + Ti and Vi.
Combining Equations E1–E3, Equations E4 and E5 quantify the probability (Pi) that the information flow (entities) passes through Route i in totally U multiple routes. <anchor name="eq95"></anchor>
Thus, we have <anchor name="eq96"></anchor>
On the basis of Figure B1 in Appendix B, the time that entities enter Server V (Vst) can be estimated in two conditions depending on the value of ta (ta = 0, short stimulus onset asynchrony [SOA] conditions; ta > 0, long SOA conditions; see Equation F1): <anchor name="eq97"></anchor>
Since Vst starts from the arrival of Stimulus 1 and stimulus-lateralized readiness potential onset time (S-LRP) starts from the arrival of Stimulus 2 (Sommer, Leuthold, & Schubert, 2001), S-LRP equals Vst − SOA: <anchor name="eq98"></anchor>
Since ta = max[(SOAβ − TFstβ)1/β, 0], Equation F2 can be rewritten into the main text's Equation 23 (see below).
On the basis of the five possible conditions described in Figure 23 in the main text, the following sets of equations were developed to predict the expected reaction time in the response grouping effect. <anchor name="eq99"></anchor>
where T1,A¦B is the processing time at Server A or B (depending on Task 1's [T1's] route), GR refers to the time in grouping the two responses together, and SF1 and SF2 are the sum of processing time of servers after Server F (e.g., Servers Y, W, and Z) of T1 and Task 2, respectively. <anchor name="eq100"></anchor>
<anchor name="eq101"></anchor>
<anchor name="eq102"></anchor>
<anchor name="eq103"></anchor>
Specifically, in Ruthruff, Pashler, and Klaassen's (2001) experimental study, T1,P = TS,P, T1,A¦B = TS,A, T1,F = TS,F, SF1 = SFS = TS,C + TS,W + TS,Y + TS,Z + TS,K; T2,P = TT,P, T2,A¦B = TT,B, T2,F = TT,F, SF2 = SFT = TT,C + TT,Y + TT,Z + TT,VO. On the basis of Equations G1–G5, RT1-route in Ruthruff, Pashler, and Klaasen's experimental study can be estimated: <anchor name="eq104"></anchor>
where GR refers to the time in grouping the two responses together. <anchor name="eq105"></anchor>
<anchor name="eq106"></anchor>
<anchor name="eq107"></anchor>
<anchor name="eq108"></anchor>