Abstract
Background
Work in humans has shown that impulsivity can be advantageous in certain settings. However, evidence for so-called functional impulsivity is lacking in experimental animals.
Aims
This study investigated the contexts in which high impulsive (HI) rats show an advantage in performance compared with mid- (MI) and low impulsive (LI) rats. We also assessed the effects of dopaminergic and noradrenergic agents to investigate underlying neurotransmitter mechanisms.
Methods
We tested rats on a variable inter-trial interval (ITI) version of the 5-choice serial reaction time task (5CSRTT). Rats received systemic injections of methylphenidate (MPH, 1 mg/kg and 3 mg/kg), atomoxetine (ATO, 0.3 mg/kg and 1 mg/kg), amphetamine (AMPH, 0.2 mg/kg), the alpha-2a adrenoceptor antagonist atipamezole (ATI, 0.3 mg/kg) and the alpha-1 adrenoceptor agonist phenylephrine (PHEN, 1 mg/kg) prior to behavioural testing.
Results
Unlike LI rats, HI rats exhibited superior performance, earning more reinforcers, on short ITI trials, when the task required rapid responding. MPH, AMPH and ATI improved performance on short ITI trials and increased impulsivity in long ITI trials, recapitulating the behavioural profile of HI. In contrast, ATO and PHEN impaired performance on short ITI trials and decreased impulsivity, thus mimicking the behavioural profile of LI rats. The effects of ATO were greater on MI rats and LI rats.
Conclusions
These findings indicate that impulsivity can be advantageous when rapid focusing and actions are required, an effect that may depend on increased dopamine neurotransmission. Conversely, activation of the noradrenergic system, with ATO and PHEN, led to a general inhibition of responding.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Impulsivity is a multifactorial construct more generally understood as the tendency to act prematurely without foresight (Dalley et al. 2011; Evenden 1999; Whiteside and Lynam 2001; Winstanley et al. 2006). It is often regarded as a maladaptive trait and indeed is widely associated with various psychiatric disorders, including drug addiction (de Wit 2009; Jentsch and Taylor 1999; Kollins et al. 2005) and attention-deficit hyperactivity disorder (ADHD, Solanto 2002). However, impulsivity need not be an exclusively dysfunctional trait and may even be advantageous in certain contexts (Dickman 1985; Dickman 1990; Smillie and Jackson 2006; Cools et al. 2005).
Dickman (1990, 2000) advanced the concept of functional impulsivity, that is ‘the tendency to engage in rapid, error-prone information processing when such a strategy is (..) optimal’, (p.101, Dickman 1990). Based on research in human subjects, Dickman concluded that when the experimental task is very simple, the rapid responding typical of ‘high impulsives’ does not lead to a higher rate of errors (Dickman 1985). Similarly, when there is little time available to make a decision, high impulsive individuals respond with greater accuracy than low impulsive individuals (Dickman and Meyer 1988). In line with this early evidence, it was recently shown that trait impulsivity boosts performance in highly rewarding settings (Cools et al. 2005). Similar conclusions on the advantages of impulsivity can be drawn from other contexts, including entrepreneurship (Lerner et al. 2019; Verheul et al. 2015), and creative literature (Lawrence et al. 2008; White and Shah 2011), and are consistent with the recognised role of context in the expression of ADHD (Barkley 2002; Williams and Dayan 2005). Thus, environments encompassing novel, interesting, and fast-paced activities improve ADHD symptoms among young adults (Lasky et al. 2016).
However, despite growing evidence in humans that impulsivity can confer some adaptive advantages, research in experimental animals is lacking. To investigate whether higher levels of impulsivity can be advantageous in certain contexts, we tested rats on the 5-choice serial reaction time task (5CSRTT) and presented them with pseudo-randomly interleaved inter-trial intervals (ITI) of varying durations from relatively short intervals, of 3 and 5 s in duration, to longer intervals, of 7 and 9 s in duration. We predicted that high impulsive (HI) rats, who typically respond prematurely before the occurrence of any light cue, would perform better when the task requires them to respond quickly whilst low impulsive (LI) rats would be impaired. On the contrary, we expected LI rats to have superior performance when the task required animals to wait longer for the stimulus to appear. To further test how performance on rapid trials was affected by context (i.e. the presentation of interleaved slow and rapid trials) and the extent to which HI and LI rats adapt to high-event rate trials, we also evaluated the effects of short trial presentations, with pseudo-randomly interleaved 3 s and 2 s ITIs. The variable ITI (vITI) paradigm offers a range of ITIs and can thus allow different behavioural tendencies to emerge. In addition, the unpredictability in the presentation of each ITI increases attentional load, whilst controlling for the habituation or timing strategies that the animals may adopt as the session progresses (Bizarro et al. 2004; Cope et al. 2016). Whilst other studies have examined performance under vITI versions of the 5CSRTT (Bizarro et al. 2004; Callahan et al. 2019; Carli et al. 1983; Navarra et al. 2008; Paterson et al. 2011; Robinson 2012; Sirviö et al. 1993), none have yet investigated whether HI and LI rats perform differentially during this experimental manipulation and whether a specific impulsivity phenotype confers a selective advantage in performance. Blondeau and Dellu-Hagedorn (2007) tested whether rats segregated on the basis of impulsivity as well as attentional accuracy show a selective advantage in long (8 s) ITI as opposed to short (2 s) ITI trials. Those authors, however, presented trials in isolation as separate challenges and only measured percentage premature responses and percentage correct responses as indexes of performance efficiency. Percentage correct responses, however, does not adequately test whether a specific phenotype has an advantage in performance since it obscures information on incorrect responses and could thus just indicate a more or less prominent response bias in a specific ITI, but not superior performance. In our study, we instead assessed reinforcers earned and omission responses, as well as premature responses, to test the hypothesis that HI and LI rats exhibit different advantages in performance depending on the ITI. Finally, Blondeau and Dellu-Hagedorn (2007) did not test the stability of performance of different impulsivity phenotypes, whilst we tested this on multiple sessions and in two separate batches of animals, thus strengthening the validity of our results.
Additionally, we administered pharmacological agents that are widely used to treat ADHD — d-amphetamine (AMPH), methylphenidate (MPH) and atomoxetine (ATO) — to investigate how different medications affect the performance of animals segregated on the basis of their impulsivity phenotype. Importantly, we chose drugs with different though overlapping effects on catecholamine transmission to more precisely dissect the contribution of distinct neurotransmitter systems in the vITI-5CSRTT paradigm. On the basis of evidence showing that AMPH and MPH impair ‘waiting’ impulsivity (Navarra et al. 2008; Pattij et al. 2007) and decrease response latency (Bizarro et al. 2004), we predicted that administration of these drugs would lead to an improvement of performance in short ITI trials especially. On the contrary, since ATO reduces impulsivity (Blondeau and Dellu-Hagedorn 2007) and slows responding in some contexts (Callahan et al. 2019), we predicted that ATO would mostly enhance performance on long ITI trials. To better dissect the role that noradrenaline (NA) plays in modulating performance of HI and LI rats, we also assessed the effects of systemic administration of atipamezole (ATI), an alpha-2a antagonist, and phenylephrine (PHEN), an alpha1 agonist. To the best of our knowledge, ATI and PHEN have not been tested on animals segregated based on impulsivity; thus, it is unknown how these drugs would interact with this phenotype. In addition, PHEN has never been tested on a vITI paradigm such as the one used in this experiment. On the basis of evidence showing that ATI increases behavioural activation (Ma et al. 2005; Sirviö et al. 1994), whilst PHEN has the opposite effect (Pattij et al. 2012), we predicted that the former would improve performance during short ITI trials, whilst the latter would impair performance.
Methods and materials
Subjects
Sixty outbred male Lister Hooded rats (Charles River, Margate, UK) weighing 280–300 g at the beginning of the experiments were used for this study. Animals were acclimatised to the animal facility under a 12 h:12 h light cycle (lights off at 7 AM) for a minimum of 7 days before any procedure began. When rats reached a body weight of approximately 300 g, they were food-restricted to maintain approximately 90% of their free-feeding weight trajectory (19 g of Purina rodent chow per animal and day; adjusted for reward pellet consumption during testing). Water was available ad libitum, and food was given at the end of each day’s testing. All procedures conformed to the UK (1986) Animal (Scientific Procedures) Act (Project licence PA9FBFA9F: Neurobehavioural mechanisms of mental health, held by Dr. A. L. Milton) and were approved by the local Ethics Committee at Cambridge University.
Behavioural apparatus
Twelve five-hole operant chambers (Med Associates, Georgia, VT) controlled by two computers and Whisker Control software (Cardinal and Aitken 2010) were used. Each chamber was enclosed in a ventilated sound-attenuating box, fitted with five apertures in a curved wall and a food magazine on the opposite wall of the box that delivered rodent sugar pellets (TestDiet®, Purina, UK). A yellow light-emitting diode stimulus was placed at the rear of each aperture. The food magazine and entire chamber were illuminated by light emitting diodes. Infrared beams detected responses in the magazine and apertures.
Five-choice serial reaction time task: training
All rats were trained in the 5CSRTT as described previously (Bari et al. 2008). Animals were trained to detect a brief visual cue appearing in one of five apertures of the operant chambers. Each trial is initiated when the rat pokes into the food magazine, and the visual cue is presented after an ITI of 5 s. A response was deemed ‘correct’ if the animal poked into the hole where the light was presented within 5 s of target presentation. A nose-poke response occurring before the appearance of the visual cue was considered ‘premature’, whilst a response occurring in any of the apertures where the light was not presented was considered ‘incorrect’. A failure to respond within 5 s of target presentation was recorded as an ‘omission’ of response. Only correct responses were rewarded with a food pellet (Noyes dustless pellets, Research Diets, UK), whilst incorrect, premature and omission responses were punished with a time-out period of 5 s. During a time-out, the animal was required to wait for the beginning of the next trial in order to engage again with the task. Nose-pokes in any of the holes made after a correct or incorrect response, but prior to reward collection, were deemed ‘perseverative’ but were not signalled by punishment. Each session lasted a maximum of 100 trials or 30 min, whichever limit was reached first. During the training session, stimulus duration was set at 30 s and was gradually decreased over sessions until animals reached stable baseline performance (accuracy, >80% correct choice and <20% errors of omission). In Experiment 1, thirty-six animals were trained to reach a stable baseline performance on the 5CSRTT with a final stimulus duration of 0.7 s and an ITI of 5 s. In Experiment 2, twenty-four animals were trained to reach a stable baseline performance on the 5CSRTT with a final stimulus duration of 0.6 s and an ITI of 5 s.
Experiment 1: Effects of impulsivity trait on behavioural performance at variable ITIs
Variable ITI challenge
Thirty-six rats reached a stable baseline performance and were subsequently exposed to two vITI sessions. Each vITI session was followed by at least 1 day of baseline testing where rats were run according to the baseline parameters specified above. Each vITI session consisted of a pseudo-random presentation of trials with 3 s, 5 s, 7 s, and 9 s ITI (mean of 6 s). Each ITI was presented at least 50 times, and the session ended when animals had completed 200 trials or after 2 h (whichever event occurred first). Animals could not predict which ITI was going to be presented on each trial. Time-out (0.5 s) and stimulus duration (0.7 s) were kept constant at the same level as their baseline training. To identify which animals exhibited extreme impulsivity phenotypes, rats underwent an impulsivity screening procedure. Specifically, premature responses across the 2 days of vITI challenge were averaged, and the upper (i.e. the 9 highest-impulsive rats) and lower (i.e. the 9 lowest-impulsive rats) were selected. Animals falling between these two extremes were classified as mid-impulsive (MI) rats.
Short vITI challenge: rapid stimulus presentation
A day after their last vITI challenge, rats were presented with a short vITI session. This consisted of 100 trials of 3 s ITI and 50 trials of 2 s ITI (mean of 2.6 s). The two different ITI trials were pseudo-randomly interleaved, and the rat could not predict which ITI trial was going to be presented. The session ended when rats had completed 150 trials or after 1 h and 30 min (whichever occurred first). More instances of the 3 s ITI were presented compared to the 2 s ITI, to avoid making the task too difficult (and risk having floor effects), whilst still exploring whether rats could be challenged with even quicker ITI trials than 3 s and whether trait impulsivity influenced performance on these two ITIs differently.
Experiment 2: Effects of methylphenidate, atomoxetine, amphetamine, atipamezole and phenylephrine on vITI performance
Variable ITI challenge
Twenty-four rats were exposed to three vITI sessions similar to those of Experiment 1. Each vITI session was followed by at least 1 day of baseline testing with the baseline parameters specified above. Each vITI session consisted of a pseudo-random presentation of trials with 3 s, 5 s, 7 s and 9 s ITI. Each ITI was presented at least 50 times; the session ended when animals had completed 200 trials or when 2 h had passed (whichever occurred first). Animals could not predict which ITI was going to be presented on each trial. Time-out (5 s) and stimulus duration (0.6 s) were kept constant at the same level as that of their baseline training. To identify which animals exhibited extreme impulsivity phenotypes, rats underwent a screening procedure. Specifically, premature responses across the 3 days of vITI challenge were averaged, and the upper (N = 6) and lower (N = 6) quartiles were selected. Animals falling between these two extremes were deemed MI impulsive rats. Following this challenge, rats were also tested on a fixed 7 s ITI session to compare behaviour on the vITI challenge with previous studies on impulsive responding using a fixed 7 s ITI procedure.
Systemic drug administration
All rats (HI, MI and LI) received control injections of the vehicle 2 days before the start of the experiment. All drugs were administered sub-cutaneously (s.c.) 40 min prior to testing. The drug experiments consisted of two separate randomised within-subject cross-over Latin-square designs, to control for training and crossover effects. These two Latin-square designs were separated by at least 3 days of washout. In Latin-square 1, vehicle, MPH (1 mg/kg and 3 mg/kg) and ATO (0.3 mg/kg and 1 mg/kg) were administered. In Latin-square 2, vehicle, AMPH (0.2 mg/kg), ATI (0.3 mg/kg) and PHEN (1 mg/kg) were administered. All drugs were dissolved in 0.9% saline and vehicle consisted of just 0.9% saline. Drugs were tested on vITI challenges only (mean ITI of 6 s).
Data analysis
The main dependent variables were percentages of premature responses, percentages of omission responses, the number of reinforcers earned and response latencies to make correct, incorrect or premature responses. To assess the temporal profile of responses, we divided the vITI sessions into 5-min bins. Each bin had to have responses from at least three animals from each impulsivity group to be included in the analyses. The 5-min bins satisfying this criteria, across different sessions and cohorts of animals, were from 5 to 55 min (11 bins).
Percentages, number of reinforcers and the number of active responses per unit of time were square root transformed. Latencies were log-transformed. Transformations were applied to enable comparisons with previous publications (Hervig et al. 2020; Milstein et al. 2010) and to avoid incurring issues of non-normal data distributions. Statistical tests were performed with RStudio, version 1.2.1335 (RStudio, Inc). Data were subjected to Linear Mixed-Effects Model analysis with the lmer package in R. To validate whether the data transformations improved model fit, we compared the AIC values of the models with transformed and non-transformed data. The model with transformed data yielded the lowest AIC values for all variables. For analyses of behaviour prior to any drug manipulation, the model contained three fixed factors (day, ITI and impulsivity) and one factor (subject) modelled as a random slope to account for individual differences between rats across testing days. When significant three-way interactions were found, further analysis was performed by conducting separate multilevel models on ‘day’. For analyses of drug interventions, the model contained three fixed factors (ITI, impulsivity and drug) and one factor (subject). When significant three-way interactions were found, further analysis was performed by conducting separate multilevel models on ‘impulsivity’. For all analyses, significance was considered at α = 0.05. When significant interactions were found, further analysis was performed by conducting post hoc Tukey’s corrected pairwise comparisons. For drug manipulations, post-hoc testing was used to determine differences with vehicle treatment only.
Results
Baseline performance prior to the vITI challenge was analysed and is reported in detail in the supplementary materials. Briefly, on baseline, HI rats exhibited elevated premature responses compared with the other two groups.
Experiment 1: Effects of impulsivity trait on behavioural performance at variable ITIs
For reinforcers earned, there was a significant Day × ITI × Group interaction (F(6,231) = 2.89, p = 0.010). Since the three-way interaction was significant, separate multilevel models were used to ascertain the Group dependency of the ITI effects in each Day separately. Impulsivity phenotype determined the efficacy of performance in terms of earned reinforcers at different ITI values for the second day of testing (Group × ITI interaction, F(6,99) = 21.91, p < 0.001). This is shown in Fig. 1A where HI rats obtained more reinforcers than LI rats (t = 6.30, p < 0.001) and MI (t = 4.51, p < 0.001) on the short 3 s ITI trials, with MI rats also earning more reinforcers than LI on the short 3 s ITI trials (t = 2.77, p = 0.018). HI also earned more reinforcers than LI on the 5 s ITI trials (t = 2.81, p = 0.002) but earned fewer reinforcers than LI (t = −3.65, p = 0.012; t = −4.69, p < 0.001) and MI (t = −2.87, p = 0.009; t = −2.55, p < 0.001) on the long 7 s and 9 s ITI trials, respectively. A similar effect was evident on day 1 of testing as shown by Figure S1a in the supplementary materials. In summary, HI rats earned more reinforcers at shorter ITI trials, whilst LI rats earned more reinforcers at longer ITI trials.
Both impulsivity phenotype and ITI influenced the incidence of omission responses (Group × ITI, F(6,231) = 2.76, p = 0.013). Figure 1B shows data for the second day of testing. LI rats made proportionally more omission responses than HI rats (t = −5.06, p < 0.001) and MI (t = −3.82, p <0.001) on the short 3 s ITI. LI rats also made more percentages of omission errors than HI rats on the 5 s ITI trials (t = −2.80, p = 0.018). In summary, LI rats were more prone than HI and MI at making omission errors, and these occurred on short ITI trials.
For percentages of premature responses, there was a significant Day × ITI × Group interaction (F(6,231) = 3.26, p = 0.004). Since the three-way interaction was significant, separate multilevel models were used to ascertain the Group dependency of the ITI effects in each Day separately. Impulsivity phenotype and ITI influenced the frequency of premature responses in the second day of testing (Group × ITI interaction, F(6,99) = 12.92, p < 0.001). Figure 1C shows that HI rats made proportionally more premature response than LI and MI rats during 5 s ITIs (t = 3.34, p = .003; t = 3.77, p < 0.001, respectively), 7 s ITIs (t = 9.16, p < 0.001; t = 7.24, p < 0.001, respectively) and 9 s ITIs (t = 7.96, p < .001; t = 5.86, p < 0.001, respectively). MI rats also made more percentages of premature response than LI rats on the 7 s ITI (t = 3.34, p = 0.003) and the 9 s ITI (t = 3.33, p = 0.004). A similar pattern was evident on day 1 as shown by Figure S1b in the supplementary materials. In summary, HI rats and to an extent MI rats made proportionally more premature responses than LI rats, and these occurred during the long ITI trials.
We then combined premature, correct and incorrect responses and divided the session into 5-min bins to examine whether HI, MI and LI rats differ in overall rate of responding. There was an effect of impulsivity phenotype on number of active responses per unit of time (F(2,33) = 6.32, p = 0.005). Specifically, HI rats were significantly more active than LI rats (t = 3.54, p = 0.003). For more details on this, see Figure S2 in the supplementary materials.
We next assessed the relationships between the various behavioural variables. During the first (r = −0.46, p = 0.005) and second (r = −0.37, p = 0.028) day of testing, there was an overall significant negative relationship between making an omission on the 3 s ITI and making a premature response on the 9 s ITI. There was also a strong positive correlation between making a correct response on the 3 s ITI and making a premature response on the 9 s ITI both on day 1 (r = 0.64, p < 0.001) and on day 2 (r = 0.64, p < 0.001). These correlations are in line with behavioural data analysed by impulsivity phenotype, showing that animals that respond prematurely during long ITI trials are also more likely to respond correctly on short ITI trials. Conversely, animals that do not engage with rapid, short ITI trials, and thus make many omissions on these trials, are more likely to respond correctly when waiting is rewarded. Finally, impulsivity groups and ITI types influenced latency to perform correct and premature responses. For more details on this, see Table 1.
Short vITI challenge
We next tested rats with short vITI trials of 2 and 3 s (mean of the vITI session: 2.6 s). Figure 2A shows that the impulsivity groups differed with regard to reinforcers earned (F(2,33) = 3.65, p = 0.037) with HI rats earning significantly more reinforcers than LI rats (t = 2.53, p = 0.041). As shown in Fig. 2B, omissions varied as a function of ITI (F(1,33) = 206.33, p < 0.001) and impulsivity group (F(2,33) = 7.53, p = 0.002). Percentages of omission errors were higher during 2 s ITI trials than 3 s ITI trials (t = 14.36, p < .001), and HI rats made significantly less of these errors than LI (t = −3.77, p = 0.002) and MI (t = −2.94, p = 0.023) rats. These findings show that HI rats show a superior performance compared with LI rats during fast-paced trials.
Latencies to make a correct response varied significantly across different ITIs (F(1,33) = 69.29, p < 0.001) and impulsivity groups (F(2,33) = 4.17, p = 0.024). Latencies to make an incorrect response also varied depending on ITI (F(1,33) = 6.52, p = 0.015). For details on this, see Table S1 in the supplementary materials.
Experiment 2: Effects of methylphenidate, atomoxetine, amphetamine, atipamezole and phenylephrine on vITI performance
Prior to the drug administration studies, rats were trained to a stable baseline level and were tested on three vITI sessions. On baseline, HI rats exhibited elevated premature responses and lower accuracy compared with LI rats (for more details, see the supplementary materials).
Results from the vITI challenges replicated Experiment 1 and are shown in the supplementary section (see Table S2 and Figures S3–S5). Briefly, HI rats earned more rewards and made fewer omissions when the task required rapid information in short ITI trials. When the ITI was increased to longer durations, HI rats showed more premature responses than LI rats. LI rats exhibited the opposite behavioural profile with more rewards during long ITI trials and impaired performance during the short ITI trials with increased omissions. Finally, rats were also tested on a fixed 7 s ITI session, to allow comparisons with previous publications. Briefly, HI rats categorised using the variable ITI procedure exhibited significantly increased levels of premature responding compared with LI rats and MI rats during a fixed 7 s ITI session (for more details see, the supplementary materials).
Figure 3A,B shows that the effects of ATO and MPH on behaviour depended on the ITI (Drug × ITI interaction, F(12,380) = 28.52, p < 0.001). As shown in Fig. 3A, during short 3 s and 5 s ITI trials, ATO (1 mg/kg) significantly decreased the number of reinforcers earned compared with vehicle (t = 7.23, p < .001; t = 6.39, p < .001 respectively for 3 s and 5 s ITI trials). ATO (1 mg/kg) also reduced the number of reinforcers earned during the long 7 s ITIs compared with the vehicle group (t = 3.89, p < 0.001).
In contrast, during short 3 s ITI trials, rats earned more reinforcers following the administration of MPH at both low (1 mg/kg, t = 6.91, p < 0.001) and high (3 mg/kg, t = 7.92, p < 0.001) doses compared with the vehicle group. The beneficial effect of 1 mg/kg MPH extended to the 5 s ITI compared to vehicle (t = 3.20, p = 0.005). However, similar to ATO, during long ITI trials with high-dose MPH (3 mg/kg), performance deteriorated both on the 7 s and 9 s ITI trials (t = 4.10, p < 0.001; t = 4.41, p < 0.001 respectively). Low-dose MPH (1 mg/kg) impaired performance during the 9 s ITI trials (t = 3.49, p = 0.002).
ATO affected performance differently depending on the impulsivity phenotype (Drug × Group interaction, F(8,380) = 2.31, p = 0.020). Specifically, high-dose ATO (1 mg/kg) worsened performance mostly of MI (t = 5.72, p < 0.001) and LI rats (t = 7.66, p < 0.001) and only produced a trend level decrement in performance for HI rats (t = 2.37, p = 0.063, see Fig. 6A).
ATO and MPH affected the percentages of omission errors differently depending on the ITI (Drug × ITI, F(12,380) = 5.38, p < 0.001). Figure 4A shows that treatment with high-dose ATO (1 mg/kg) increased the percentages of omission responses compared to vehicle on all ITIs (3 s ITI: t = 6.82, p < 0.001; 5 s ITI: t = 8.43, p < 0.001; 7 s ITI: t = 7.17, p < 0.001; 9 s ITI: t = 5.78, p < 0.001).
In contrast, Fig. 4B shows that treatment with both high (3 mg/kg) and low-dose (1 mg/kg) MPH reduced the percentages of omission responses on short 3 s ITI trials (t = −7.16, p < 0.001; t = −6.82, p < 0.001 for the high and low doses respectively).
Both ATO and MPH modulated performance differently depending on the impulsivity phenotype (Group × Drug, F(8,380) = 2.20, p = 0.026). Specifically, low-dose ATO (0.3 mg/kg) increased the percentage of omission responses solely for MI rats (t = 4.74, p < 0.001) whilst high-dose (3 mg/kg) and low-dose (1 mg/kg) MPH decreased the percentage of omission responses both for HI (t = 4.42, p = 0.001; t = 4.05, p < 0.001; respectively) and LI rats (t = 3.45, p = 0.004; t = 3.86, p = 0.013; respectively; see Fig. 6C,D).
ATO and MPH affected the percentages of premature response differently depending on the ITI (Drug × ITI, F(12,380) = 15.02, p < 0.001). Figure 5A shows that administration of ATO both low-dose (0.3 mg/kg) and high-dose (1 mg/kg) decreased the percentage of premature responses on trials with 7 s (t = 3.75, p < 0.01; t = 7.62, p < 0.01 for the low and high doses respectively) and 9 s ITIs (t = 3.74, p < 0.01; t = 9.44, p < 0.01 for the low and high doses respectively). High-dose ATO (1 mg/kg) also decreased the percentage of premature responses on the 5 s ITI trials (t = 3.40, p = 0.003). On the contrary, Fig. 5B shows that administration of both low-dose (1 mg/kg) and high-dose (3 mg/kg) MPH increased the percentage of premature responses on the 5 s, 7 s and 9 s ITI trials (low-dose: 5 s ITI t = 3.73, p < 0.001; 7 s ITI t = 6.96, p < 0.001; 9 s ITI t = 4.86, p < 0.001; high-dose: 5 s ITI t = 9.07, p < 0.001; 7 s ITI t = 9.99, p < 0.001; 9 s ITI t = 5.86, p < 0.001). High-dose MPH (3 mg/kg) also increased the percentage of premature responses in the 3 s ITI trials (t = 3.71, p < 0.001).
ATO modulated performance differently depending on impulsivity phenotype (Group × Drug, F(8,380) = 2.82, p = 0.004). Specifically, low-dose ATO (0.3 mg/kg) decreased the percentage of premature responses compared with vehicle in MI (t = 5.38, p < 0.001) and LI (t = 2.98, p = 0.012) but not in HI rats (t = 0.83, p = 0.780; see Fig. 6B). Latencies on correct, incorrect and premature responses following administration of ATO and MPH are shown in Tables S3–S5 of the supplementary materials.
The above findings show that MPH and ATO have essentially opposite effects on performance. Whereas MPH led to a general activation of behaviour, increasing premature responses, decreasing omissions and facilitating responding on short ITI trials, the administration of ATO produced a general inhibition of behaviour with reduced premature responses during long ITI trials and increasing omissions, especially during short ITI trials. Finally, the action of ATO was dependent on trait impulsivity and affected MI and LI rats more so than HI rats.
Effects of amphetamine, atipamezole and phenylephrine
Figure 7A shows that AMPH, PHEN and ATI affected performance on long and short ITI trials differently depending on the ITI (Drug × ITI, F(9,285) = 17.19, p < 0.001). Specifically, in the short 3 s ITI trials, animals earned more pellets after administration of AMPH compared with vehicle (t = 5.62, p < 0.001), but less pellets after administration of PHEN (t = −3.42, p = 0.002). There was also a trend for animals to earn more pellets on 3 s ITI trials following the administration of ATI compared to vehicle (t = 2.25, p = 0.068). During long 7 s and 9 s ITI trials, animals earned significantly fewer pellets following administration of AMPH compared to vehicle (t = −4.28, p < 0.001; t = −4.69, p < 0.001 respectively). During 7 s ITI trials, there was a trend for animals to earn less pellets following administration of ATI compared to vehicle (t = −2.27, p = 0.064). This effect was significant in the 9 s ITI trials (t = −3.20, p = 0.004).
Omission responses were affected differently by AMPH, ATI and PHEN depending on the ITI (Drug × ITI, F(9,285) = 5.88, p < 0.001). Figure 7B shows that treatment with ATI (t = 2.30, p = 0.05) and AMPH (t = 6.10, p < .001) reduced the percentage of omission responses on the short 3 s ITI trials; however, PHEN increased the percentage of omission responses on the 3 s and 5 s ITI trials (t = 4.49, p < 0.001, t = 3.69, p = 0.001 respectively). In addition, AMPH reduced omission responses on the 7 s ITI trials (t = 2.41, p = 0.046).
Premature responses were affected differently by AMPH, ATI and PHEN depending on the ITI (Drug × ITI, F(9,285) = 4.77, p < 0.001). Figure 7C shows administration of AMPH increased the percentage of premature responses in trials with 5 s (t = 6.07, p < .001), 7 s (t = 6.76, p < .001), 9 s (t = 3.15, p < .001) ITIs, whereas ATI only increased premature responses during 5 s (t = 2.83, p = 0.014) and 7 s (t = 3.08, p = 0.007) ITIs. Latencies on correct, incorrect and premature responses following administration of ATI, AMPH and PHEN are shown in Table S6 of the supplementary materials.
The effects of AMPH, ATI and PHEN were determined by ITI. Administration of AMPH and ATI led to behavioural disinhibition: increasing premature responses, decreasing omissions and facilitating responding on fast-paced, short ITI trials. Administration of PHEN, instead, led to a general inhibition of behaviour: reducing premature responses and increasing omissions, especially during short ITI trials.
Discussion
The findings show that high and low levels of impulsivity can be both detrimental and advantageous to task performance, depending on the precise contingencies of the test environment. Specifically, HI rats performed best with short ITIs and fast stimulus presentations whilst LI rats were superior during the long ITI trials of the vITI-5CSRTT. Moreover, the effects of drugs used to treat ADHD also depended on the context of the test situation as well as baseline levels of impulsivity. Specifically, drugs that increase the levels of catecholamines both cortically and subcortically, such as MPH and AMPH, conferred an advantage in the short ITI trials of the 5CSRTT and mimicked the behavioural profile of HI rats. In contrast, the selective NA reuptake blocker ATO (Swanson et al. 2006) which also increases DA in the prefrontal cortex but has no effect on DA levels in the striatum (Carboni et al. 2006) decreased impulsivity, slowed response latencies and improved performance in long ITI trials, mimicking the behaviour of LI rats. Importantly, we noticed that the effect of ATO was partly dependent on trait impulsivity and exerted greater influence on behaviour in MI and LI rats. The contrasting effects of MPH and ATO implicate DA and NA in different aspects of sustained attentional performance.
In two separate experiments, over multiple sessions, HI animals earned more reinforcers and made fewer omission responses than LI and MI animals in the short, 3 s and 5 s ITI trials. In addition, HI were on average faster at making a correct response, regardless of ITI. This adaptive response was not the result of a strategy chosen based on the available contingencies. Indeed, when animals were challenged with a session that presented only short ITIs, LI (and to a lesser extent MI) rats were not able to adapt to the short latencies and performed significantly worse than HI rats. Conversely, when the task required animals to wait for an extended period before responding, the behavioural phenotype typical of HI rats emerged, with increased premature responses during the long 7 s and 9 s ITIs. This suggests that there is some adaptive value to the impulsivity phenotype. The advantage that this trait confers is revealed under high-event rate conditions, where rapid information processing, including visual attention and action, is required. The significance of these findings can be seen from work in humans showing that task pace and frequency of reinforcers improve performance of impulsive subjects (Cools et al. 2005) and ADHD juveniles (Delisle and Braun 2011; McInerney and Kerns 2003; Slusarek et al. 2001; Strand et al. 2012), normalising behaviour or even improving behaviour compared with matched healthy controls. Some have attributed this phenomenon to an intolerance of delayed rewards and increased susceptibility to boredom (Barkley 2001; Wiersema et al. 2006), suggesting that uninteresting or non-stimulating tasks foster the development of ADHD symptoms, whilst fast-paced and motivating contexts reduce their occurrence. This is particularly relevant for the present study with a superior performance of HI rats during a high-event rate challenge.
LI rats tended to stop responding on the fast trials but continued to work on the 7 s and 9 s ITI trials. Indeed, HI rats were on average faster and more active than LI rats throughout the session. Short latencies and greater activity-per-unit-of-time have been postulated to require greater energy and thus be more costly (Niv et al. 2005, 2007; Opris et al. 2011; Staddon 2001). Niv et al. (2005, 2007) explored this idea computationally, suggesting that the expectation of future reward determines the rapidity or vigour with which the operant is performed by functioning as an opportunity cost, that is by determining whether the cost of responding fast and/or frequently is worth the outcome. Building on this idea, both rats (Opris et al. 2011) and humans (Shadmehr 2010) respond faster and with greater vigour when the opportunity to gain a reward is high, whereas they are slower and less active when the expected reward from any given action is low. This corroborates the hypothesis that movement kinematics are dictated by the value attributed to a stimulus and by the rate at which this value is discounted in time (Shadmehr 2010). This would suggest that steeper than normal temporal discounting of reward would be accompanied by faster and more vigorous movements. Consistent with this idea, subjects showing impaired waiting impulsivity (Choi et al. 2014; Wallace and Newman 1990) or proneness to boredom (Berret et al. 2018) make faster and more vigorous movements.
This is in line with our data, showing that high impulsive animals, who are steeper discounters (Robinson et al. 2009), have faster responding and demonstrate superior performance when such behaviour is advantageous. According to the normative account described by Niv et al. (2007), the more vigorous responding of HI rats would indicate enhanced subjective utility of food reward for this endophenotype. Interestingly, both in rodents and in humans, impulsive action has been associated with indices of greater sensitivity to reward-predicting cues, such as risky decision-making (Barrus et al. 2015; Gabriel et al. 2019; Ioannidis et al. 2019), substance abuse (Belin et al. 2008; Dalley et al. 2007; Diergaarde et al. 2008, 2009; Voon 2014) and increased responsivity for sucrose (Diergaarde et al. 2009). Recent data in humans supports the idea that motor impulsivity is associated with enhanced value attribution to reinforcers (Mechelmans et al. 2017); however, we did not test this directly in this study.
Results from the pharmacological interventions show that the effects that drugs have on behavioural performance can be both context and trait dependent. Specifically, drugs that increase the release of dopamine and noradrenaline both cortically and subcortically, such as MPH and AMPH (Bymaster et al. 2002; Kuczenski and Segal 2001), reduced response latencies and improved performance on fast-paced trials. In long ITI trials, instead, they increased premature responses and deteriorated performance, mimicking, as a whole, the behaviour of HI rats. Behavioural results obtained with these drugs agree with previous research on impulsive action, whereby increasing extracellular DA levels, in particular in the striatum (Economidou et al. 2012), leads to enhanced behavioural activation and more premature responses (Baarendse and Vanderschuren 2012; Milstein et al. 2010; Murphy et al. 2008; Navarra et al. 2008; Pattij et al. 2007; Sun et al. 2012). Navarra et al. (2008) had also observed an improvement of performance on the 5CSRTT with MPH on some short ITI trials; we confirm these findings and extend this effect to low-dose AMPH. These results add to a growing body of literature on the pro-cognitive effects of psychostimulants in animals (Paine et al. 2007; Tomlinson et al. 2014; Turner et al. 2016) and in humans (Pietrzak et al. 2006; Wardle et al. 2011). These results are also in line with computational (Niv et al. 2005, 2007) and experimental evidence (Hamid et al. 2016; Klaus et al. 2019; Mohebi et al. 2019; Wassum et al. 2012) that increased DA transmission in the striatum lowers the threshold for action initiation and invigorates operant responding by a process of activation (Robbins and Everitt 2007). Importantly, these findings also suggest that the advantage conferred by impulsivity in highly stimulating contexts may be due to increased levels of dopamine in the striatum. This is in line with evidence suggesting that HI rats present increased synaptic DA levels in the shell sub-region of the ventral striatum due to reduced expression of the dopamine transporter and decreased DA D2/D3 receptor availability in this region (Dalley and Robbins 2017; Jupp et al. 2013).
Contrary to MPH, systemic administration of ATO, which increases extracellular NA levels and does not affect DA release in the striatum but increases it in the PFC (Carboni et al. 2006; Swanson et al. 2006), improved performance on long ITI trials, increased omissions on short ITI trials and slowed responding in general, mimicking the behaviour of LI rats. These results are in line with previous research on 5CSRTT showing that ATO reduces premature responses in this task (Blondeau and Dellu-Hagedorn 2007; Economidou et al. 2012; Fernando et al. 2012; Navarra et al. 2008; Robinson et al. 2008). Contrary to previous evidence (Navarra et al. 2008 5 s ITI 1.0mg/kg; Callahan et al. 2019 2.5 s ITI 3.0mg/kg), however, we did not observe an increase in the probability to make a correct response in short ITI trials following administration of ATO, and instead we saw a decrement in performance, consistent with a role of ATO in reducing behavioural activation or even producing mild sedative effects. Importantly, MI and LI rats were more sensitive to the deactivating effects of ATO than HI rats; thus, trait-related factors can determine the behavioural effects of ATO. Studies using tasks other than the 5CSRTT have also observed reduced behavioural responding following the administration of ATO, such as an increase in omissions on a cognitive-effort task (Hosking et al. 2015) and a decrease in breakpoint in a progressive ratio choice task (Yohn et al. 2016). The specific mechanisms of how ATO strengthens behavioural inhibition are not well understood. In the context of 5CSRTT, it is possible that ATO reduces premature responses by increasing NA transmission in the nucleus accumbens shell (Benn and Robinson 2017; Economidou et al. 2012). Others have found that administration of ATO reduces DA release in the nucleus accumbens core, with a concomitant behavioural effect of decreased willingness to exert effort in a progressive ratio task (Yohn et al. 2016). The authors then speculated that ATO may be acting via alpha-2 adrenergic receptors on dopamine neurons of the ventral tegmental area (VTA) to reduce accumbal DA release (Guiard et al. 2008; Yohn et al. 2016).
Blockade of the alpha-2a adrenoceptors with ATI yielded results similar to those of psychostimulants, with a decrease of omissions in short ITI trials and an increase in premature responses in long ITI trials. In contrast, the alpha1 adrenoceptor agonist PHEN resulted in a behavioural profile similar to that of ATO, reducing correct responses and increasing the probability of omissions in short ITI trials. These results are in line with previous research in 5CSRTT (Koskinen et al. 2003; Pattij et al. 2012; Sirviö et al. 1993) showing that PHEN leads to an overall inhibition of responding whilst administration of ATI results in an increase in behavioural activation. Given that administration of ATI yielded results markedly different from those of ATO, it is unlikely that ATI is acting on pre-synaptic alpha-2a autoreceptors on NA fibres to activate NA transmission (Berridge and Waterhouse 2003). Instead, ATI may be acting on post-synaptic alpha-2a adrenoceptors subcortically to increase DA release, either via its action on alpha-2-autoreceptors on VTA DA cells (Guiard et al. 2008), or by inhibiting DA decline in the striatum (Yavich et al. 2003). Alternatively, ATI may act on post-synaptic alpha-2a adrenoceptors receptors located in the prefrontal cortex. Studies in non-human primates have shown that blockade of these receptors with infusions of yohimbine, an alpha-2a antagonist, in the dorsolateral prefrontal cortex, increases impulsivity (Ma et al. 2003) and induces locomotor hyperactivity (Ma et al. 2005).
NA has lower affinity for alpha-1 adrenoceptors compared to alpha-2 adrenoceptors (Mohell et al. 1983; O’Rourke et al. 1994), and thus alpha-1 adrenoceptors in the prefrontal cortex are thought to be preferentially engaged during high levels of stress, when levels of NA release are highest (Ramos and Arnsten 2007). There is evidence that activation of alpha-1 adrenoceptors in prefrontal cortex impairs working memory performance both in rodents (Arnsten et al. 1999; Birnbaum et al. 2004) and monkeys (Arnsten and Jentsch 1997; Birnbaum et al. 2004; Mao et al. 1999). On the basis of this, it is possible that the slowing of behavioural activation that we observe with PHEN could be due to a neocortical action of this drug.
In conclusion, our findings demonstrate that trait impulsivity can be advantageous in certain contexts, specifically when rapid responding and attentional focusing is required. From human studies on ADHD, it is apparent that stimulating environments can help remediate decrements in performance in this patient population; however, we have demonstrated, for the first time to our knowledge, that this is also true in animal models of impulsivity. Importantly, we have also explored the role that catecholamines play in the performance of high-event rate tasks, and we suggest that drugs that elevate subcortical, as well as cortical, DA levels improve performance on fast-paced trials, whilst drugs that act mainly to block the reuptake of NA slow responding in such situations. These results have important implications for our understanding of impulsivity, the context within which it manifests and the pharmacological agents that are used to treat ADHD.
References
Arnsten AFT, Jentsch JD (1997) The alpha-1 adrenergic agonist, cirazoline, impairs spatial working memory performance in aged monkeys. Pharmacol Biochem Behav 58(1):55–59. https://doi.org/10.1016/S0091-3057(96)00477-7
Arnsten AFT, Mathew R, Ubriani R, Taylor JR, Li BM (1999) Α-1 noradrenergic receptor stimulation impairs prefrontal cortical cognitive function. Biol Psychiatry 45(1):26–31. https://doi.org/10.1016/S0006-3223(98)00296-0
Baarendse PJJ, Vanderschuren LJMJ (2012) Dissociable effects of monoamine reuptake inhibitors on distinct forms of impulsive behavior in rats. Psychopharmacology 219(2):313–326. https://doi.org/10.1007/s00213-011-2576-x
Bari A, Dalley JW, Robbins TW (2008) The application of the 5-choice serial reaction time task for the assessment of visual attentional processes and impulse control in rats. Nat Protoc 3(5):759–767. https://doi.org/10.1038/nprot.2008.41
Barkley RA (2001) The executive functions and self-regulation: an evolutionary neuropsychological perspective. Neuropsychol Rev 11(1):1–29. https://doi.org/10.1023/A:1009085417776
Barkley RA (2002) Psychosocial treatments for attention-deficit/hyperactivity disorder. J Clin Psychiatry 63(12):36–43. https://doi.org/10.1007/s11920-008-0066-6
Barrus MM, Hosking JG, Zeeb FD, Tremblay M, Winstanley CA, Barrus MM (2015) Disadvantageous decision-making on a rodent gambling task is associated with increased motor impulsivity in a population of male rats. J Psychiatry Neurosci 40(2):108–125. https://doi.org/10.1503/jpn.140045
Belin D, Mar AC, Dalley JW, Robbins TW, Everitt BJ (2008) High impulsivity predicts the switch to compulsive cocaine-taking. Science 320(5881):1352–1355. https://doi.org/10.1126/science.1158136
Benn A, Robinson ESJ (2017) Differential roles for cortical versus sub-cortical noradrenaline and modulation of impulsivity in the rat. Psychopharmacology 234(2):255–266. https://doi.org/10.1007/s00213-016-4458-8
Berret B, Castanier C, Bastide S, Deroche T (2018) Vigour of self-paced reaching movement: cost of time and individual traits. Sci Rep 8(10655):1–14. https://doi.org/10.1038/s41598-018-28979-6
Berridge CW, Waterhouse BD (2003) The locus coeruleus-noradrenergic system: modulation of behavioral state and state-dependent cognitive processes. Brain Res Rev 42(1):33–84. https://doi.org/10.1016/S0165-0173(03)00143-7
Birnbaum SG, Yuan PX, Wang M, Vijayraghavan S, Bloom AK, Davis DJ, Gobeske KT, Sweatt JD, Manji HK, Arnsten AFT (2004) Protein kinase C overactivity impairs prefrontal cortical regulation of working memory. Science 306(5697):882–884 http://science.sciencemag.org/
Bizarro L, Patel S, Murtagh C, Stolerman IP (2004) Differential effects of psychomotor stimulants on attentional performance in rats: nicotine, amphetamine, caffeine and methylphenidate. Behav Pharmacol 15(3):195–206. https://doi.org/10.1097/01.fbp.0000131574.61491.50
Blondeau C, Dellu-Hagedorn F (2007) Dimensional analysis of ADHD subtypes in rats. Biol Psychiatry 61(12):1340–1350. https://doi.org/10.1016/j.biopsych.2006.06.030
Bymaster FP, Katner JS, Nelson DL, Hemrick-Luecke SK, Threlkeld PG, Heiligenstein JH, Morin SM, Gehlert DR, Perry KW (2002) Atomoxetine increases extracellular levels of norepinephrine and dopamine in prefrontal cortex of rat: a potential mechanism for efficacy in Attention Deficit/Hyperactivity Disorder. Neuropsychopharmacology 27(5):699–711
Callahan PM, Plagenhoef MR, Blake DT, Terry A v Jr (2019) Atomoxetine improves memory and other components of executive function in young-adult rats and aged rhesus monkeys. Neuropharmacology 155:69–75. https://doi.org/10.1016/j.neuropharm.2019.05.016
Carboni E, Silvagni A, Vacca C, Chiara G (2006) Cumulative effect of norepinephrine and dopamine carrier blockade on extracellular dopamine increase in the nucleus accumbens shell, bed nucleus of stria terminalis and prefrontal cortex. J Neurochem 96(2):473–481. https://doi.org/10.1111/j.1471-4159.2005.03556.x
Cardinal RN, Aitken MRF (2010) Whisker: a client-server high-performance multimedia research control system. Behav Res Methods 42(4):1059–1071. https://doi.org/10.3758/BRM.42.4.1059
Carli M, Robbins TW, Evenden JL, Everitt BJ (1983) Effects of lesions to ascending noradrenergic neurones on performance of a 5-choice serial reaction task in rats; implications for theories of dorsal noradrenergic bundle function based on selective attention and arousal. Behav Brain Res 9(3):361–380. https://doi.org/10.1016/0166-4328(83)90138-9
Choi JES, Vaswani PA, Shadmehr R (2014) Vigor of movements and the cost of time in decision making. J Neurosci 34(4):1212–1223. https://doi.org/10.1523/JNEUROSCI.2798-13.2014
Cools R, Blackwell A, Clark L, Menzies L, Cox S, Robbins TW (2005) Tryptophan depletion disrupts the motivational guidance of goal-directed behavior as a function of trait impulsivity. Neuropsychopharmacology 30(7):1362–1373. https://doi.org/10.1038/sj.npp.1300704
Cope ZA, Halberstadt AL, van Enkhuizen J, Flynn AD, Breier M, Swerdlow NR, Geyer MA, Young JW (2016) Premature responses in the five-choice serial reaction time task reflect rodents’ temporal strategies: evidence from no-light and pharmacological challenges. Psychopharmacology 233(19–20):3513–3525. https://doi.org/10.1007/s00213-016-4389-4
Dalley JW, Robbins TW (2017) Fractionating impulsivity: neuropsychiatric implications. Nat Rev Neurosci 18(3):158–171. https://doi.org/10.1038/nrn.2017.8
Dalley JW, Fryer TD, Brichard L, Robinson ESJ, Theobald DEH, Lääne K, Peña Y, Murphy ER, Shah Y, Probst K, Abakumova I, Aigbirhio FI, Richards HK, Hong Y, Baron JC, Everitt BJ, Robbins TW (2007) Nucleus accumbens D2/3 receptors predict trait impulsivity and cocaine reinforcement. Science 315(5816):1267–1270. https://doi.org/10.1126/science.1137073
Dalley JW, Everitt BJ, Robbins TW (2011) Impulsivity, compulsivity, and top-down cognitive control. Neuron 69(4):680–694. https://doi.org/10.1016/j.neuron.2011.01.020
de Wit H (2009) Impulsivity as a determinant and consequence of drug use: a review of underlying processes. Addict Biol 14(1):22–31. https://doi.org/10.1111/j.1369-1600.2008.00129.x
Delisle J, Braun CMJ (2011) A context for normalizing impulsiveness at work for adults with Attention Deficit/Hyperactivity Disorder (combined type). Arch Clin Neuropsychol 26(7):602–613. https://doi.org/10.1093/arclin/acr043
Dickman S (1985) Impulsivity and perception. Individual differences in the processing of the local and global dimensions of stimuli. J Pers Soc Psychol 48(1):133–149. https://doi.org/10.1037/0022-3514.48.1.133
Dickman SJ (1990) Functional and dysfunctional impulsivity: personality and cognitive correlates. J Pers Soc Psychol 58(1):95–102
Dickman SJ (2000) Impulsivity, arousal and attention. Personal Individ Differ 28(3):563–581. https://doi.org/10.1016/S0191-8869(99)00120-8
Dickman SJ, Meyer DE (1988) Impulsivity and speed-accuracy tradeoffs in information processing. J Pers Soc Psychol 54(2):274–290
Diergaarde L, Pattij T, Poortvliet I, Hogenboom F, de Vries W, Schoffelmeer ANM, de Vries TJ (2008) Impulsive choice and impulsive action predict vulnerability to distinct stages of nicotine seeking in rats. Biol Psychiatry 63(3):301–308. https://doi.org/10.1016/j.biopsych.2007.07.011
Diergaarde L, Pattij T, Nawijn L, Schoffelmeer ANM, de Vries TJ (2009) Trait impulsivity predicts escalation of sucrose seeking and hypersensitivity to sucrose-associated. Behav Neurosci 123(4):794–803. https://doi.org/10.1037/a0016504
Economidou D, Theobald DEH, Robbins TW, Everitt BJ, Dalley JW (2012) Norepinephrine and dopamine modulate impulsivity on the five-choice serial reaction time task through opponent actions in the shell and core sub-regions of the nucleus accumbens. Neuropsychopharmacology 37(9):2057–2066. https://doi.org/10.1038/npp.2012.53
Evenden JL (1999) Impulsivity and personality. Psychopharmacology 146(4):348–361
Fernando ABP, Economidou D, Theobald DE, Zou M-F, Newman AH, Spoelder M, Caprioli D, Moreno M, Hipόlito L, Aspinall AT, Robbins TW, Dalley JW (2012) Modulation of high impulsivity and attentional performance in rats by selective direct and indirect dopaminergic and noradrenergic receptor agonists. Psychopharmacology 219(2):341–352. https://doi.org/10.1007/s00213-011-2408-z
Gabriel DBK, Freels TG, Setlow B, Simon NW (2019) Risky decision-making is associated with impulsive action and sensitivity to first-time nicotine exposure. Behav Brain Res 359:579–588. https://doi.org/10.1016/j.bbr.2018.10.008
Guiard BP, el Mansari M, Blier P (2008) Cross-talk between dopaminergic and noradrenergic systems in the rat ventral tegmental area, locus ceruleus, and dorsal hippocampus. Mol Pharmacol 74(5):1463–1475. https://doi.org/10.1124/mol.108.048033
Hamid AA, Pettibone JR, Mabrouk OS, Hetrick VL, Schmidt R, vander Weele CM, Kennedy RT, Aragona BJ, Berke JD (2016) Mesolimbic dopamine signals the value of work. Nat Neurosci 19(1):117–126. https://doi.org/10.1038/nn.4173
Hervig M, Fiddian L, Piilgaard L, Božič T, Blanco-Pozo M, Knudsen C, Olesen S, Alsiö J, Robbins T (2020) Dissociable and paradoxical roles of rat medial and lateral orbitofrontal cortex in visual serial reversal learning. Cereb Cortex 30(3):1016–1029. https://doi.org/10.1093/cercor/bhz144
Hosking JG, Floresco SB, Winstanley CA (2015) Dopamine antagonism decreases willingness to expend physical, but not cognitive, effort: a comparison of two rodent cost/benefit decision-making tasks. Neuropsychopharmacology 40(4):1005–1015. https://doi.org/10.1038/npp.2014.285
Ioannidis K, Hook R, Wickham K, Grant JE, Chamberlain SR (2019) Impulsivity in Gambling Disorder and problem gambling: a meta-analysis. Neuropsychopharmacology 44:1354–1361. https://doi.org/10.1038/s41386-019-0393-9
Jentsch JD, Taylor JR (1999) Impulsivity resulting from frontostriatal dysfunction in drug abuse: Implications for the control of behavior by reward-related stimuli. Psychopharmacology 146(4):373–390. https://doi.org/10.1007/PL00005483
Jupp B, Caprioli D, Saigal N, Reverte I, Shrestha S, Cumming P, Everitt BJ, Robbins TW, Dalley JW (2013) Dopaminergic and GABA-ergic markers of impulsivity in rats: evidence for anatomical localisation in ventral striatum and prefrontal cortex. Eur J Neurosci 37(9):1519–1528. https://doi.org/10.1111/ejn.12146
Klaus A, Alves da Silva J, Costa RM (2019) What, if, and when to move: basal ganglia circuits and self-paced action initiation. Annu Rev Neurosci 42(1):459–483. https://doi.org/10.1146/annurev-neuro-072116-031033
Kollins SH, McClernon FJ, Fuemmeler BF (2005) Association between smoking and attention-deficit/hyperactivity disorder symptoms in a population-based sample of young adults. Arch Gen Psychiatry 62(10):1142–1147. https://doi.org/10.1001/archpsyc.62.10.1142
Koskinen T, Haapalinna A, Sirviö J (2003) α-adrenoceptor-mediated modulation of 5-HT2 receptor agonist induced impulsive responding in a 5-choice serial reaction time task. Pharmacol Toxicol 92(5):214–225. https://doi.org/10.1034/j.1600-0773.2003.920504.x
Kuczenski R, Segal DS (2001) Locomotor effects of acute and repeated threshold doses of amphetamine and methylphenidate: relative roles of dopamine and norepinephrine. J Pharmacol Exp Ther 296(3):876–883 http://jpet.aspetjournals.org
Lasky AK, Weisner TS, Jensen PS, Hinshaw SP, Hechtman L, Arnold LE, Murray DW, Swanson JM (2016) ADHD in context: young adults’ reports of the impact of occupational environment on the manifestation of ADHD. Soc Sci Med 161:160–168. https://doi.org/10.1016/j.socscimed.2016.06.003
Lawrence A, Clark L, Labuzetta JN, Sahakian B, Vyakarnum S (2008) The dark side? Nature 456(7219):168–169 http://tinyurl.com/5uolx2
Lerner DA, Verheul I, Thurik R (2019) Entrepreneurship and attention deficit/hyperactivity disorder: a large-scale study involving the clinical condition of ADHD. Small Bus Econ 53(2):381–392. https://doi.org/10.1007/s11187-018-0061-1
Ma CL, Qi XL, Peng JY, Li BM (2003) Selective deficit in no-go performance induced by blockade of prefrontal cortical α2-adrenoceptors in monkeys. Neuroreport 14(7):1013–1016. https://doi.org/10.1097/01.wnr.0000070831.57864.7b
Ma C-L, Arnsten AFT, Li B-M (2005) Locomotor hyperactivity induced by blockade of prefrontal cortical 2-adrenoceptors in monkeys. Biol Psychiatry 57(2):192–195. https://doi.org/10.1016/j.biopsych.2004.11.004
Mao ZM, Arnsten AFT, Li BM (1999) Local infusion of an α-1 adrenergic agonist into the prefrontal cortex impairs spatial working memory performance in monkeys. Biol Psychiatry 46(9):1259–1265. https://doi.org/10.1016/S0006-3223(99)00139-0
McInerney RJ, Kerns KA (2003) Time reproduction in children with ADHD: motivation matters. Child Neuropsychology 9(2):91–108. https://doi.org/10.1076/chin.9.2.91.14506
Mechelmans DJ, Strelchuk D, Doñamayor N, Banca P, Robbins TW, Baek K, Voon V, Leuven -, K. (2017) Reward sensitivity and waiting impulsivity: shift towards reward valuation away from action control. Int J Neuropsychopharmacol 20(12):971–978. https://doi.org/10.1093/ijnp/pyx072
Milstein JA, Dalley J, Robbins T (2010) Methylphenidate-induced impulsivity: pharmacological antagonism by β-adrenoreceptor blockade. J Psychopharmacol 24(3):309–321. https://doi.org/10.1177/0269881108098146
Mohebi A, Pettibone JR, Hamid AA, Wong J-MT, Vinson LT, Patriarchi T, Tian L, Kennedy RT, Berke JD (2019) Dissociable dopamine dynamics for learning and motivation. Nature 570(7759):65–70. https://doi.org/10.1038/s41586-019-1235-y
Mohell N, Svartengren JAN, Cannon B (1983) Identification of [3H] prazosin binding sites in crude membranes and isolated cells of brown adipose tissue as α1-adrenergic receptors. Eur J Pharmacol 92(1–2):15–25
Murphy ER, Robinson ESJ, Theobald DEH, Dalley JW, Robbins TW (2008) Contrasting effects of selective lesions of nucleus accumbens core or shell on inhibitory control and amphetamine-induced impulsive behaviour. Eur J Neurosci 28(2):353–363. https://doi.org/10.1111/j.1460-9568.2008.06309.x
Navarra R, Graf R, Huang Y, Logue S, Comery T, Hughes Z, Day M (2008) Effects of atomoxetine and methylphenidate on attention and impulsivity in the 5-choice serial reaction time test. Prog Neuro-Psychopharmacol Biol Psychiatry 32(1):34–41. https://doi.org/10.1016/j.pnpbp.2007.06.017
Niv Y, Daw ND, Dayan P (2005) How fast to work: response vigor, motivation and tonic dopamine. In: W. Y, S. B, Platt J (eds) Advances in neural information processing systems (pp. 1019–1026). MIT Press
Niv Y, Daw ND, Joel D, Dayan P (2007) Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology 191(3):507–520. https://doi.org/10.1007/s00213-006-0502-4
O’Rourke MF, Blaxall HS, Bylund DB (1994) Characterization of [3H]RX821001 binding to alpha-2 adrenergic receptor subtypes. J Pharmacol Exp Ther 268(3):1362–1367
Opris I, Lebedev M, Nelson RJ (2011) Motor planning under unpredictable reward: Modulations of movement vigor and primate striatum activity. Front Neurosci 5:1–12. https://doi.org/10.3389/fnins.2011.00061
Paine TA, Tomasiewicz HC, Zhang K, Carlezon WA (2007) Sensitivity of the five-choice serial reaction time task to the effects of various psychotropic drugs in sprague-dawley rats. Biol Psychiatry 62(6):687–693. https://doi.org/10.1016/j.biopsych.2006.11.017
Paterson NE, Ricciardi J, Wetzler C, Hanania T (2011) Sub-optimal performance in the 5-choice serial reaction time task in rats was sensitive to methylphenidate, atomoxetine and d-amphetamine, but unaffected by the COMT inhibitor tolcapone. Neurosci Res 69(1):41–50. https://doi.org/10.1016/j.neures.2010.10.001
Pattij T, Janssen MCW, Vanderschuren LJMJ, Schoffelmeer ANM, van Gaalen MM (2007) Involvement of dopamine D1 and D2 receptors in the nucleus accumbens core and shell in inhibitory response control. Psychopharmacology 191(3):587–598. https://doi.org/10.1007/s00213-006-0533-x
Pattij T, Schetters D, Schoffelmeer ANM, van Gaalen MM (2012) On the improvement of inhibitory response control and visuospatial attention by indirect and direct adrenoceptor agonists. Psychopharmacology 219(2):327–340. https://doi.org/10.1007/s00213-011-2405-2
Pietrzak RH, Mollica CM, Maruff P, Snyder PJ (2006) Cognitive effects of immediate-release methylphenidate in children with attention-deficit/hyperactivity disorder. Neurosci Biobehav Rev 30(8):1225–1245. https://doi.org/10.1016/j.neubiorev.2006.10.002
Ramos BP, Arnsten AFT (2007) Adrenergic pharmacology and cognition: focus on the prefrontal cortex. Pharmacol Ther 113(3):523–536. https://doi.org/10.1016/j.pharmthera.2006.11.006
Robbins TW, Everitt BJ (2007) A role for mesencephalic dopamine in activation: commentary on Berridge (2006). Psychopharmacology 191(3):433–437. https://doi.org/10.1007/s00213-006-0528-7
Robinson ESJ (2012) Blockade of noradrenaline re-uptake sites improves accuracy and impulse control in rats performing a five-choice serial reaction time tasks. Psychopharmacology 219(2):303–312. https://doi.org/10.1007/s00213-011-2420-3
Robinson ESJ, Eagle DM, Mar AC, Bari A, Banerjee G, Jiang X, Dalley JW, Robbins TW (2008) Similar effects of the selective noradrenaline reuptake inhibitor atomoxetine on three distinct forms of impulsivity in the rat. Neuropsychopharmacology 33(5):1028–1037. https://doi.org/10.1038/sj.npp.1301487
Robinson ESJ, Eagle DM, Economidou D, Theobald DEH, Mar AC, Murphy ER, Robbins TW, Dalley JW (2009) Behavioural characterisation of high impulsivity on the 5-choice serial reaction time task: specific deficits in “waiting” versus “stopping.”. Behav Brain Res 196(2):310–316. https://doi.org/10.1016/j.bbr.2008.09.021
Shadmehr R (2010) Control of movements and temporal discounting of reward. Curr Opin Neurobiol 20:726–730. https://doi.org/10.1016/j.conb.2010.08.017
Sirviö J, Jakala P, Mazurkiewicz M, Haapalinna A, Riekkinen JR, P., & Riekkinen, P. (1993) Dose-and parameter-dependent effects of atipamezole, an a2-antagonist, on the performance of rats in a Five-Choice Serial Reaction Time Task. In Pharmacology Biochemistry and Behavior 45:123–129
Sirviö J, Mazurkiewicz M, Haapalinna A, Riekkinen P, Lahtinen H, Riekkinen PJ (1994) The effects of selective alpha-2 adrenergic agents on the performance of rats in a 5-choice serial reaction time task. Brain Res Bull 35(5–6):451–455. https://doi.org/10.1016/0361-9230(94)90158-9
Slusarek M, Velling S, Bunk D, Eggers C (2001) Motivational effects on inhibitory control in children with ADHD. J Am Acad Child Adolesc Psychiatry 40(3):355–363. https://doi.org/10.1097/00004583-200103000-00016
Smillie LD, Jackson CJ (2006) Functional impulsivity and reinforcement sensitivity theory. J Pers 74(1):47–83. https://doi.org/10.1111/j.1467-6494.2005.00369.x
Solanto M v (2002) Dopamine dysfunction in AD/HD: integrating clinical and basic neuroscience research. Behav Brain Res 130(1–2):65–71. https://doi.org/10.1016/S0166-4328(01)00431-4
Staddon JER (2001) Adaptive dynamics. The MIT Press. https://doi.org/10.7551/mitpress/1092.001.0001
Strand MT, Hawk LW, Bubnik M, Shiels K, Pelham WE, Waxmonsky JG (2012) Improving working memory in children with attention-deficit/hyperactivity disorder: the separate and combined effects of incentives and stimulant medication. J Abnorm Child Psychol 40(7):1193–1207. https://doi.org/10.1007/s10802-012-9627-6
Sun H, Cocker PJ, Zeeb FD, Winstanley CA (2012) Chronic atomoxetine treatment during adolescence decreases impulsive choice, but not impulsive action, in adult rats and alters markers of synaptic plasticity in the orbitofrontal cortex. Psychopharmacology 219(2):285–301. https://doi.org/10.1007/s00213-011-2419-9
Swanson CJ, Perry KW, Koch-Krueger S, Katner J, Svensson KA, Bymaster FP (2006) Effect of the attention deficit/hyperactivity disorder drug atomoxetine on extracellular concentrations of norepinephrine and dopamine in several brain regions of the rat. Neuropharmacology 50(6):755–760. https://doi.org/10.1016/j.neuropharm.2005.11.022
Tomlinson A, Grayson B, Marsh S, Harte MK, Barnes SA, Marshall KM, Neill JC (2014) Pay attention to impulsivity: modelling low attentive and high impulsive subtypes of adult ADHD in the 5-choice continuous performance task (5C-CPT) in female rats. Eur Neuropsychopharmacol 24(8):1371–1380. https://doi.org/10.1016/j.euroneuro.2014.04.008
Turner KM, Peak J, Burne THJ (2016) Measuring attention in rodents: comparison of a modified signal detection task and the 5-Choice serial reaction time task. Front Behav Neurosci 9:370. https://doi.org/10.3389/fnbeh.2015.00370
Verheul I, Block J, Burmeister-Lamp K, Thurik R, Tiemeier H, Turturea R (2015) ADHD-like behavior and entrepreneurial intentions. Small Bus Econ 45:85–101. https://doi.org/10.1007/s11187-015-9642-4
Voon V (2014) Models of impulsivity with a focus on waiting impulsivity: translational potential for neuropsychiatric disorders. Current Addiction Reports 1:281–288. https://doi.org/10.1007/s40429-014-0036-5
Wallace JF, Newman JP (1990) Differential effects of reward and punishment cues on response speed in anxious and impulsive individuals. Personal Individ Differ 11(10):999–1009
Wardle MC, Treadway MT, Mayo LM, Zald DH, de Wit H (2011) Amping up effort: effects of d-amphetamine on human effort-based decision-making. J Neurosci 31(46):16597–16602. https://doi.org/10.1523/JNEUROSCI.4387-11.2011
Wassum KM, Ostlund SB, Maidment NT (2012) Phasic mesolimbic dopamine signaling precedes and predicts performance of a self-initiated action sequence task. Biol Psychiatry 71:846–854. https://doi.org/10.1016/j.biopsych.2011.12.019
White HA, Shah P (2011) Creative style and achievement in adults with attention-deficit/hyperactivity disorder. Personal Individ Differ 50(5):673–677. https://doi.org/10.1016/j.paid.2010.12.015
Whiteside SP, Lynam DR (2001) The five factor model and impulsivity: using a structural model of personality to understand impulsivity. Personal Individ Differ 30(4):669–689. https://doi.org/10.1016/S0191-8869(00)00064-7
Wiersema R, van der Meere J, Roeyers H, van Coster R, Baeyens D (2006) Event rate and event-related potentials in ADHD. J Child Psychol Psychiatry Allied Discip 47(6):560–567. https://doi.org/10.1111/j.1469-7610.2005.01592.x
Williams J, Dayan P (2005) Dopamine , learning , and impulsivity : a biological account of attention-deficit / hyperactivity disorder. Journal of Child and Adolescent Psychopharmacology 15(2):160–179
Winstanley CA, Eagle DM, Robbins TW (2006) Behavioral models of impulsivity in relation to ADHD: translation between clinical and preclinical studies. Clin Psychol Rev 26(4):379–395. https://doi.org/10.1016/j.cpr.2006.01.001
Yavich L, Sirviö J, Haapalinna A, Ylinen A, Männistö PT (2003) Atipamezole, an a 2-adrenoceptor antagonist, augments the effects of L-DOPA on evoked dopamine release in rat striatum. Eur J Pharmacol 462(1–3):83–89. https://doi.org/10.1016/S0014-2999(03)01324-4
Yohn SE, Errante EE, Rosenbloom-Snow A, Somerville M, Rowland M, Tokarski K, Zafar N, Correa M, Salamone JD (2016) Blockade of uptake for dopamine, but not norepinephrine or 5-HT, increases selection of high effort instrumental activity: implications for treatment of effort-related motivational symptoms in psychopathology. Neuropharmacology 109:270–280. https://doi.org/10.1016/j.neuropharm.2016.06.018
Funding
This work was funded by the Lundbeck Foundation (held by UG; R223-2016-261) and by a core award from the Medical Research Council (G1000183) and Wellcome Trust (093875/Z/10/Z) to the Behavioural and Clinical Neuroscience Institute at Cambridge University. CT is the recipient of a Medical Research Council doctoral training award at Cambridge University.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
T.W.R. discloses consultancy with Cambridge Cognition, Arcadia, Takeda, Greenfield Bioventures, Cassava Inc.; he holds research grants with Shionogi and GlaxoSmithKline. JD holds research grants with Boehringer Ingelheim and Glaxo Smith Kline. C.T, M.H.E, P.M, M.P declare no conflicts of interest.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Toschi, C., Hervig, M.ES., Moazen, P. et al. Adaptive aspects of impulsivity and interactions with effects of catecholaminergic agents in the 5-choice serial reaction time task: implications for ADHD. Psychopharmacology 238, 2601–2615 (2021). https://doi.org/10.1007/s00213-021-05883-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00213-021-05883-y