Abstract
One major aim of preclinical intracerebral hemorrhage (ICH) research is to develop and test potential neuroprotectants. Published guidelines for experimental design and reporting stress the importance of clearly and completely reporting results and methodological details to ensure reproducibility and maximize information availability. The current review has two objectives: first, to characterize current ICH neuroprotection research and, second, to analyze aspects of translational design in preclinical ICH studies. Translational design is the adoption and reporting of experimental design characteristics that are thought to be clinically relevant and critical to reproducibility in animal studies (e.g., conducting and reporting experiments according to the STAIR and ARRIVE guidelines, respectively). Given that ICH has no current neuroprotective treatments and an ongoing reproducibility crisis in preclinical research, translational design should be considered by investigators. We conducted a systematic review of ICH research from 2015 to 2019 using the PubMed database. Our search returned 281 published manuscripts studying putative neuroprotectants in animal models. Contemporary ICH research predominantly uses young, healthy male rodents. The collagenase model is the most commonly used. Reporting of group sizes, blinding, and randomization are almost unanimous, but group size calculations, mortality and exclusion criteria, and animal model characteristics are infrequently reported. Overall, current ICH neuroprotection research somewhat aligns with experimental design and reporting guidelines. However, there are areas for improvement. Because failure to consider translational design is associated with inflation of effect sizes (and possibly hindered reproducibility), we suggest that researchers, editors, and publishers collaboratively consider enhanced adherence to published guidelines.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Intracerebral hemorrhage (ICH) is a deadly stroke subtype, accounting for ~ 15% of all strokes [1]. ICH affects ~ 5 million people each year worldwide. Of those, ~ 3 million will die within 1 year, and only 12–39% of survivors will regain functional independence [2]. These statistics are concerning given that the incidence of ICH rose globally by 47% between 1990 and 2010, yet the rates of death and disability were unchanged during this time [1, 3]. Rates of disability following ICH are quite high, and we lack effective neuroprotective interventions. Those are expected to arise from rigorous and coordinated evaluation at the preclinical and clinical levels (the so-called translational pipeline) [4].
Translational experimental design is the adoption of a research plan that may advance a novel therapy from bench to bedside [5]. Translational design evolves, changing as the therapeutic approach becomes better understood. For example, safety and exploratory studies are often the first steps, whereas more rigorous (and costly) testing elements are added later as we progress towards translation (e.g., varying age and/or sex; using preclinical randomized controlled trials) [5, 6]. In sum, translational research uses information from basic and clinical sciences to advance therapies to the clinical realm.
In stroke neuroprotection, reproducibility and bias reduction are key issues [7, 8]. To address these, preclinical stroke researchers are encouraged to follow the STAIR and RIGOR guidelines [6, 9,10,11]. These contain widely adopted experimental design elements that preclinical scientists can use to produce more meticulous research [11,12,13]. These elements are blinding, randomization, a priori sample size calculations, explicit a priori statement of inclusion and exclusion criteria, and replication in multiple laboratories, to name a few [9, 14]. Although seemingly trivial, these experimental design components may have striking implications for translation. For example, previous studies have shown that more strict adherence to translational design associates with decreased efficacy (i.e., smaller effect sizes) of putative neuroprotective agents under study [15]. Thus, failing to use randomization and blinding could lead to bias in experimental neuroprotection research.
There are no agreed-upon definitions for neuroprotection. However, it is often described as an intervention that can preserve brain structure and/or function [15,16,17,18,19]. In the clinic, neuroprotection is commonly measured behaviorally (e.g., using the modified Rankin scale) [19,20,21]. Conversely, preclinical ischemia studies tend to measure infarct volume to gauge neuroprotection [19]. In preclinical ICH studies, the most common endpoints are behavior and brain water content (edema) assessments [22]. Although edema is commonly used preclinically, the relationship between edema and clinical outcomes is unclear, though recent studies suggest that peri-hematoma edema expansion is an independent predictor of ICH outcomes [23,24,25]. Thus, simple preclinical edema assessments (one-time wet-dry weight measurements) may not equivalently predict behavioral outcome as well as clinical edema markers (serial neuroimaging of edema expansion). The STAIR guidelines suggest that long-term (> 2 weeks post-stroke) behavioral and histological assessments should be performed in preclinical stroke studies, with emphasis placed on functional outcomes. This is especially important in the context of ICH, as post-ICH secondary injury can occur over several weeks [26, 27].
Similar to designing experiments using the STAIR and RIGOR guidelines, researchers can follow the ARRIVE guidelines to report important aspects of an experiment during publication, and ARRIVE is available in a checklist format which can be easily published as supplemental material [28]. The ARRIVE guidelines were developed with the rationale that improved reporting of published literature could lead to improved reproducibility, by fully characterizing a study. Aside from completely reporting analyses and results, ARRIVE outlines critical information required to interpret and replicate the study, for example, drug doses, routes, and timing of administration; animal age, weight, strain, sex, sample sizes, and method of their determination; and bias reduction measures (e.g., randomization and blinding), among others. Not only are the ARRIVE guidelines important for replicability, but this information is critical for research interpretation and synthesis (e.g., during meta-analyses, study quality assessments).
Given that experimental design is seen as critical to research translation, the present review aims to provide a snapshot of the quality of experimental design in ICH neuroprotection research and some considerations for researchers. Using the STAIR and ARRIVE guidelines as a framework to analyze experimental design and reporting, we sought to systematically investigate the reporting of in vivo preclinical experiments from the past 5 years of ICH neuroprotection research. Specifically, given that published guidelines suggest long-term behavioral and histological assessment, one goal of this study was to analyze the type and timing of behavioral and histological assessments in current preclinical ICH research.
Methods
We searched the PubMed database from January 2015 to June 2019. The search criteria were made with the combination of the following terms: “(animal OR rodent OR rat OR mouse)” AND “(intracerebral hemorrhage OR intraparenchymal hemorrhage OR intrastriatal hemorrhage)” NOT “(ischemia OR subarachnoid hemorrhage OR traumatic brain injury OR middle cerebral artery occlusion model).” Using these search criteria, abstracts and titles of 1265 articles were returned and screened for eligibility. The inclusion criteria comprised only in vivo experimental ICH studies written in the English language. Of the 1265 articles returned in our search, 281 met inclusion criteria and were analyzed for experimental design characteristics (e.g., endpoints used, model descriptions, and alignment with STAIR and ARRIVE guidelines), and the venue of publication was also extracted, in addition to whether the venue required mandatory reporting in accordance with published guidelines. A flowchart of the search results can be found in Fig. 1. Our analysis focused exclusively on studies with a clearly defined ictus and intervention. Therefore, spontaneous ICH models were also excluded (though these models were used infrequently). Finally, as the main focus of this analysis was centered around adult ICH models, intrauterine and neonatal models were excluded from our analysis.
Results
Experimental Design Reporting
In our analysis of experimental design, we found that 94% of studies clearly report the number of animals used per group. We also found that 12.5% of studies detailed a priori how many animals per group were deemed necessary to detect an expected effect. A majority of authors now report use of randomization or blinding in their publications. An overview of experimental design reporting can be found in Fig. 2a.
Characteristics of Animal Models Used in ICH Neuroprotection Research
In our evaluation of ICH neuroprotection research, we characterized most aspects of the animal ICH models used. We found that most studies make use of chloral hydrate, sodium pentobarbital, or isoflurane anesthesia (Fig. 2b). We also found that about 50% of the published studies used the collagenase model of ICH [29]. About 40% of studies used the blood infusion model of ICH [30, 31]. Remaining studies used blood component models (e.g., thrombin or iron) or multiple models (e.g., collagenase and blood infusion model or blood infusion model and thrombin model; Fig. 2c). In terms of the animal species used in preclinical research, about 60% of studies use rats, and 38% of studies use mice (Fig. 2d). Pigs and rabbits are uncommon ICH models, and few studies are performed using multiple animal species.
Weight and Age Reporting
Forty-seven percent of studies reported the age of animals used in the study. Eighty-three percent of studies stated the weight of the animals used. Only 34% of studies reported both the weight and age of the animals used in the study.
Sex Differences in ICH Neuroprotection Research
Of the 281 total studies, 270 reported the biological sex of the animals used. Of these studies, we found that about 96% used male rats and only about 3% of studies were conducted using female rats (Fig. 2e).
Animal Health Status
Overall, we found 16 studies that used animals with advanced age or comorbid conditions. Three studies used hypertensive rats, 4 studies used rats with hyperglycemia, and 9 studies used aged (age > 1 year) rats. A breakdown of animal age categories used in current preclinical ICH research is depicted in Fig. 2f. In sum, of the 281 experimental neuroprotection studies, about 5% used animals with altered health status.
Neuroprotective Intervention Characteristics
To better characterize ICH neuroprotection research, we evaluated how neuroprotective interventions are delivered, whether a dose-response relationship was shown, whether intervention timing was considered, and the latest intervention delay within each study. We found that intraperitoneal injection was the most common route of administration, followed by intracerebroventricular administration (Fig. 3a). Few studies (~ 20%) did dose-response assessment (Fig. 3b). Only ~ 7% of studies varied the delay between ICH and treatment administration. Thus, most studies treated animals at only one time after ICH, and most treated within the first hour (Fig. 3c). Remarkably, 1 in 6 ICH neuroprotection studies used pre-ICH treatment. Only ~ 16% of neuroprotective interventions were given after a 6-h or longer delay. Finally, no study compared treatment efficacy across a range in hemorrhage volumes.
Tissue Endpoints
For an overview of tissue endpoints in preclinical ICH literature from 2015 to 2019, see Fig. 4a. Overall, we found that most studies used endpoints related to the reduction of inflammation (~ 60%), edema (~ 58%), and cell death (~ 55%). Fewer studies assessed blood brain barrier (BBB) disruption or hematoma volume.
Injury Volume Estimation and Latest Timing of Assessment
Ninety-four studies (~ 33% of 281 studies) performed histological or imaging assessment of injury volume. To look at the timing of the injury volume assessment, we collected the latest assessment time in each study. We categorized the studies into those where the assessment was on or before day 1 post-ICH, between 1- and 7-day post-ICH, between 7- and 14-day post-ICH, and studies which assessed injury volume later than 14-day post-ICH. Of the 94 studies that performed injury volume assessment, 89 reported when the assessment occurred. The results of our analysis are in Fig. 4b. We found that 14% of studies assessed injury volume on or before day 1 post-ICH. A majority of studies (56%) performed injury volume assessments between days 1 and 7 post-ICH. About 19% of studies that assessed lesion size did so at a long-term survival time (> 2-week survival). Thus, only ~ 6% of all studies assessed long-term injury volume.
Behavioral Tasks and Timing of Assessment
Similar to our analysis of tissue endpoints, we looked at the prevalence of various behavioral tasks used in the assessment of post-ICH functional outcomes and the timing of these assessments. Overall, 47 studies did not perform behavioral assessment, and 234 studies used 1 or more behavioral tests. We found heavy reliance on a variety of neurological deficit scales (NDS) to gauge behavioral outcomes following ICH (Fig. 5a). The next most common assessments included forelimb use asymmetry (i.e., cylinder or forelimb placing tasks), followed by corner turn assessments. The “other” category included assessments of somatosensation, proprioception, and additional uncommon assessment strategies.
Timing of Latest Behavioral Assessment
Of the 234 studies which reported using behavioral assessments, 231 clearly reported the timing of behavioral assessment. Again, we collected data with respect to timing of latest behavioral assessment. The results are in Fig. 5b. Of the studies that conducted behavior, we found that most studies (77.5% of 231) conduct assessments on or before day 7 post-ICH and 22% of studies conduct long-term (> day 14) behavioral assessments. We also found that about 50% of published ICH neuroprotection studies make use of 2 or more behavioral tests per study (range = 1–6; Fig. 5c). Out of all studies, 18.5% conducted long-term behavioral testing.
Largest Reported Group Size
Because few studies (~ 12.5%) reported using a priori group size calculations to select group sizes, we assessed group sizes used in published research. By looking at the largest group sizes in each study, we found a skewed distribution, ranging from 3 to 24 animals per group (mean = 8.6, SD = 3.5; median = 8, IQR = 6–10). A histogram of the largest reported group sizes can be found in Fig. 6.
We were also interested in whether group sizes used in a study were increased when a priori sample size calculations were performed. We found that studies performing a priori sample size calculations had larger group sizes (~ 2 more animals per group) when compared with studies that did not perform these calculations (p = 0.0092).
Publication Venue Characteristics
We found that the most popular journals used for publishing ICH neuroprotection research were Stroke, the Journal of Cerebral Blood Flow and Metabolism, and the Journal of Neuroinflammation, respectively (Fig. 7a). Publications in the most common 3 journals accounted for 13% of the total publications analyzed. Publications in the top 25 most popular journals accounted for about 50% of all publications analyzed. We analyzed the top 25 most popular journals for statements related to mandatory reporting in accordance with experimental design and reporting guidelines and found that 2 journals required mandatory publication of experimental design characteristics according to published guidelines in the form of a checklist as supplemental material (Fig. 7b). Fifty-two percent of journals recommended reporting in accordance with published guidelines, and 40% of journals did not mention reporting or designing experiments in accordance with published guidelines.
Discussion and Additional Considerations
Developed with the “3 R’s” of animal ethics in mind, the ARRIVE guidelines aimed to improve the reporting standards for animal experiments [28, 32]. Recently, ethicists have proposed a “fourth R”: reproducibility [7, 33, 34]. The authors of ARRIVE sought to reduce the costs and consequences of incomplete study reporting [28]. Similarly, in stroke neuroprotection, several guidelines intend to enhance reproducibility and reduce bias [9,10,11]. Here, we used those guidelines as a framework for analyzing ICH neuroprotection studies. Generally, reporting simple experimental design features is commonplace, but imperfect. Published guidelines can improve research quality, especially when adopted and enforced by editors, journals, and funders [28, 35, 36]. Altogether, guidelines can benefit authors (by making a clear process), publishers (by creating higher quality publications), and readers (by maximizing information available) [28, 37].
In 2012 we investigated experimental quality in preclinical ICH research [22]. There have been some improvements since then, but many aspects are similar. Key changes from that study include a large increase in use of chloral hydrate, greater use of mice, and a greater prevalence of cell death and inflammation measurements. Interestingly, our previous study was published closely after the publication of the ARRIVE guidelines, so some improvements were expected, though more work must be done. Finally, authors in subarachnoid hemorrhage noted transient improvements in experimental reporting following the publication of the ARRIVE guidelines, suggesting that system-wide, collaborative changes must be implemented to reach and sustain a standard of experimental design reporting [38].
To briefly summarize our findings, almost all studies use young, healthy, male rodents. Authors frequently provide weight information to refer to the developmental status of their animals and infrequently provide age information; both are important [28]. Indeed, age may not be accurately gleaned from weight (e.g., due to species and strain differences, husbandry conditions, if food restriction is used) [39,40,41]. Few studies use animals with advanced age or comorbidities. Studies considering these conditions are critical to understanding treatment efficacy, as most ICH patients are not young and healthy. Indeed, many have shown decreased treatment efficacy with stronger adherence to translational design [15]. Echoing this, a recent meta-analysis of preclinical ischemia studies could not find evidence for therapeutic efficacy across many treatments in studies using animals with comorbidities [42]. Lastly, many clinical studies do not find sex differences in the incidence of ICH [3, 43]. Despite this fact, almost all ICH research uses male animals. Moreover, sex differences in post-ICH outcomes are understudied, despite the expectation that they should be considered [44,45,46]. Previous research has shown that sex hormones (e.g., estradiol) affect post-ICH injury trajectories [47, 48]. Unfortunately, we found that very few studies use female rats. Future preclinical ICH studies should consider biological sex, and calls are being made to investigate these issues [14, 44,45,46]. Although animal models of ICH appear relatively homogenous, our findings may underestimate the heterogeneity of translational design since no single group would assess every endpoint and parameter in the short and long term [49].
Investigators must consider the use of anesthetics and analgesics, as they can alter post-ICH injury trajectories [50, 51]. Indeed, the most common 3 anesthetics identified here have significant concerns. For example, pentobarbital, chloral hydrate, and isoflurane affect thermoregulation, and some can decrease body temperature for hours despite providing external heating [51,52,53]. Although the relationship between brain damage and temperature is better known in other brain injuries, anesthetic-driven hypothermia should be avoided in ICH [51]. Additionally, general anesthetics depress respiration. Finally, general anesthesia can reduce blood pressure which may modify post-ICH outcomes, particularly in the collagenase model where bleeding occurs over hours [26, 54, 55]. Little is known about the impact of analgesics on post-ICH outcomes. For example, one study showed that buprenorphine decreased hematoma volume while increasing peri-hematoma cell death in the collagenase model [50]. Buprenorphine also affects inflammation and suppresses respiration at high doses [56]. Interestingly, chloral hydrate is the most commonly used anesthetic (Fig. 2b), but its analgesic properties are inadequate, and the agent is toxic [57,58,59,60]. These issues are relevant, especially for multiple surgical preparations and long-term survivals. We recently demonstrated that ICH can be induced in awake freely behaving animals using collagenase; this method may avoid anesthetic-related confounds [51]. Altogether, analgesics and general anesthetics may alter many physiological processes, leading to experimental confounds if improperly considered.
Group size reporting is ubiquitous in preclinical ICH studies, but the method of determining group sizes is rarely mentioned. Studies using a priori sample size calculations generally had larger group sizes than those that did not. Notably, we considered only the largest group sizes used in a study, and often, group sizes for other endpoints were smaller. Thus, future reports should detail the group size calculation for all endpoints [10, 11, 28]. Group sizes are a critical issue, and they present researchers with an ethical dilemma because researchers are obligated to use the fewest animals possible [32]. Conversely, researchers must ensure that they have sufficient statistical power. Indeed, conclusions may be impossible to draw from an underpowered study [10, 61, 62]. A priori sample size calculations may solve this dilemma, as they represent the fewest animals necessary to detect an expected effect.
Most ICH studies use neurological deficit scoring, forelimb use asymmetry tasks, or the corner turn test, which are simple and quick to administer. Although deficit scales appear to mimic clinical assessments, these tasks are often not sensitive to chronic impairments [4, 63]. These scales also involve subjective assessments, and thus, blinded assessments are critical. However, these tests are reasonable to use as a gross assessment strategy and possibly in tandem with tasks that are sensitive to chronic behavioral deficits. Indeed, we and others have found that a battery of tests discriminates ICH injury better than any single test and thus researchers should use multiple tests and assessment times longer than 2 weeks whenever possible [4, 10, 63, 64].
Our analysis of brain tissue endpoints revealed that most assess inflammation, edema, or cell death. Inflammation was frequently measured with immunohistology or western blotting. Edema was mostly assessed with wet-dry measurements. Cell death was mostly measured using TUNEL or Fluoro-Jade counts. Generally, tissue endpoints in preclinical research are difficult to translate to clinic, and thus calls have been made to investigate biomarkers that predict neuroprotective efficacy [4]. While preclinical research is advantageous because mechanisms can be evaluated, they must still be established as biomarkers (i.e., shown on a translatable scale, alongside neurological improvements), as described by the STAIR/RIGOR guidelines [4, 9, 14].
We began this study with the premise that long-term histological or imaging assessments of injury may be easily translatable endpoints in preclinical research. This is because neuroimaging is the gold standard for assessment and diagnosis of ICH and these data is easily available [65]. Additionally, many studies have determined the impact of injury volume and location on death and disability in animals and humans [63, 66,67,68,69]. We also reasoned that short-term injury assessments produce an incomplete picture, as injury occurs for weeks [26, 27, 70]. Moreover, mass effect complicates short-term injury assessments, which can result in biased measurements if tissue displacement is not considered. Moreover, cell death assessments may not be feasible in a long-term study and are influenced by the region of interest. Conversely, long-term injury volume assessments capture the end-product of injury and repair processes that result in an easily defined cavity without mass effect and are feasible owing to low mortality rates in preclinical models [71, 72]. Although other tissue endpoints are informative, we propose (in line with published guidelines) that long-term preclinical injury volume measurements are translationally valuable as they are established biomarkers [10]. However, we acknowledge that depending on the preclinical model used, there may be key differences in cerebral anatomy that must be considered (e.g., lissencephaly).
Lastly, to better understand the context of current research, we analyzed the most popular publishing venues and whether they require that manuscripts comply with experimental design and reporting guidelines. Few journals require mandatory compliance with published guidelines. About half of the most popular journals suggest reporting in accordance with ARRIVE or similar guidelines, but do not mandate it. Finally, 40% of the most popular journals in ICH do not recommend or require alignment with published guidelines. These facts are concerning given calls for transparent, translationally rigorous preclinical research [5, 9, 11, 28, 49].
Can We ARRIVE at a Standard for Experimental Design and Reporting by Putting our HEADS Together?
In 2018, the Hemorrhagic Stroke Academia Industry (HEADS) Roundtable published a report addressing current practices, priorities, and limitations of translational ICH research [73]. Several of our recommendations overlap with those, which are presented in Table 1. For example, the HEADS report stressed that advanced age and comorbidities must be addressed, speculating that most preclinical ICH research is performed in young, healthy animals, which our results confirm. Studies that consider advanced age and hypertension are important as they are established risk factors for ICH incidence and recurrence in patients [2, 74].
Similarly, HEADS recommended finding biomarkers to guide neuroprotective interventions. Our results suggest that most authors consider inflammation, cell death, and edema to be important ICH biomarkers. We found a heavy focus on preventing these injury processes. However, many post-stroke processes are multiphasic [73, 75]. Thus, timing of treatment onset should be considered, but few investigated multiple treatment delays, and most administered treatments before or immediately following ICH. Relying upon hyperacute treatments means that most ICH neuroprotection studies do not consider realistic therapeutic windows, as patient studies often show treatment delays of several hours [76,77,78]. Also, in the collagenase model, treatments administered in the first few hours must be considered as occurring during hematoma formation and are therefore more relevant to a smaller portion of re-bleeding patients that receive very early treatment. In sum, more work must be done to evaluate parameters under which neuroprotectants are effective (e.g., efficacy following a clinically relevant treatment delay).
To best address the issues raised here and in the HEADS report, a common recommendation is to systematically form networks that engage in high-quality ICH research. Indeed, Table 1 suggests that at the individual level, many of the HEADS recommendations are not being met. Although one group probably cannot assess every translational issue, several laboratories may [4, 73]. The HEADS report recognizes that ARRIVE and STAIR guidelines must be followed and recognize the value of replication studies. Authors may resist running replication studies, with concerns that the study may not replicate. These concerns must subside, as scientific inquiry must be supported by rigor and replication. Moreover, it is unethical to leave “unsuccessful” replication studies unpublished [9, 14, 73]. Several journals recognize the value of “negative” studies, and avenues exist to publish studies before they are conducted (i.e., registered studies). We and many others maintain that both “positive” and “negative” studies are essential to translational success, as they contribute to the evidence-base of a therapy [7, 42, 79, 80].
Conclusion and Summary
We conducted this study to assess research design and reporting in current preclinical ICH research, recognizing that inappropriate or inadequate research design can produce biased research findings and hinder translational success [9, 10, 15, 28]. We found that reporting of basic design elements has become commonplace, but there is significant room for improvement in terms of both experimental reporting and design. We note that published guidelines exist to aid investigators in research development and dissemination [9, 10, 28, 73]. Finally, publishers infrequently require mandatory reporting of critical experimental characteristics. In order to see improvements, publishers must require reporting in accordance with published guidelines, as the mere publication of guidelines without their enforcement may not improve reporting [38]. A collaborative approach towards improved experimental design and reporting is suggested at all levels of the publication process.
References
Krishnamurthi RV, Moran AE, Forouzanfar MH, Bennett DA, Mensah GA, Lawes CMM, Barker-Collo S, Connor M, Roth GA, Sacco R. The global burden of hemorrhagic stroke: a summary of findings from the GBD 2010 study. Glob Heart. 2014;9:101–6.
An SJ, Kim TJ, Yoon B-W. Epidemiology, risk factors, and clinical features of intracerebral hemorrhage: an update. J Stroke. 2017;19(1):3–10.
van Asch CJ, Luitse MJ, Rinkel GJ, van der Tweel I, Algra A, Klijn CJ. Incidence, case fatality, and functional outcome of intracerebral haemorrhage over time, according to age, sex, and ethnic origin: a systematic review and meta-analysis. Lancet Neurol. 2010;9(2):167–76.
Corbett D, Carmichael ST, Murphy TH, Jones TA, Schwab ME, Jolkkonen J, Clarkson AN, Dancause N, Weiloch T, Johansen-Berg H. Enhancing the alignment of the preclinical and clinical stroke recovery research pipeline: consensus-based core recommendations from the Stroke Recovery and Rehabilitation Roundtable translational working group. Neurorehabil Neural Repair. 2017;31(8):699–707.
Bosetti F, Koenig JI, Ayata C, Back SA, Becker K, Broderick JP, Carmichael ST, Cho S, Cipolla MJ, Corbett D. Translational stroke research: vision and opportunities. Stroke. 2017;48(9):2632–7.
Leonardo CC, Robbins S, Doré S. Translating basic science research to clinical application: models and strategies for intracerebral hemorrhage. Front Neurol. 2012;3:85.
Begley CG, Ioannidis JPA. Reproducibility in science: improving the standard for basic and preclinical research. Circ Res. 2015;116(1):116–26.
Plesser HE. Reproducibility vs. replicability: a brief history of a confused terminology. Front Neuroinform. 2018;11:76.
Lapchak PA, Zhang JH, Noble-Haeusslein LJ. RIGOR guidelines: escalating STAIR and STEPS for effective translational research. Transl Stroke Res. 2013;4(3):279–85.
Fisher M, Feuerstein G, Howells DW, Hurn PD, Kent TA, Savitz SI, Lo EH. Update of the stroke therapy academic industry roundtable preclinical recommendations. Stroke. 2009;40(6):2244–50.
Macleod MR, Fisher M, O’collins V, Sena ES, Dirnagl U, Bath PMW, Buchan A, Van Der Worp HB, Traystman R, Minematsu K. Good laboratory practice: preventing introduction of bias at the bench. Stroke. 2009;40(3):e50–2.
Henderson VC, Kimmelman J, Fergusson D, Grimshaw JM, Hackam DG. Threats to validity in the design and conduct of preclinical efficacy studies: a systematic review of guidelines for in vivo animal experiments. PLoS Med. 2013;10(7):e1001489.
Shuaib A. Neuroprotection–STAIR-way to the future? Cerebrovasc Dis. 2006;22:10–7.
Saver JL, Albers GW, Dunn B, Johnston KC, Fisher M. Stroke Therapy Academic Industry Roundtable (STAIR) recommendations for extended window acute stroke therapy trials. Stroke. 2009;40(7):2594–600.
O’Collins VE, Macleod MR, Donnan GA, Horky LL, van der Worp BH, Howells DW. 1,026 experimental treatments in acute stroke. Ann Neurol. 2006;59(3):467–77.
Chamorro Á, Dirnagl U, Urra X, Planas AM. Neuroprotection in acute stroke: targeting excitotoxicity, oxidative and nitrosative stress, and inflammation. Lancet Neurol. 2016;15(8):869–81.
Minnerup J, Sutherland BA, Buchan AM, Kleinschnitz C. Neuroprotection for stroke: current status and future perspectives. Int J Mol Sci. 2012;13(9):11753–72.
Keep RF, Hua Y, Xi G. Intracerebral haemorrhage: mechanisms of injury and therapeutic targets. Lancet Neurol. 2012;11(8):720–31.
Gladstone DJ, Black SE, Hakim AM. Toward wisdom from failure: lessons from neuroprotective stroke trials and new therapeutic directions. Stroke. 2002;33(8):2123–36.
Saver JL. Optimal end points for acute stroke therapy trials: best ways to measure treatment effects of drugs and devices. Stroke. 2011;42(8):2356–62.
Quinn TJ, Dawson J, Walters MR, Lees KR. Exploring the reliability of the modified Rankin scale. Stroke. 2009;40(3):762–6.
MacLellan CL, Paquette R, Colbourne F. A critical appraisal of experimental intracerebral hemorrhage research. J Cereb Blood Flow Metab. 2012;32(4):612–27.
Gebel JM Jr, Jauch EC, Brott TG, Khoury J, Sauerbeck L, Salisbury S, Spilker J, Tomsick TA, Duldner J, Broderick JP. Relative edema volume is a predictor of outcome in patients with hyperacute spontaneous intracerebral hemorrhage. Stroke. 2002;33(11):2636–41.
Murthy SB, Urday S, Beslow LA, Dawson J, Lees K, Kimberly WT, Iadecola C, Kamel H, Hanley DF, Sheth KN. Rate of perihaematomal oedema expansion is associated with poor clinical outcomes in intracerebral haemorrhage. J Neurol Neurosurg Psychiatry. 2016;87(11):1169–73.
Urday S, Kimberly WT, Beslow LA, Vortmeyer AO, Selim MH, Rosand J, Simard JM, Sheth KN. Targeting secondary injury in intracerebral haemorrhage—perihaematomal oedema. Nat Rev Neurol. 2015;11(2):111–22.
MacLellan CL, Silasi G, Poon CC, Edmundson CL, Buist R, Peeling J, Colbourne F. Intracerebral hemorrhage models in rat: comparing collagenase to blood infusion. J Cereb Blood Flow Metab. 2008;28(3):516–25.
Enzmann DR, Britt RH, Lyons BE, Buxton JL, Wilson DA. Natural history of experimental intracerebral hemorrhage: sonography, computed tomography and neuropathology. Am J Neuroradiol. 1981;2(6):517–26.
Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG. Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research. PLoS Biol. 2010;8(6).
Rosenberg GA, Mun-Bryce S, Wesley M, Kornfeld M. Collagenase-induced intracerebral hemorrhage in rats. Stroke. 1990;21(5):801–7.
Bullock R, Mendelow AD, Teasdale GM, Graham DI. Intracranial haemorrhage induced at arterial pressure in the rat: Part 1: Description of technique, ICP changes and neuropathological findings. Neurol Res. 1984;6(4):184–8.
Wang J, Fields J, Doré S. The development of an improved preclinical mouse model of intracerebral hemorrhage using double infusion of autologous whole blood. Brain Res. 2008;1222:214–21.
Balls M, Goldberg AM, Fentem JH, Broadhead CL, Burch RL, Festing MFW, Frazier JM, Hendriksen CFM, Jennings M, van der Kamp M. The three Rs: the way forward: the report and recommendations of the ECVAM Workshop 11. Alternatives to laboratory animals: ATLA. 1995;23:838–66.
Karp NA. Reproducible preclinical research—Is embracing variability the answer? PLoS Biol. 2018;16(3).
Würbel H. More than 3Rs: the importance of scientific validity for harm-benefit analysis of animal research. Lab Animal. 2017;46(4):164–6.
Starfield S, Paltridge B. Journal editors: Gatekeepers or custodians? In: Novice Writers and Scholarly Publication. Springer; 2019. p. 253–70.
Sena ES, Currie GL, McCann SK, Macleod MR, Howells DW. Systematic reviews and meta-analysis of preclinical studies: why perform them and how to appraise them critically. J Cereb Blood Flow Metab. 2014;34(5):737–42.
Landis SC, Amara SG, Asadullah K, Austin CP, Blumenstein R, Bradley EW, Crystal RG, Darnell RB, Ferrante RJ, Fillit H. A call for transparent reporting to optimize the predictive value of preclinical research. Nature. 2012;490(7419):187–91.
Marbacher S, Grüter B, Schöpf S, Croci D, Nevzati E, D’Alonzo D, Lattmann J, Roth T, Bircher B, Wolfert C. Systematic review of in vivo animal models of subarachnoid hemorrhage: species, standard parameters, and outcomes. Transl Stroke Res. 2019;10(3):250–8.
Konkle A, Kentner AC, Baker SL, Stewart A, Bielajew C. Environmental-enrichment–related variations in behavioral, biochemical, and physiologic responses of Sprague–Dawley and Long Evans rats. J Am Assoc Lab Anim Sci. 2010;49(4):427–36.
Nohynek GJ, Longeart L, Geffray B, Provost JP, Lodola A. Fat, frail and dying young: survival, body weight and pathology of the Charles River Sprague-Dawley-derived rat prior to and since the introduction of the VAFR variant in 1988. Hum Exp Toxicol. 1993;12(2):87–98.
Hubert M-F, Laroque P, Gillet J-P, Keenan KP. The effects of diet, ad libitum feeding, and moderate and severe dietary restriction on body weight, survival, clinical pathology parameters, and cause of death in control Sprague-Dawley rats. Toxicol Sci. 2000;58(1):195–207.
Schmidt‐Pogoda A, Bonberg N, Koecke MHM, Strecker J, Wellmann J, Bruckmann N, Beuker C, Schäbitz W, Meuth SG, Wiendl H. Why most acute stroke studies are positive in animals but not in patients: a systematic comparison of preclinical, early phase, and phase 3 clinical trials of neuroprotective agents. Ann Neurol. 2020;87(1):40–51.
Gokhale S, Caplan LR, James ML. Sex differences in incidence, pathophysiology, and outcome of primary intracerebral hemorrhage. Stroke. 2015;46(3):886–92.
Umeano O, Phillips-Bute B, Hailey CE, Sun W, Gray MC, Roulhac-Wilson B, McDonagh DL, Kranz PG, Laskowitz DT, James ML. Gender and age interact to affect early outcome after intracerebral hemorrhage. PLoS One. 2013;8(11):e81664.
Miller LR, Marks C, Becker JB, Hurn PD, Chen W-J, Woodruff T, McCarthy MM, Sohrabji F, Schiebinger L, Wetherington CL. Considering sex as a biological variable in preclinical research. FASEB J. 2016;31(1):29–34.
Hankivsky O, Springer KW, Hunting G. Beyond sex and gender difference in funding and reporting of health research. Res Integr peer Rev. 2018;3(1):6.
Auriat A, Plahta WC, McGie SC, Yan R, Colbourne F. 17 β-Estradiol pretreatment reduces bleeding and brain injury after intracerebral hemorrhagic stroke in male rats. J Cereb Blood Flow Metab. 2005;25(2):247–56.
Nakamura T, Hua Y, Keep RF, Park J-W, Xi G, Hoff JT. Estrogen therapy for experimental intracerebral hemorrhage in rats. J Neurosurg. 2005;103(1):97–103.
Howells DW, Sena ES, Macleod MR. Bringing rigour to translational medicine. Nat Rev Neurol. 2014;10(1):37.
Ferland C, Veilleux-Lemieux D, Vachon P. Effects of buprenorphine on intracerebral collagenase-induced hematoma in Sprague-Dawley rats. J Am Assoc Lab Anim Sci. 2007;46(3):13–6.
Wilkinson CM, Kalisvaart ACJ, Kung TFC, Maisey DR, Klahr AC, Dickson CT, Colbourne F. The collagenase model of intracerebral hemorrhage in awake, freely moving animals: The effects of isoflurane. Brain Res. 2020;1728.
Kiyatkin EA, Brown PL. Brain and body temperature homeostasis during sodium pentobarbital anesthesia with and without body warming in rats. Physiol Behav. 2005;84(4):563–70.
Zhu M, Nehra D, Ackerman JJH, Yablonskiy DA. On the role of anesthesia on the body/brain temperature differential in rats. J Therm Biol. 2004;29(7–8):599–603.
Anderson CS, Heeley E, Huang Y, Wang J, Stapf C, Delcourt C, et al. Rapid blood-pressure lowering in patients with acute intracerebral hemorrhage. N Engl J Med. 2013;368(25):2355–65.
Majidi S, Suarez JI, Qureshi AI. Management of acute hypertensive response in intracerebral hemorrhage patients after ATACH-2 trial. Neurocrit Care. 2017;27(2):249–58.
Guarnieri M, Brayton C, DeTolla L, Forbes-McBean N, Sarabia-Estrada R, Zadnik P. Safety and efficacy of buprenorphine for analgesia in laboratory mice and rats. Lab Anim (NY). 2012;41(11):337–43.
Ren Y, Zhang F-J, Xue Q-S, Zhao X, Yu B-W. Chloral hydrate is not acceptable for anesthesia or euthanasia of small animals. Anesthesiol J Am Soc Anesthesiol. 2009;111(1):209–10.
Maud P, Thavarak O, Cédrick L, Michèle B, Vincent B, Olivier P, Régis B. Evidence for the use of isoflurane as a replacement for chloral hydrate anesthesia in experimental stroke: an ethical issue. Biomed Res Int. 2014;2014.
Salmon AG, Kizer KW, Zeise L, Jackson RJ, Smith MT. Potential carcinogenicity of chloral hydrate–a review. J Toxicol Clin Toxicol. 1995;33(2):115–21.
Guha N, Loomis D, Grosse Y, et al. Carcinogenicity of trichloroethylene, tetrachloroethylene, some other chlorinated solvents, and their metabolites. Lancet Oncol. 2012;13(12):1192–93.
Button KS, Ioannidis JPA, Mokrysz C, Nosek BA, Flint J, Robinson ESJ, Munafò MR. Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci. 2013;14(5):365–76.
Button KS, Ioannidis JPA, Mokrysz C, Nosek BA, Flint J, Robinson ESJ, Munafò MR. Confidence and precision increase with high statistical power. Nat Rev Neurosci. 2013;14(8):585.
MacLellan CL, Auriat AM, McGie SC, Yan RHY, Huynh HD, De Butte MF, Colbourne F. Gauging recovery after hemorrhagic stroke in rats: implications for cytoprotection studies. J Cereb Blood Flow Metab. 2006;26(8):1031–42.
Kirkman MA, Allan SM, Parry-Jones AR. Experimental intracerebral hemorrhage: avoiding pitfalls in translational research. J Cereb Blood Flow Metab. 2011;31(11):2135–51.
Goldstein LB, Simel DL. Is this patient having a stroke? JAMA. 2005;293(19):2391–402.
Prabhakaran S, Zarahn E, Riley C, Speizer A, Chong JY, Lazar RM, Marshall RS, Krakauer JW. Inter-individual variability in the capacity for motor recovery after ischemic stroke. Neurorehabil Neural Repair. 2008;22(1):64–71.
Jeffers MS, Karthikeyan S, Corbett D. Does stroke rehabilitation really matter? Part A: proportional stroke recovery in the rat. Neurorehabil Neural Repair. 2018;32(1):3–6.
Boers AMM, Jansen IGH, Beenen LFM, Devlin TG, San Roman L, Heo JH, Ribó M, Brown S, Almekhlafi MA, Liebeskind DS. Association of follow-up infarct volume with functional outcome in acute ischemic stroke: a pooled analysis of seven randomized trials. J Neurointerv Surg. 2018;10(12):1137–42.
Hemphill JC, Bonovich DC, Besmertis L, Manley GT, Johnston SC. The ICH score. Stroke. 2001;32(4):891–7.
Elliott J, Smith M. The acute management of intracerebral hemorrhage: a clinical review. Anesth Analg. 2010;110(5):1419–27.
Liddle L, Reinders R, South S, Blacker D, Knuckey N, Colbourne F, Meloni B. Poly-arginine-18 peptides do not exacerbate bleeding, or improve functional outcomes following collagenase-induced intracerebral hemorrhage in the rat. PLoS One. 2019;14(11).
Adeoye O, Clark JF, Khatri P, Wagner KR, Zuccarello M, Pyne-Geithman GJ. Do current animal models of intracerebral hemorrhage mirror the human pathology? Transl Stroke Res. 2011;2(1):17–25.
Selim M, Hanley D, Broderick J, Goldstein JN, Gregson BA, Falcione G, Gonzales NR, Gurol E, Kersten J. Unmet needs and challenges in clinical research of intracerebral hemorrhage. Stroke. 2018;49(5):1299–307.
Hemphill JC, Greenberg SM, Anderson CS, Becker K, Bendok BR, Cushman M, Fung GL, Goldstein JN, Macdonald RL, Mitchell PH. Guidelines for the management of spontaneous intracerebral hemorrhage: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2015;46(7):2032–60.
Carmichael ST. Emergent properties of neural repair: elemental biology to therapeutic concepts. Ann Neurol. 2016;79(6):895–906.
Faiz KW, Sundseth A, Thommessen B, Rønning OM. Prehospital delay in acute stroke and TIA. Emerg Med J. 2013;30(8):669–74.
Qureshi AI. Intracerebral hemorrhage specific intensity of care quality metrics. Neurocrit Care. 2011;14(2):291–317.
Pulvers JN, Watson JDG. If time is brain where is the improvement in prehospital time after stroke? Front Neurol. 2017;8:617.
Ioannidis JPA. Why most published research findings are false. PLoS Med. 2005;2(8):e124.
Dirnagl U. Resolving the Tension Between Exploration and Confirmation in Preclinical Biomedical Research. In: Good Research Practice in Non-Colinical Pharmacology and Biomedicine. Springer; 2019. p. 71–79.
Funding
FC is supported by the Canadian Institutes of Health Research Grant (166087) and holds a Canada Research Chair in Intracerebral Hemorrhagic Stroke. LL is supported by the Canadian Graduate Studies—Master’s Award from the Canadian Institutes of Health Research.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Research Involving Human Participants and/or Animals
The current research is a systematic review of preclinical literature, and therefore, no animal or human participants were directly involved in this manuscript.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Liddle, L.J., Ralhan, S., Ward, D.L. et al. Translational Intracerebral Hemorrhage Research: Has Current Neuroprotection Research ARRIVEd at a Standard for Experimental Design and Reporting?. Transl. Stroke Res. 11, 1203–1213 (2020). https://doi.org/10.1007/s12975-020-00824-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12975-020-00824-x