Skip to main content
Advertisement
  • Neurology.org
  • Journals
    • Neurology
    • Clinical Practice
    • Education
    • Genetics
    • Neuroimmunology & Neuroinflammation
  • Online Sections
    • Neurology Video Journal Club
    • Diversity, Equity, & Inclusion (DEI)
    • Neurology: Clinical Practice Accelerator
    • Practice Buzz
    • Practice Current
    • Residents & Fellows
    • Without Borders
  • Collections
    • COVID-19
    • Disputes & Debates
    • Health Disparities
    • Infographics
    • Neurology Future Forecasting Series
    • Null Hypothesis
    • Patient Pages
    • Topics A-Z
    • Translations
    • UDDA Revision Series
  • Podcast
  • CME
  • About
    • About the Journals
    • Contact Us
    • Editorial Board
  • Authors
    • Submit New Manuscript
    • Submit Revised Manuscript
    • Author Center

Advanced Search

Main menu

  • Neurology.org
  • Journals
    • Neurology
    • Clinical Practice
    • Education
    • Genetics
    • Neuroimmunology & Neuroinflammation
  • Online Sections
    • Neurology Video Journal Club
    • Diversity, Equity, & Inclusion (DEI)
    • Neurology: Clinical Practice Accelerator
    • Practice Buzz
    • Practice Current
    • Residents & Fellows
    • Without Borders
  • Collections
    • COVID-19
    • Disputes & Debates
    • Health Disparities
    • Infographics
    • Neurology Future Forecasting Series
    • Null Hypothesis
    • Patient Pages
    • Topics A-Z
    • Translations
    • UDDA Revision Series
  • Podcast
  • CME
  • About
    • About the Journals
    • Contact Us
    • Editorial Board
  • Authors
    • Submit New Manuscript
    • Submit Revised Manuscript
    • Author Center
  • Home
  • Latest Articles
  • Current Issue
  • Past Issues
  • Neurology Video Journal Club
  • Residents & Fellows

User menu

  • Subscribe
  • My Alerts
  • Log in

Search

  • Advanced search
Neurology
Home
The most widely read and highly cited peer-reviewed neurology journal
  • Subscribe
  • My Alerts
  • Log in
Site Logo
  • Home
  • Latest Articles
  • Current Issue
  • Past Issues
  • Neurology Video Journal Club
  • Residents & Fellows

Share

July 19, 2016; 87 (3) Article

Early CT changes in patients admitted for thrombectomy

Intrarater and interrater agreement

Behzad Farzin, Robert Fahed, Francois Guilbert, Alexandre Y. Poppe, Nicole Daneault, André P. Durocher, Sylvain Lanthier, Hayet Boudjani, Naim N. Khoury, Daniel Roy, Alain Weill, Jean-Christophe Gentric, André L. Batista, Laurent Létourneau-Guillon, François Bergeron, Marc-Antoine Henry, Tim E. Darsaut, Jean Raymond
First published June 17, 2016, DOI: https://doi.org/10.1212/WNL.0000000000002860
Behzad Farzin
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert Fahed
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Francois Guilbert
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD, FRCPC
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alexandre Y. Poppe
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD, FRCPC
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nicole Daneault
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD, FRCPC
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
André P. Durocher
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD, FRCPC
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sylvain Lanthier
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD, FRCPC
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hayet Boudjani
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Naim N. Khoury
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Daniel Roy
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD, FRCPC
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alain Weill
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD, FRCPC
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jean-Christophe Gentric
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
André L. Batista
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Laurent Létourneau-Guillon
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD, FRCPC
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
François Bergeron
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marc-Antoine Henry
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tim E. Darsaut
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD, FRCSC
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jean Raymond
From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada.
MD, FRCPC
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Full PDF
Citation
Early CT changes in patients admitted for thrombectomy
Intrarater and interrater agreement
Behzad Farzin, Robert Fahed, Francois Guilbert, Alexandre Y. Poppe, Nicole Daneault, André P. Durocher, Sylvain Lanthier, Hayet Boudjani, Naim N. Khoury, Daniel Roy, Alain Weill, Jean-Christophe Gentric, André L. Batista, Laurent Létourneau-Guillon, François Bergeron, Marc-Antoine Henry, Tim E. Darsaut, Jean Raymond
Neurology Jul 2016, 87 (3) 249-256; DOI: 10.1212/WNL.0000000000002860

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Permissions

Make Comment

See Comments

Downloads
409

Share

  • Article
  • Figures & Data
  • Info & Disclosures
Loading

This article requires a subscription to view the full text. If you have a subscription you may use the login form below to view the article. Access to this article can also be purchased.

Abstract

Objective: To systematically review the literature and assess agreement on the Alberta Stroke Program Early CT Score (ASPECTS) among clinicians involved in the management of thrombectomy candidates.

Methods: Studies assessing agreement using ASPECTS published from 2000 to 2015 were reviewed. Fifteen raters reviewed and scored the anonymized CT scans of 30 patients recruited in a local thrombectomy trial during 2 independent sessions, in order to study intrarater and interrater agreement. Agreement was measured using intraclass correlation coefficients (ICCs) and Fleiss kappa statistics for ASPECTS and dichotomized ASPECTS at various cutoff values.

Results: The review yielded 30 articles reporting 40 measures of agreement. Populations, methods, analyses, and results were heterogeneous (slight to excellent agreement), precluding a meta-analysis. When analyzed as a categorical variable, intrarater agreement was slight to moderate (κ = 0.042–0.469); it reached a substantial level (κ > 0.6) in 11/15 raters when the score was dichotomized (0–5 vs 6–10). The interrater ICCs varied between 0.672 and 0.811, but agreement was slight to moderate (κ = 0.129–0.315). Even in the best of cases, when ASPECTS was dichotomized as 0–5 vs 6–10, interrater agreement did not reach a substantial level (κ = 0.561), which translates into at least 5 of 15 raters not giving the same dichotomized verdict in 15% of patients.

Conclusions: In patients considered for thrombectomy, there may be insufficient agreement between clinicians for ASPECTS to be reliably used as a criterion for treatment decisions.

GLOSSARY

ASPECTS=
Alberta Stroke Program Early CT Score;
EASI=
Endovascular Acute Stroke Intervention Trial;
ICC=
intraclass correlation coefficient;
NIHSS=
NIH Stroke Scale score;
PACS=
Picture Archiving and Communication System

Footnotes

  • ↵* These authors contributed equally to this work.

  • Go to Neurology.org for full disclosures. Funding information and disclosures deemed relevant by the authors, if any, are provided at the end of the article.

  • Supplemental data at Neurology.org

  • Editorial, page 242

  • Received November 19, 2015.
  • Accepted in final form February 24, 2016.
  • © 2016 American Academy of Neurology
View Full Text

AAN Members

We have changed the login procedure to improve access between AAN.com and the Neurology journals. If you are experiencing issues, please log out of AAN.com and clear history and cookies. (For instructions by browser, please click the instruction pages below). After clearing, choose preferred Journal and select login for AAN Members. You will be redirected to a login page where you can log in with your AAN ID number and password. When you are returned to the Journal, your name should appear at the top right of the page.

Google Safari Microsoft Edge Firefox

Click here to login

AAN Non-Member Subscribers

Click here to login

Purchase access

For assistance, please contact:
AAN Members (800) 879-1960 or (612) 928-6000 (International)
Non-AAN Member subscribers (800) 638-3030 or (301) 223-2300 option 3, select 1 (international)

Sign Up
Information on how to subscribe to Neurology and Neurology: Clinical Practice can be found here 

Purchase
Individual access to articles is available through the Add to Cart option on the article page.  Access for 1 day (from the computer you are currently using) is US$ 39.00.  Pay-per-view content is for the use of the payee only, and content may not be further distributed by print or electronic means.  The payee may view, download, and/or print the article for his/her personal, scholarly, research, and educational use.  Distributing copies (electronic or otherwise) of the article is not allowed.

Letters: Rapid online correspondence

  • Time to Resign the ASPECTS
    • Reza Behrouz, Associate Professor, Unviersity of Texas School of Medicine at San Antoniobehrouz@uthscsa.edu
    Submitted August 04, 2016
Comment

REQUIREMENTS

You must ensure that your Disclosures have been updated within the previous six months. Please go to our Submission Site to add or update your Disclosure information.

Your co-authors must send a completed Publishing Agreement Form to Neurology Staff (not necessary for the lead/corresponding author as the form below will suffice) before you upload your comment.

If you are responding to a comment that was written about an article you originally authored:
You (and co-authors) do not need to fill out forms or check disclosures as author forms are still valid
and apply to letter.

Submission specifications:

  • Submissions must be < 200 words with < 5 references. Reference 1 must be the article on which you are commenting.
  • Submissions should not have more than 5 authors. (Exception: original author replies can include all original authors of the article)
  • Submit only on articles published within 6 months of issue date.
  • Do not be redundant. Read any comments already posted on the article prior to submission.
  • Submitted comments are subject to editing and editor review prior to posting.

More guidelines and information on Disputes & Debates

Compose Comment

More information about text formats

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Author Information
NOTE: The first author must also be the corresponding author of the comment.
First or given name, e.g. 'Peter'.
Your last, or family, name, e.g. 'MacMoody'.
Your email address, e.g. higgs-boson@gmail.com
Your role and/or occupation, e.g. 'Orthopedic Surgeon'.
Your organization or institution (if applicable), e.g. 'Royal Free Hospital'.
Publishing Agreement
NOTE: All authors, besides the first/corresponding author, must complete a separate Publishing Agreement Form and provide via email to the editorial office before comments can be posted.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Vertical Tabs

You May Also be Interested in

Back to top
  • Article
    • Abstract
    • GLOSSARY
    • METHODS
    • RESULTS
    • DISCUSSION
    • AUTHOR CONTRIBUTIONS
    • STUDY FUNDING
    • DISCLOSURE
    • ACKNOWLEDGMENT
    • Footnotes
    • REFERENCES
  • Figures & Data
  • Info & Disclosures
Advertisement

Direct Health Care Costs Associated With Multiple Sclerosis: A Population-Based Cohort Study in British Columbia, Canada, 2001-2020

Dr. Dennis Bourdette and Dr. Lindsey Wooliscroft

► Watch

Related Articles

  • Patient selection for stroke thrombectomyIs CT head good enough?

Topics Discussed

  • All Cerebrovascular disease/Stroke
  • CT
  • Infarction

Alert Me

  • Alert me when eletters are published

Recommended articles

  • Research
    Frequency of early rapid improvement in stroke severity during interfacility transfer
    Kori S. Zachrison, Thabele M. Leslie-Mazwi, Gregoire Boulouis et al.
    Neurology: Clinical Practice, May 08, 2019
  • Research Article
    Association of Pediatric ASPECTS and NIH Stroke Scale, Hemorrhagic Transformation, and 12-Month Outcome in Children With Acute Ischemic Stroke
    Lauren A. Beslow, Arastoo Vossough, Rebecca N. Ichord et al.
    Neurology, August 13, 2021
  • Article
    Clinical and Neuroimaging Outcomes of Direct Thrombectomy vs Bridging Therapy in Large Vessel Occlusion
    Analysis of the SELECT Cohort Study
    Amrou Sarraj, James Grotta, Gregory W. Albers et al.
    Neurology, April 19, 2021
  • Article
    Reliability of brain CT evaluation by stroke neurologists in telemedicine
    Volker Puetz, Ulf Bodechtel, Johannes C. Gerber et al.
    Neurology, December 19, 2012
Neurology: 101 (10)

Articles

  • Ahead of Print
  • Current Issue
  • Past Issues
  • Popular Articles
  • Translations

About

  • About the Journals
  • Ethics Policies
  • Editors & Editorial Board
  • Contact Us
  • Advertise

Submit

  • Author Center
  • Submit a Manuscript
  • Information for Reviewers
  • AAN Guidelines
  • Permissions

Subscribers

  • Subscribe
  • Activate a Subscription
  • Sign up for eAlerts
  • RSS Feed
Site Logo
  • Visit neurology Template on Facebook
  • Follow neurology Template on Twitter
  • Visit Neurology on YouTube
  • Neurology
  • Neurology: Clinical Practice
  • Neurology: Education
  • Neurology: Genetics
  • Neurology: Neuroimmunology & Neuroinflammation
  • AAN.com
  • AANnews
  • Continuum
  • Brain & Life
  • Neurology Today

Wolters Kluwer Logo

Neurology | Print ISSN:0028-3878
Online ISSN:1526-632X

© 2023 American Academy of Neurology

  • Privacy Policy
  • Feedback
  • Advertise