{"id":46081,"date":"2023-11-20T05:51:09","date_gmt":"2023-11-20T11:51:09","guid":{"rendered":"https:\/\/stage.cancerimagingarchive.net\/analysis-result\/radiomic-feature-standards\/"},"modified":"2024-09-10T14:48:24","modified_gmt":"2024-09-10T19:48:24","slug":"radiomic-feature-standards","status":"publish","type":"tcia_analysis_result","link":"https:\/\/stage.cancerimagingarchive.net\/analysis-result\/radiomic-feature-standards\/","title":{"rendered":"RADIOMIC-FEATURE-STANDARDS"},"featured_media":8973,"template":"","class_list":["post-46081","tcia_analysis_result","type-tcia_analysis_result","status-publish","has-post-thumbnail"],"cancer_types":["Lung"],"citations":[46041,46043,9225,46045,46047,46049,46051,46053,46055,46057,46059,46061,46063,46065],"result_doi":"10.7937\/tcia.2020.9era-gg29","result_download_info":"","result_downloads":[46067,46069,46071,46073,46075],"version_change_log_archived":"Version 1 (Current): Updated 2020\/06\/09\r\nData TypeDownload all or Query\/FilterCorresponding Original CT images from LIDC-IDRI and DRO-Toolkit (DICOM, 2.0 GB)\r\n Download\u00a0\r\n\r\n Search\u00a0\r\n(Requires NBIA Data Retriever.)Corresponding second-generation SEG images from QIN-LungCT-Seg (DICOM, 123 MB)\u00a0\r\n Download\u00a0\r\n\r\n Search\u00a0\r\n(Requires NBIA Data Retriever.)Segmentation (NIfTI, zip, 4 MB)\r\n Download\u00a0\r\nFeature Variability Software Package details (xlsx)\r\n Download\u00a0\r\nDRO Results (xlsx)\r\n Download\u00a0\r\nPatient Dataset Results (xlsx)\r\n Download\u00a0\r\nHarmonized GLCM Entropy Results \u00a0(xlsx)\r\n Download\u00a0","versions":false,"additional_resources":"","cancer_locations":["Chest"],"publications_related":"&nbsp;","result_page_accessibility":"Public","detailed_description":"<strong>Patient IDs for the 3 DROs from (<a href=\"https:\/\/doi.org\/10.7937\/t062-8262\">https:\/\/doi.org\/10.7937\/t062-8262<\/a>)<\/strong>\r\nPhantom-100.0-1.0-1.0-1.0-9.0-0.0-100.0-10.0-0.0-0.0\r\nPhantom-100.0-1.0-1.0-1.0-9.0-0.0-100.0-10.0-50.0-0.0\r\nPhantom-100.0-1.0-1.0-1.0-9.0-0.2-100.0-10.0-0.0-0.0\r\n\r\n<strong>Patient IDs for the 10 LIDC-IDRI subjects (<a href=\"http:\/\/doi.org\/10.7937\/K9\/TCIA.2015.LO9QL9SX\">https:\/\/doi.org\/10.7937\/K9\/TCIA.2015.LO9QL9SX<\/a>)<\/strong>\r\nLIDC-IDRI-0314\r\nLIDC-IDRI-0325\r\nLIDC-IDRI-0580\r\nLIDC-IDRI-0766\r\nLIDC-IDRI-0771\r\nLIDC-IDRI-0811\r\nLIDC-IDRI-0905\r\nLIDC-IDRI-0963\r\nLIDC-IDRI-0965\r\nLIDC-IDRI-1012\r\n\r\nAdditional options for download:\r\n<table><colgroup> <col \/> <col \/> <\/colgroup>\r\n<tbody>\r\n<tr>\r\n<th>DRO Data (3 subjects)<\/th>\r\n<th>Download all or Query\/Filter<\/th>\r\n<\/tr>\r\n<tr>\r\n<td>Image Data (DICOM, 452.0 MB)\r\n\r\nCT only<\/td>\r\n<td>\r\n<div>\r\n\r\n<a href=\"\/wp-content\/uploads\/DRO-Toolkit-3-Subjects-DICOM-CT-Image-Data-TCIA-Manifest.tcia\" download=\"DRO-Toolkit-3-Subjects-DICOM-CT-Image-Data-TCIA-Manifest.tcia\"><button><i><\/i> Download<\/button><\/a>\r\n\r\n<a href=\"https:\/\/nbia.cancerimagingarchive.net\/nbia-search\/?ImageModalityCriteria=CT&amp;MinNumberOfStudiesCriteria=1&amp;PatientCriteria=Phantom-100.0-1.0-1.0-1.0-9.0-0.0-100.0-10.0-0.0-0.0,Phantom-100.0-1.0-1.0-1.0-9.0-0.0-100.0-10.0-50.0-0.0,Phantom-100.0-1.0-1.0-1.0-9.0-0.2-100.0-10.0-0.0-0.0&amp;CollectionCriteria=DRO-Toolkit\"><button><i><\/i> Search<\/button><\/a>\r\n\r\n(Requires\u00a0<a href=\"https:\/\/wiki.cancerimagingarchive.net\/display\/NBIA\/Downloading+TCIA+Images\">NBIA Data Retriever<\/a>.)\r\n\r\n<\/div><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Segmentation Data - DSO (DICOM, 29.0 MB)<\/td>\r\n<td>\r\n<div>\r\n\r\n<a href=\"\/wp-content\/uploads\/DRO-Toolkit-3-Subjects-DICOM-Segmentation-Data-TCIA-Manifest.tcia\" download=\"DRO-Toolkit-3-Subjects-DICOM-Segmentation-Data-TCIA-Manifest.tcia\"><button><i><\/i> Download<\/button><\/a>\r\n\r\n<a href=\"https:\/\/nbia.cancerimagingarchive.net\/nbia-search\/?ImageModalityCriteria=SEG&amp;MinNumberOfStudiesCriteria=1&amp;PatientCriteria=Phantom-100.0-1.0-1.0-1.0-9.0-0.0-100.0-10.0-0.0-0.0,Phantom-100.0-1.0-1.0-1.0-9.0-0.0-100.0-10.0-50.0-0.0,Phantom-100.0-1.0-1.0-1.0-9.0-0.2-100.0-10.0-0.0-0.0&amp;CollectionCriteria=DRO-Toolkit\"><button><i><\/i> Search<\/button><\/a>\r\n\r\n(Requires\u00a0<a href=\"https:\/\/wiki.cancerimagingarchive.net\/display\/NBIA\/Downloading+TCIA+Images\">NBIA Data Retriever<\/a>.)\r\n\r\n<\/div><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Segmentation Data - (NIfTI, zip, 926 KB)<\/td>\r\n<td>\r\n<div>\r\n\r\n<a href=\"\/wp-content\/uploads\/DRO-Toolkit-3-Subjects-SEG-Images-NIfTI-.zip\" download=\"DRO-Toolkit-3-Subjects-SEG-Images-NIfTI-.zip\"><button><i><\/i> Download<\/button><\/a>\r\n\r\n<\/div><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<table><colgroup> <col \/> <col \/> <\/colgroup>\r\n<tbody>\r\n<tr>\r\n<th>Patient Datasets (10 subjects)<\/th>\r\n<th>Download all or Query\/Filter<\/th>\r\n<\/tr>\r\n<tr>\r\n<td>Image Data (DICOM, 1.0 GB)\r\n\r\nCT only<\/td>\r\n<td>\r\n<div>\r\n\r\n<a href=\"\/wp-content\/uploads\/LIDC-IDRI-10-Subjects-DICOM-CT-Image-Data-TCIA-manifest.tcia\" download=\"LIDC-IDRI-10-Subjects-DICOM-CT-Image-Data-TCIA-manifest.tcia\"><button><i><\/i> Download<\/button><\/a>\r\n\r\n<a href=\"https:\/\/nbia.cancerimagingarchive.net\/nbia-search\/?ImageModalityCriteria=CT&amp;MinNumberOfStudiesCriteria=1&amp;PatientCriteria=LIDC-IDRI-0314,LIDC-IDRI-0325,LIDC-IDRI-0580,LIDC-IDRI-0766,LIDC-IDRI-0771,LIDC-IDRI-0811,LIDC-IDRI-0905,LIDC-IDRI-0963,LIDC-IDRI-0965,LIDC-IDRI-1012&amp;CollectionCriteria=LIDC-IDRI\"><button><i><\/i> Search<\/button><\/a>\r\n\r\n(Requires\u00a0<a href=\"https:\/\/wiki.cancerimagingarchive.net\/display\/NBIA\/Downloading+TCIA+Images\">NBIA Data Retriever<\/a>.)\r\n\r\n<\/div><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Segmentation Data - (DICOM, 94 MB)<\/td>\r\n<td>\r\n<div>\r\n\r\n<a href=\"\/wp-content\/uploads\/LIDC-IDRI-10-Subjects-DICOM-SEG-Image-Data-TCIA-Manifest.tcia\" download=\"LIDC-IDRI-10-Subjects-DICOM-SEG-Image-Data-TCIA-Manifest.tcia\"><button><i><\/i> Download<\/button><\/a>\r\n\r\n<a href=\"https:\/\/nbia.cancerimagingarchive.net\/nbia-search\/?saved-cart=nbia-39001586554584246\"><button><i><\/i> Search<\/button><\/a>\r\n\r\n(Requires\u00a0<a href=\"https:\/\/wiki.cancerimagingarchive.net\/display\/NBIA\/Downloading+TCIA+Images\">NBIA Data Retriever<\/a>.)\r\n\r\n<\/div><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Segmentation Data - (NIfTI, zip, 21.0 KB)<\/td>\r\n<td>\r\n<div>\r\n\r\n<a href=\"\/wp-content\/uploads\/LIDC-IDRI-10-Subjects-NIfTI-Patient_Image_Data_NIFTI_Segs.zip\" download=\"LIDC-IDRI-10-Subjects-NIfTI-Patient_Image_Data_NIFTI_Segs.zip\"><button><i><\/i> Download<\/button><\/a>\r\n\r\n<\/div><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>","publications_using":"TCIA maintains <a href=\"https:\/\/www.cancerimagingarchive.net\/publications\/\"> a list of publications <\/a> which leverage TCIA data. If you have a manuscript you'd like to add please <a href=\"http:\/\/www.cancerimagingarchive.net\/support\/\">contact TCIA's Helpdesk<\/a>.","result_title":"Standardization in Quantitative Imaging: A Multi-center Comparison of Radiomic Feature Values","species":false,"version_number":"1","date_updated":"2020-06-09","related_collections":[43681,42151],"result_short_title":"Radiomic-Feature-Standards","subjects":"13","related_analysis_results":[45659],"result_browse_title":"Standardization in Quantitative Imaging: A Multi-center Comparison of Radiomic Feature Values (Radiomic-Feature-Standards)","supporting_data":["Multi-center comparison of radiomic features."],"version_change_log":"","collections":"Below is a list of the Collections used in these analyses:\r\n<table><colgroup> <col \/> <col \/> <col \/><\/colgroup>\r\n<tbody>\r\n<tr>\r\n<th scope=\"col\">Source Data Type<\/th>\r\n<th scope=\"col\">Download<\/th>\r\n<th scope=\"col\">License<\/th>\r\n<\/tr>\r\n<tr>\r\n<td>Corresponding Original CT images from <a href=\"https:\/\/doi.org\/10.7937\/K9\/TCIA.2015.LO9QL9SX\">LIDC-IDRI<\/a> and <a href=\"https:\/\/doi.org\/10.7937\/t062-8262\">DRO-Toolkit<\/a> (DICOM, 2.0 GB)<\/td>\r\n<td>\r\n<div>\r\n\r\n<a href=\"https:\/\/wiki.cancerimagingarchive.net\/download\/attachments\/70222123\/Radiomic-Feature-Standards-DICOM%20CTs%203%20Subjects%20DRO%20Toolkit%2010%20Subjects%20QIN.tcia?api=v2\"><button><i><\/i> Download<\/button><\/a>\r\n\r\n<a href=\"https:\/\/nbia.cancerimagingarchive.net\/nbia-search\/?ImageModalityCriteria=CT&amp;MinNumberOfStudiesCriteria=1&amp;PatientCriteria=Phantom-100.0-1.0-1.0-1.0-9.0-0.0-100.0-10.0-0.0-0.0,Phantom-100.0-1.0-1.0-1.0-9.0-0.0-100.0-10.0-50.0-0.0,Phantom-100.0-1.0-1.0-1.0-9.0-0.2-100.0-10.0-0.0-0.0,LIDC-IDRI-0314,LIDC-IDRI-0325,LIDC-IDRI-0580,LIDC-IDRI-0766,LIDC-IDRI-0771,LIDC-IDRI-0811,LIDC-IDRI-0905,LIDC-IDRI-0963,LIDC-IDRI-0965,LIDC-IDRI-1012\"><button><i><\/i> Search<\/button><\/a>\r\n\r\n<\/div>\r\n(Requires <a href=\"https:\/\/wiki.cancerimagingarchive.net\/display\/NBIA\/Downloading+TCIA+Images\">NBIA Data Retriever<\/a>.)<\/td>\r\n<td>\r\n<div>\r\n\r\n<a href=\"https:\/\/creativecommons.org\/licenses\/by\/3.0\/\">CC BY 3.0<\/a>\r\n\r\n<\/div><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Corresponding second-generation SEG images from <a href=\"https:\/\/doi.org\/10.7937\/k9\/tcia.2015.1buvfjr7\">QIN-LungCT-Seg<\/a> (DICOM, 123 MB)<\/td>\r\n<td>\r\n<div>\r\n\r\n<a href=\"https:\/\/wiki.cancerimagingarchive.net\/download\/attachments\/70222123\/Radiomic-Feature-Standards-DICOM%20Segs%203%20Subjects%20DRO%20Toolkit%2010%20Subjects%20QIN.tcia?api=v2\"><button><i><\/i> Download<\/button><\/a>\r\n\r\n<a href=\"https:\/\/nbia.cancerimagingarchive.net\/nbia-search\/?ImageModalityCriteria=SEG&amp;MinNumberOfStudiesCriteria=1&amp;PatientCriteria=Phantom-100.0-1.0-1.0-1.0-9.0-0.0-100.0-10.0-0.0-0.0,Phantom-100.0-1.0-1.0-1.0-9.0-0.0-100.0-10.0-50.0-0.0,Phantom-100.0-1.0-1.0-1.0-9.0-0.2-100.0-10.0-0.0-0.0,LIDC-IDRI-0314,LIDC-IDRI-0325,LIDC-IDRI-0580,LIDC-IDRI-0766,LIDC-IDRI-0771,LIDC-IDRI-0811,LIDC-IDRI-0905,LIDC-IDRI-0963,LIDC-IDRI-0965,LIDC-IDRI-1012\"><button><i><\/i> Search<\/button><\/a>\r\n(Requires <a href=\"https:\/\/wiki.cancerimagingarchive.net\/display\/NBIA\/Downloading+TCIA+Images\">NBIA Data Retriever<\/a>.)\r\n\r\n<\/div><\/td>\r\n<td>\r\n<div>\r\n\r\n<a href=\"https:\/\/creativecommons.org\/licenses\/by\/3.0\/\">CC BY 3.0<\/a>\r\n\r\n<\/div><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n&nbsp;","result_summary":"This dataset was used by the NCI's Quantitative Imaging Network (QIN) PET-CT Subgroup for their project titled: <strong>Multi-center Comparison of Radiomic Features from Different Software Packages on Digital Reference Objects and Patient Datasets<\/strong>.\u00a0 The purpose of this project was to assess the agreement among radiomic features when computed by several groups by using different software packages under very tightly controlled conditions, which included common image data sets and standardized feature definitions.\r\n\r\n<a href=\"\/wp-content\/uploads\/Screen-Shot-2020-06-19-at-7.56.05-PM.png\" rel=\"prettyPhoto noopener\"><img class=\"cm-inline-img-css alignright wp-image-1958 size-medium\" src=\"\/wp-content\/uploads\/Screen-Shot-2020-06-19-at-7.56.05-PM.png\" \/><\/a><a href=\"\/wp-content\/uploads\/Screen-Shot-2020-06-19-at-7.53.53-PM.png\" rel=\"prettyPhoto noopener\"><img class=\"cm-inline-img-css alignright wp-image-1959 size-medium\" src=\"\/wp-content\/uploads\/Screen-Shot-2020-06-19-at-7.53.53-PM.png\" \/><\/a>\r\n\r\nThe image datasets (and Volumes of Interest \u2013 VOIs) provided here are the same ones used in that project and reported in the publication listed below (ISSN 2379-1381\u00a0<a href=\"https:\/\/doi.org\/10.18383\/j.tom.2019.00031\">https:\/\/doi.org\/10.18383\/j.tom.2019.00031<\/a>).\u00a0 In addition, we have provided detailed information about the software packages used (Table 1 in that publication) as well as the individual feature value results for each image dataset and each software package that was used to create the summary tables (Tables 2, 3 and 4) in that publication.\r\n\r\nFor that project, nine common quantitative imaging features were selected for comparison including features that describe morphology, intensity, shape, and texture and that are described in detail in the International Biomarker Standardisation Initiative (IBSI,\u00a0<a href=\"https:\/\/arxiv.org\/abs\/1612.07003\">https:\/\/arxiv.org\/abs\/1612.07003\u00a0<\/a>\u00a0and\u00a0 publication (Zwanenburg A. Valli\u00e8res M, et al, <strong>The Image Biomarker\u00a0Standardization\u00a0Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping<\/strong>. Radiology. 2020 May;295(2):328-338. doi: <a href=\"https:\/\/doi.org\/10.1148\/radiol.2020191145\">https:\/\/doi.org\/10.1148\/radiol.2020191145<\/a>).\r\n\r\nThere are three datasets provided \u2013 two image datasets and one dataset consisting of four excel spreadsheets containing feature values.\r\n<ol>\r\n \t<li>The first image dataset is a set of three Digital Reference Objects (DROs) used in the project, which are: (a) a sphere with uniform intensity, (b) a sphere with intensity variation (c) a nonspherical (but mathematically defined) object with uniform intensity. These DROs were created by the team at Stanford University and are described in (Jaggi A, Mattonen SA, McNitt-Gray M, Napel S. <strong>Stanford DRO Toolkit: digital reference objects for standardization of radiomic features.<\/strong> Tomography. 2019;6:\u2013.) and are a subset of the DROs described in <a href=\"\/collection\/dro-toolkit\/\" target=\"_blank\" rel=\"noopener\">DRO Toolkit<\/a>. Each DRO is represented in both DICOM and NIfTI format and the VOI was provided in each format as well (DICOM Segmentation Object (DSO) as well as NIfTI segmentation boundary).<\/li>\r\n \t<li>The second image dataset is the set of 10 patient CT scans, originating from the <a href=\"\/collection\/lidc-idri\/\"><strong>LIDC-IDRI<\/strong><\/a> dataset, that were used in the <strong>QIN multi-site collection of Lung CT<\/strong> data with Nodule Segmentations project ( <a href=\"https:\/\/doi.org\/10.7937\/K9\/TCIA.2015.1BUVFJR7\">https:\/\/doi.org\/10.7937\/K9\/TCIA.2015.1BUVFJR7<\/a> ). In that QIN study, a single lesion from each case was identified for analysis and then nine VOIs were generated using three repeat runs of three segmentation algorithms (one from each of three academic institutions) on each lesion.\u00a0 To eliminate one source of variability in our project, only one of the VOIs previously created for each lesion was identified and all sites used that same VOI definition. The specific VOI chosen for each lesion was the first run of the first algorithm (algorithm 1, run 1). DICOM images were provided for each dataset and the VOI was provided in both DICOM Segmentation Object (DSO) and NIfTI segmentation formats.<\/li>\r\n \t<li>The third dataset is a collection of four excel spreadsheets, each of which contains detailed information corresponding to each of the four tables in the publication. For example, the raw feature values and the summary tables for Tables 2,3 and 4 reported in the publication cited (<a href=\"https:\/\/doi.org\/10.18383\/j.tom.2019.00031\">https:\/\/doi.org\/10.18383\/j.tom.2019.00031<\/a>). These tables are:<\/li>\r\n<\/ol>\r\n<u> Software Package details <\/u>: This table contains detailed information about the software packages used in the study (and listed in Table 1 in the publication) including version number and any parameters specified in the calculation of the features reported.\r\n\r\n<u> DRO results <\/u>: This contains the original feature values obtained for each software package for each DRO as well as the table summarizing results across software packages (Table 2 in the publication) .\r\n\r\n<u>Patient Dataset results<\/u>: This contains the original feature values for each software package for each patient dataset (1 lesion per case) as well as the table summarizing results across software packages and patient datasets (Table 3 in the publication).\r\n\r\n<u> Harmonized GLCM Entropy Results <\/u>: This contains the values for the \u201cHarmonized\u201d GLCM Entropy feature for each patient dataset and each software package as well as the summary across software packages (Table 4 in the publication).","collection_downloads":[46077,46079],"result_featured_image":{"ID":"8973","post_author":"29","post_date":"2023-09-14 01:03:08","post_date_gmt":"2023-09-14 06:03:08","post_content":"","post_title":"Screen-Shot-2020-06-19-at-7.51.57-PM","post_excerpt":"","post_status":"inherit","comment_status":"closed","ping_status":"closed","post_password":"","post_name":"screen-shot-2020-06-19-at-7-51-57-pm","to_ping":"","pinged":"","post_modified":"2023-11-20 05:51:10","post_modified_gmt":"2023-11-20 11:51:10","post_content_filtered":"","post_parent":"46081","guid":"https:\/\/stage.cancerimagingarchive.net\/wp-content\/uploads\/Screen-Shot-2020-06-19-at-7.51.57-PM.png","menu_order":"0","post_type":"attachment","post_mime_type":"image\/png","comment_count":"0","pod_item_id":"8973"},"result_acknowledgements":"The authors gratefully acknowledge the following sources of support:\r\n<ul>\r\n \t<li>The National Cancer Institute Quantitative Network (QIN)<\/li>\r\n<\/ul>","hide_from_browse_table":"0","program":["QIN"],"_links":{"self":[{"href":"https:\/\/stage.cancerimagingarchive.net\/api\/v1\/analysis-results\/46081","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/stage.cancerimagingarchive.net\/api\/v1\/analysis-results"}],"about":[{"href":"https:\/\/stage.cancerimagingarchive.net\/api\/wp\/v2\/types\/tcia_analysis_result"}],"version-history":[{"count":1,"href":"https:\/\/stage.cancerimagingarchive.net\/api\/v1\/analysis-results\/46081\/revisions"}],"predecessor-version":[{"id":47237,"href":"https:\/\/stage.cancerimagingarchive.net\/api\/v1\/analysis-results\/46081\/revisions\/47237"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/stage.cancerimagingarchive.net\/api\/wp\/v2\/media\/8973"}],"wp:attachment":[{"href":"https:\/\/stage.cancerimagingarchive.net\/api\/wp\/v2\/media?parent=46081"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}