SNOMED International Release Management

Page tree

Versions Compared

Old Version 4

changes.mady.by.user Andrew Atkinson

Saved on

compared with

New Version Current

changes.mady.by.user Andrew Atkinson

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
September

November 2023 PRODUCTION (

PUBLISHED

Version 1 POST VERSIONING) to

October

November 2023 PRODUCTION (Version 2 POST VERSIONING) traceability

SUMMARY COMPONENT REPORT (RUN BY DEVOPS POST-VERSIONING):    https://docs.google.com/spreadsheets/d/1uellN8gy6AJhc1S0aItqrjz8Cn2bIyKfhDbHCQlQjuc/edit#gid=0

SEP + LATERALIZABLE REFSET REPORT (RUN BY MARIA PRE-VERSIONING):   https://docs.google.com/spreadsheets/d/1t2thATnI6JWDQnrM7gFjJunHS-sP00mgpY1qcMjsTM0/edit#gid=0

Differences found in package Comparison

Number of RF2 records impacted

Related JIRA ticket(s)

Rationale

RefsetDescriptor files0

0 records added/updated as expected

Association Reference files621

402 records added/updated, plus

219 records inactivated

...as expected as the totals ALMOST match exactly with Summary Component Stats report, but you also need to incorporate SEP changes:

In order to get an accurate comparison, we have to ALSO INCLUDE the SEP refset (734138000 + 734139008) totals from the RF2 files (manually tallied from the new Association Snapshot files) and add them to the "Hist Assoc" tab in the Summary Component Report:

SEP (from RF2 diff files) = 10 changes:

  • 0 inactivations (734139008) + 0 inactivations (734139008)
  • 4 new/updated records (734138000) + 4 new records (734138000)

  • Confirmed as matches exactly with data in Lateralizable Report sent to me by Maria (in Section 1 of Content Handover page) - see report above

    • Report shows 8 changes - 4 new records + 4 inactivations + 0 updates

This then, adds to the "Association" totals in the final refsets tab, in the Summary report stats:

  • 202 new/updated records +
  • 44 inactivations 

Makes a total of:

  • 206 new/updated records +
  • 48 inactivations 

Which matches exactly with the counts I got above from the RF2 files!!  

Attribute Value files3968

3929 records added/updated, plus

39 inactivated

...as expected as the totals match exactly with Summary Component Stats report

Language refset files15247

10143 records added/updated, plus

5104 records inactivated

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

ExtendedMap files855

591 records added/updated, plus

264 records inactivated

Which matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at 10:06 on :

  • "added/updated" counts from diff report matches to total of WCI report lines:
    • Total Changed mapped entries (new) this release     1            +
    • Total New mapped entries this release     375
    • Total Changed mapped entries (modified) this release    0
  • "inactivated" counts from diff report matches to total of WCI report lines:
    • Total Changed mapped entries (retired) this release     0        +
    • Total Retired mapped entries this release     45
Simple Refset files6

2 records added/updated, plus

4 records inactivated

  • Confirmed as matches exactly with Lateralizable refset (723264001) data in Lateralizable Report sent to me by Maria (in Section 1 of Content Handover page) - see report above

SimpleMap files628

857 records added/updated, plus

0 records inactivated

Confirmed as matches with:

  • firstly the number of CTV3 records (900000000000497000) - which in this release is 625 (as per the number of 900000000000497000 records in the SimpleMap diff files, + it's exactly the same number as new concepts this cycle - see "Concepts" tab in the Summary Component Stats report above) PLUS
    • the manual counts of ICD-0 records (446608001) - here 3 new + 0 inactivations, in the SimpleMap diff file, which also matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at 09:39 on
    • "added/updated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (new) this release     1            +
      • Total New mapped entries this release     2
    • "inactivated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (retired) this release     0        +
      • Total Retired mapped entries this release     0
    ModuleDependency files

    3

    3 records updated, as expected for July 2023 effectiveTimes

    Readme file

    July 2023 dates updated + Beta "x" prefixes added, as expected

    Concept files822

    723 records added/updated, plus

    99 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    Description files2315

    1969 records added/updated, plus

    346 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

    NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

    Relationship files7225

    5151 records added/updated, plus

    2074 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

    Relationship Concrete Values files96

    79 records added/updated, plus

    17 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

    OwlExpression (Axiom) files1217

    1118 records added/updated, plus

    99 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    Stated Relationship files0

    0 records updated, plus

    0 records inactivated

    As expected due to full migration to OWLExpression file in the July 2019 International Edition

    TextDefinition files40

    26 records added/updated, plus

    14 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

    NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

    MRCM AttributeDomain files0

    0 records added/updated as expected

    MRCM AttributeRange files0

    0 records added/updated as expected

    MRCM Domain files0

    0 records added/updated as expected

    MRCM ModuleScope files0

    0 records added/updated as expected

    October 2023 PRODUCTION (Version 1 POST VERSIONING) to October 2023 PRODUCTION (Version 2 POST VERSIONING) traceability

    SUMMARY COMPONENT REPORT (RUN BY DEVOPS POST-VERSIONING):  https://docs.google.com/spreadsheets/d/1uellN8gy6AJhc1S0aItqrjz8Cn2bIyKfhDbHCQlQjuc/edit#gid=0

    SEP + LATERALIZABLE REFSET REPORT (RUN BY MARIA PRE-VERSIONING):   https://docs.google.com/spreadsheets/d/1t2thATnI6JWDQnrM7gFjJunHS-sP00mgpY1qcMjsTM0/edit#gid=0

    Differences found in package Comparison

    Number of RF2 records impacted

    Related JIRA ticket(s)

    Rationale

    MRCM AttributeDomain files2

    INFRA-11609

    1 records added/updated as expected, plus

    1 records inactivated

    • > 0ef2a9f6-5794-11ee-8c99-0242ac120002    20231001    1    900000000000012004    723561005    410675002    1285465008    1    0..*    0..1    723597001    723596005
    • < ad00a6fd-be74-4974-96ab-8049ed543aad    20231001    1    900000000000012004    723561005    410675002    1285465008    1    0..*    0..1    723597001    723596005
      > ad00a6fd-be74-4974-96ab-8049ed543aad    20231001    0    900000000000012004    723561005    410675002    433590000    1    0..*    0..1    723597001    723596005

    Needs Chris/Michael to verify that this is as planned...emailed them for confirmation on 22/9/23....

    Michael confirmed all good via Slack on  

    Chris confirmed all good via Slack on  

    Component Annotation String Value Simple Refset0


    As per the Content team plan (SNOMED CT Annotations) we are introducing 2x new Refset files (and potentially another 2x refsets in future releases) in the November 2023 Release, in order to contain the future Annotations content.

    • > ./der2_Refset_ComponentAnnotationStringValueSimpleRefsetSnapshot_INT_20231101.txt
    • > ./der2_Refset_ComponentAnnotationStringValueSimpleRefsetFull_INT_20231101.txt

    The first content is planned for inclusion in the January 2024 International Edition release, so these files are empty for this Release.

    IT WAS EVENTUALLY DECIDED THAT ANNOTATIONS WOULD BE DELAYED UNTIL DECEMBER 2023 RELEASE, AS MORE DECISIONS WERE REQUIRED FIRST IN MAG/TRAG in October 2023 - therefore need to revert to previous version to Publish in November 2023.

    Member Annotation String Value Simple Refset0


    As per the Content team plan (SNOMED CT Annotations) we are introducing 2x new Refset files (and potentially another 2x refsets in future releases) in the November 2023 Release, in order to contain the future Annotations content.

    • > ./der2_Refset_MemberAnnotationStringValueSimpleRefsetFull_INT_20231101.txt
    • > ./der2_Refset_MemberAnnotationStringValueSimpleRefsetSnapshot_INT_20231101.txt

    The first content is planned for inclusion in the January 2024 International Edition release, so these files are empty for this Release.

    IT WAS EVENTUALLY DECIDED THAT ANNOTATIONS WOULD BE DELAYED UNTIL DECEMBER 2023 RELEASE, AS MORE DECISIONS WERE REQUIRED FIRST IN MAG/TRAG in October 2023 - therefore need to revert to previous version to Publish in November 2023.

    Readme filen/a


    2x new Annotations refsets added as expected:

    • >                     der2_Refset_ComponentAnnotationStringValueSimpleRefsetFull_INT_20231101.txt
    • >                     der2_Refset_ComponentAnnotationStringValueSimpleRefsetSnapshot_INT_20231101.txt
    • >                     der2_Refset_MemberAnnotationStringValueSimpleRefsetFull_INT_20231101.txt
    • >                     der2_Refset_MemberAnnotationStringValueSimpleRefsetSnapshot_INT_20231101.txt
    SimpleMap files438

    438 new records had their UUID's refreshed, as expected as matches exactly the new of brand new SimpleMap records in this Release cycle


    November

    October

    2023 PRODUCTION (Version 2 PRE VERSIONING) to

    October

    November 2023 PRODUCTION (Version 1 POST VERSIONING) traceability

    SUMMARY COMPONENT REPORT (RUN BY DEVOPS POST-VERSIONING):  https://docs.google.com/spreadsheets/d/1uellN8gy6AJhc1S0aItqrjz8Cn2bIyKfhDbHCQlQjuc/edit#gid=0

    SEP + LATERALIZABLE REFSET REPORT (RUN BY MARIA PRE-VERSIONING):   https://docs.google.com/spreadsheets/d/1t2thATnI6JWDQnrM7gFjJunHS-sP00mgpY1qcMjsTM0/edit#gid=01TWmSyuk9cbm2g3J9b9AVa6pw2-WZbrHj6u_FlOI-LC8/edit?usp=sharing

    903903

    Differences found in package Comparison

    Number of RF2 records impacted

    Related JIRA ticket(s)

    Rationale

    Readme file

    Beta "x" prefixes removed + Prod naming conventions applied, as expected

    SimpleMap files438

    438 new records had their UUID's refreshed, as expected as matches exactly the new of brand new SimpleMap records in this Release cycle


    October 2023 PRODUCTION (PUBLISHED) to November 2023 PRODUCTION (Version 2 PRE VERSIONING) traceability

    SUMMARY COMPONENT REPORT (RUN BY MARIA PRE-VERSIONING):  https://docs.google.com/spreadsheets/d/10XE3I9bYMs_kvvh0p0htWxKwngrhy1z-PBxyNI5JZnY/edit?usp=sharing

    SEP + LATERALIZABLE REFSET REPORT (RUN BY MARIA PRE-VERSIONING):  https://docs.google.com/spreadsheets/d/1TWmSyuk9cbm2g3J9b9AVa6pw2-WZbrHj6u_FlOI-LC8/edit?usp=sharing

    112908 Sep  185   508 34  136   165 903 7 new 1 1008 Sep  7  1

    Differences found in package Comparison

    Number of RF2 records impacted

    Related JIRA ticket(s)

    Rationale

    RefsetDescriptor files0

    0 records added/updated as expected

    Association Reference files591

    421 records added/updated, plus

    170 records inactivated

    ...as expected as the totals ALMOST match exactly with Summary Component Stats report, but you also need to incorporate SEP changes:

    In order to get an accurate comparison, we have to ALSO INCLUDE the SEP refset (734138000 + 734139008) totals from the RF2 files (manually tallied from the new Association Snapshot files) and add them to the "Hist Assoc" tab in the Summary Component Report:

    SEP (from RF2 diff files) = 127 changes:

    • Refset: 734138000
    • 33 new/updated records + 5 inactivated records
    • Refset: 734139008
    • 0 new/updated records + 0 inactivated records

    • Confirmed as matches exactly with data in Lateralizable Report sent to me by Maria (in Section 1 of Content Handover page) - see report above

      • Report shows 3 changes - 1 new records + 2 inactivations + 0 updates

    This then, adds to the "Association" totals in the final refsets tab, in the Summary report stats:

    • 388 new/updated records +
    • 165 inactivations 

    Makes a total of:

    • 421 new/updated records +
    • 170 inactivations 

    Which matches exactly with the counts I got above from the RF2 files!!  

    Attribute Value files1339

    1319 records added/updated, plus

    20 inactivated

    ...as expected as the totals match exactly with Summary Component Stats report

    Language refset files4842


    3725 records added/updated, plus

    917 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    ExtendedMap files313

    248 records added/updated, plus

    65 records inactivated

    Which matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at

    14:

    26 on

    :

    • "added/updated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (new) this release   
      •  12          +
      • Total New mapped entries this release   
      •  236
      • Total Changed mapped entries (modified) this release   
      • 0
    • "inactivated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (retired) this release   
      •  9        +
      • Total Retired mapped entries this release   
      •  56
    Simple Refset files129

    30 records added/updated, plus

    99 records inactivated

    • Confirmed as matches exactly with Lateralizable refset (723264001) data in Lateralizable Report sent to me by Maria (in Section 1 of Content Handover page) - see report above

    SimpleMap files479

    477 records added/updated, plus

    2 records inactivated

    Confirmed as matches with:

    • firstly the number of CTV3 records (900000000000497000) - which in this release is
    • 438 (as per the number of 900000000000497000 records in the SimpleMap diff files, + it's exactly the same number as new concepts this cycle - see "Concepts" tab in the Summary Component Stats report above) PLUS
    • the manual counts of ICD-0 records (446608001) - here
    • 39 new +
    • 2 inactivations, in the SimpleMap diff file, which also matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at
    • 13:57 on
      • "added/updated" counts from diff report matches to total of WCI report lines:
        • Total Changed mapped entries (new) this release     0            +
        • Total New mapped entries this release   
        •  39
      • "inactivated" counts from diff report matches to total of WCI report lines:
        • Total Changed mapped entries (retired) this release     0        +
        • Total Retired mapped entries this release   
        •  2
    ModuleDependency files

    3


    3 records updated, as expected for November 2023 effectiveTimes

    Readme file

    November 2023 dates updated + Beta "x" prefixes added, as expected

    Concept files917

    737 records added/updated, plus

    180 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    Description files2228

    1780 records added/updated, plus

    448 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

    NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

    Relationship files12177

    6770 records added/updated, plus

    5407 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

    Relationship Concrete Values files12

    12 records added/updated, plus

    0 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

    OwlExpression (Axiom) files2560

    2378 records added/updated, plus

    182 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    Stated Relationship files0

    0 records updated, plus 0 records inactivated - As expected due to full migration to OWLExpression file in the July 2019 International Edition

    TextDefinition files52

    37 records added/updated, plus

    15 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

    NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

    MRCM AttributeDomain files0

    0 records added/updated as expected

    MRCM AttributeRange files0


    0 records added/updated as expected

    MRCM Domain files0


    0 records added/updated as expected

    MRCM ModuleScope files0

    0 records added/updated as expected