SNOMED International Release Management

Page tree

Versions Compared

Old Version 1

changes.mady.by.user Andrew Atkinson

Saved on

compared with

New Version Current

changes.mady.by.user Andrew Atkinson

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

March 2023 PRODUCTION (PUBLISHED) to April 2023 PRODUCTION (Version

1

2 POST VERSIONING) traceability

SUMMARY COMPONENT REPORT (RUN BY DEVOPS POST-VERSIONING):  https://docs.google.com/spreadsheets/d/1gExRH5ndhBQ929Jt91Sy3IWuQSsg-rti00Dz4mwbSyM/edit#gid=0

SEP + LATERALIZABLE REFSET REPORT (RUN BY MARIA PRE-VERSIONING):  :  https://docs.google.com/spreadsheets/d/1s6S_tnpC2ZpWoOLxnTfCKOeEQRiAD2moMnumn3xLpBY/edit#gid=2

Differences found in package Comparison

Number of RF2 records impacted

Related JIRA ticket(s)

Rationale

RefsetDescriptor files0

0 records added/updated as expected

Association Reference files
1600
1470
1158

1112 records added/updated, plus

442

358 records inactivated

...as expected as the totals ALMOST match exactly with Summary Component Stats report, but

this report was run BEFORE we manually added in the 15 new records as part of the fixes in ISRS-1271 (spot checked these manually and they are present in new Association Snapshot + Full files as planned), so this brings us much closer to the figures in Comparison Diff files.

you also need to incorporate SEP changes:

In order to get an accurate comparison, we have to ALSO INCLUDE the SEP refset (734138000 + 734139008) totals from the RF2 files (manually tallied from the new Association Snapshot files) and add them to the "Hist Assoc" tab in the Summary Component Report:

SEP (from RF2 diff files) = 36 changes:

23
  • 0 inactivations (734138000) + 0 inactivations (734139008)
8
  • 6 new/updated records (734138000) + 0 new records (734139008)

  • Confirmed as matches exactly with data in Lateralizable Report sent to me by Maria (in Section 1 of Content Handover page) - see

Report link

  • report above

)

    • Report shows

31

    • 6 changes -

23

    • 6 new records +

8

    • 0 inactivations + 0 updates

This then, adds to the "Association" totals in the final refsets tab, in the Summary report stats:

434
  • 357 inactivations +
1137
  • 1107 new/updated records

Makes a total of:

442
  • 357 inactivations +
1160
  • 1113 new/updated records  

Which matches ALMOST exactly with the counts I got above from the RF2 files!!  

Attribute Value files
3064
2403
3000

2308 records added/updated, plus

64

95 inactivated

...as expected as the totals match exactly with Summary Component Stats report

Language refset files
8291
5325
6914


4962 records added/updated,

plus  

plus

1377

363 records inactivated

*NOTE -  NEED TO SEARCH THE LANG REFSET FILES FOR BOTH the following modules in order to get the full totals:

  • 20230228\t1\t900000000000207008
  • 20230228\t1\t900000000000012004

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above -

 

("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

 
  • ("inactivated" counts above match against total of "Inactivated" + "Changed Inactive" columns in report) 
    • ExtendedMap files762

    ExtendedMap files881

    595

    383

    records added/updated, plus

    379

    286 records inactivated

    Which matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at 10:

    50

    20 on

    10 Mar

    :

    • "added/updated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (new) this release     1           
       21         
      • +
      • Total New mapped entries this release   
                                    346        +
      •  594
      • Total Changed mapped entries (modified) this release   
        16
      • 0
    • "inactivated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (retired) this release   
             
      •  1        +
      • Total Retired mapped entries this release   
                               378
      •  285
    Simple Refset files
    37
    6
    28

    6 records added/updated, plus

    9

    0 records inactivated

    • Confirmed as matches exactly with Lateralizable refset (723264001) data in Lateralizable Report sent to me by Maria (in Section 1 of Content Handover page) - see report above

    SimpleMap files868

    859

    838

    records added/updated, plus

    21

    9 records inactivated

    Confirmed as matches with:

    • firstly the number of CTV3 records (900000000000497000) - which in this release is
    827
    • 853 (as per the number of 900000000000497000 records in the SimpleMap diff files, + it's exactly the same number as new concepts this cycle - see "Concepts" tab in the Summary Component Stats report above) PLUS
    • the manual counts of ICD-0 records (446608001) - here
    11
    • 6 new +
    21
    • 9 inactivations, in the SimpleMap diff file, which also matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at
    10:15 on 10 Mar
    • 09:54 on
      • "added/updated" counts from diff report matches to total of WCI report lines:
        • Total Changed mapped entries (new) this release     0            +
        • Total New mapped entries this release   
     11
        •  6
      • "inactivated" counts from diff report matches to total of WCI report lines:
        • Total Changed mapped entries (retired) this release     0        +
        • Total Retired mapped entries this release   
     28

    ***** EXCEPT THIS TIME IT DOESN'T MATCH WITH THE REPORTS!!!  IT'S 7 LESS THAN THE REPORTS, WHICH TALLIES WITH THE ISSUES RICK FOUND WHEN TRYING TO VERIFY THE FIGURES BEFORE FNIALISING THE MAPS!!! 

    CONFIRMED on INFRA-10658... that both WCI + our internal Dev team are confident that the RF2 files are correct. The MARCH 2023 Release can therefore proceed as planned.

    The discrepancy is either between the snowstorm authoring vs browser branches, or between the snowstorm authoring branch vs RF2 files.  Likely as not, the problem happened right at the start of our transition to FRI (Sept 21) when our old process was:

    • Mapping tool passes Delta to Release team, who use this as a direct input to the RF2 files - the SRS therefore did the original reconciliations of map changes
    • RF2 files are then uploaded to snowstorm post-publication by devops.

    So it's likely that this last step was accidentally missed, resulting in the original active map records being in the RF2 files but NOT in the snowstorm authoring branch.  Then, when they were inactivated in this cycle, the snowstorm branch had no visibility of the original active records, and therefore the inactivations couldn't happen.  This is because the new process is:

    • Mapping tool passes Delta to Content team, who use this to provision snowstorm branches containing the map changes
    • RF2 files are then built using these branches as their source (instead of the direct map delta's)

    Therefore snowstorm can't inactivate records that aren't active (or even existing) in the branch, and the SRS can't inactivate the active records it DOES have as it's no longer doing the reconciliation, instead it's relying on snowstorm to pass it delta records for the inactivations.

    This will be proven, and full reconciliations run between all systems to identify the gaps, change any code required, and apply content fixes for al gaps identified...

    INFRA-10658 - final agreed plan is to wait until the ICDO release is published, and then the dev ops team will import the Snapshot into the authoring platform, and that should get everything up to date.  Therefore no changes required for this March International release.

        •  9

    So this also tallies with the issue raised in the last release cycle in INFRA-10658 whereby 7 records were still not inactivated when they should have been -

    Asked Rick in INFRA-10766 to confirm that the conceptID's all match with the fixed records to confirm this fix has worked as expected...CONFIRMED


    ModuleDependency files

    3


    3 records updated, as expected for April 2023 effectiveTimes

    Readme file

    April 2023 dates updated, as expected

    Concept files1354

    1047 records added/updated, plus

    307 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    Description files2691

    2505 records added/updated, plus

    186 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

    NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

    Relationship files11186

    7189 records added/updated, plus

    3997 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

    Relationship Concrete Values files59

    53 records added/updated, plus

    6 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

    OwlExpression (Axiom) files2349

    2038 records added/updated, plus

    311 records inactivated

    Confirmed

    ModuleDependency files

    3

    3 records updated, as expected for March 2023 effectiveTimes

    Readme file

    March 2023 dates updated + Beta "x" prefixes removed, as expected

    Concept files1488

    1063 records added/updated, plus

    425 records inactivated

    Confirmed

    as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    *NOTE -  NEED TO SEARCH THE LANG REFSET FILES FOR BOTH the following modules in order to get the full totals:

    • 20230228\t1\t900000000000207008
    • 20230228\t1\t900000000000012004
    Stated Relationship files0

    0 records updated, plus

    0 records inactivated

    As expected due to full migration to OWLExpression file in the July 2019 International Edition

    TextDefinition files6

    56

    Description files38543220

    records added/updated, plus

    634

    4 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above -

    ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

  • ("inactivated" counts above match against total of "Inactivated" + "Changed Inactive" columns in report) 

    • NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

    *NOTE -  NEED TO SEARCH THE LANG REFSET FILES FOR BOTH the following modules in order to get the full totals:

    MRCM AttributeDomain files0

    0 records added/updated as expected

    MRCM AttributeRange files0


    0 records added/updated as expected

    MRCM Domain files0


    0 records added/updated as expected

    MRCM ModuleScope files0

    0 records added/updated as expected


    March 2023 PRODUCTION (PUBLISHED) to April 2023 PRODUCTION (Version 1 POST VERSIONING) traceability

    SUMMARY COMPONENT REPORT (RUN BY DEVOPS POST-VERSIONING):  https://docs.google.com/spreadsheets/d/1gExRH5ndhBQ929Jt91Sy3IWuQSsg-rti00Dz4mwbSyM/edit#gid=0

    SEP + LATERALIZABLE REFSET REPORT (RUN BY MARIA PRE-VERSIONING):  https://docs.google.com/spreadsheets/d/1s6S_tnpC2ZpWoOLxnTfCKOeEQRiAD2moMnumn3xLpBY/edit#gid=2

    Differences found in package Comparison

    Number of RF2 records impacted

    Related JIRA ticket(s)

    Rationale

    RefsetDescriptor files0

    0 records added/updated as expected

    Association Reference files1470

    1112

    • 20230228\t1\t900000000000207008
    • 20230228\t1\t900000000000012004
    Relationship files15159

    8959 records added/updated, plus

    6200 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

    *NOTE -  NEED TO SEARCH THE LANG REFSET FILES FOR BOTH the following modules in order to get the full totals:

    • 20230228\t1\t900000000000207008
    • 20230228\t1\t900000000000012004
    Relationship Concrete Values files147

    121 records added/updated, plus

    26 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

    OwlExpression (Axiom) files29122486

    records added/updated, plus

    426

    358 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    *NOTE -  NEED TO SEARCH THE LANG REFSET FILES FOR BOTH the following modules in order to get the full totals:

    • 20230228\t1\t900000000000207008
    • 20230228\t1\t900000000000012004
    Stated Relationship files0

    0 records updated, plus

    0 records inactivated, plus

    9000000000004970000 records added

    As expected due to full migration to OWLExpression file in the July 2019 International Edition

    TextDefinition files181

    54 records added/updated, plus

    127 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

    NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

    MRCM AttributeDomain files0

    0 records added/updated as expected

    MRCM AttributeRange files0

    0 records added/updated as expected

    MRCM Domain files0

    0 records added/updated as expected

    MRCM ModuleScope files0

    0 records added/updated as expected

    March 2023 PRODUCTION (PUBLISHED) to April 2023 PRODUCTION (Version 1 PRE VERSIONING) traceability

    SUMMARY COMPONENT REPORT (RUN BY MARIA PRE-VERSIONING): 

    SEP + LATERALIZABLE REFSET REPORT (RUN BY MARIA PRE-VERSIONING):  

    ...as expected as the totals ALMOST match exactly with Summary Component Stats report, but you also need to incorporate SEP changes:

    In order to get an accurate comparison, we have to ALSO INCLUDE the SEP refset (734138000 + 734139008) totals from the RF2 files (manually tallied from the new Association Snapshot files) and add them to the "Hist Assoc" tab in the Summary Component Report:

    SEP (from RF2 diff files) = 36 changes:

    • 0 inactivations (734138000) + 0 inactivations (734139008)
    • 6 new/updated records (734138000) + 0 new records (734139008)

    • Confirmed as matches exactly with data in Lateralizable Report sent to me by Maria (in Section 1 of Content Handover page) - see report above

      • Report shows 6 changes - 6 new records + 0 inactivations + 0 updates

    This then, adds to the "Association" totals in the final refsets tab, in the Summary report stats:

    • 357 inactivations +
    • 1007 new/updated records

    Makes a total of:

    • 357 inactivations +
    • 1113 new/updated records  

    Which matches ALMOST exactly with the counts I got above from the RF2 files!!  

    Attribute Value files2403

    2308 records added/updated, plus

    95 inactivated

    ...as expected as the totals match exactly with Summary Component Stats report

    Language refset files5325


    4962 records added/updated, plus

    363 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    ExtendedMap files881

    595 records added/updated, plus

    286 records inactivated

    Which matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at 10:20 on :

    • "added/updated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (new) this release     1            +
      • Total New mapped entries this release     594
      • Total Changed mapped entries (modified) this release    0
    • "inactivated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (retired) this release     1        +
      • Total Retired mapped entries this release     285
    Simple Refset files6

    6 records added/updated, plus

    0 records inactivated

    • Confirmed as matches exactly with Lateralizable refset (723264001) data in Lateralizable Report sent to me by Maria (in Section 1 of Content Handover page) - see report above

    SimpleMap files868

    859 records added/updated, plus

    9 records inactivated

    Confirmed as matches with:

    • firstly the number of CTV3 records (900000000000497000) - which in this release is 853 (as per the number of 900000000000497000 records in the SimpleMap diff files, + it's exactly the same number as new concepts this cycle - see "Concepts" tab in the Summary Component Stats report above) PLUS
    • the manual counts of ICD-0 records (446608001) - here 6 new + 9 inactivations, in the SimpleMap diff file, which also matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at 09:54 on
      • "added/updated" counts from diff report matches to total of WCI report lines:
        • Total Changed mapped entries (new) this release     0            +
        • Total New mapped entries this release     6
      • "inactivated" counts from diff report matches to total of WCI report lines:
        • Total Changed mapped entries (retired) this release     0        +
        • Total Retired mapped entries this release     9

    So this also tallies with the issue raised in the last release cycle in INFRA-10658 whereby 7 records were still not inactivated when they should have been -

    Asked Rick in INFRA-10766 to confirm that the conceptID's all match with the fixed records to confirm this fix has worked as expected...CONFIRMED


    ModuleDependency files

    3


    3 records updated, as expected for April 2023 effectiveTimes

    Readme file

    April 2023 dates updated, as expected

    Concept files1354

    1047 records added/updated, plus

    307 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    Description files2691

    2505 records added/updated, plus

    186

    Differences found in package Comparison

    Number of RF2 records impacted

    Related JIRA ticket(s)

    Rationale

    RefsetDescriptor files0

    0 records added/updated as expected

    Association Reference files1600

    1158 records added/updated, plus

    442 records inactivated

    ...as expected as the totals ALMOST match exactly with Summary Component Stats report, but you also need to incorporate SEP changes:

    In order to get an accurate comparison, we have to ALSO INCLUDE the SEP refset (734138000 + 734139008) totals from the RF2 files (manually tallied from the new Association Snapshot files) and add them to the "Hist Assoc" tab in the Summary Component Report:

    SEP (from RF2 diff files) = 36 changes:

    • 8 inactivations (734138000) + 0 inactivations (734139008)
    • 23 new/updated records (734138000) + 0 new records (734139008)

    • Confirmed as matches exactly with data in Lateralizable Report sent to me by Maria (in Section 1 of Content Handover page) - see report above

      • Report shows 31 changes - 23 new records + 8 inactivations + 0 updates

    This then, adds to the "Association" totals in the final refsets tab, in the Summary report stats:

    • 434 inactivations +
    • 1137 new/updated records

    Makes a total of:

    • 442 inactivations +
    • 1160 new/updated records  

    Which matches exactly with the counts I got above from the RF2 files!!  

    Attribute Value files3000

    3000 records added/updated, plus

    64 inactivated

    ...as expected as the totals match exactly with Summary Component Stats report

    Language refset files8291

    6914 records added/updated, plus

    1377

    records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    ExtendedMap files762

    383 records added/updated, plus

    379 records inactivated

    Which matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at 10:50 on :

    • "added/updated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (new) this release     21            +
      • Total New mapped entries this release     346
      • Total Changed mapped entries (modified) this release    16
    • "inactivated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (retired) this release     1        +
      • Total Retired mapped entries this release     378

    ***** EXCEPT THIS TIME IT DOESN'T MATCH WITH THE REPORTS!!!  

    This was proven to be because the "Total Changed mapped entries (modified) this release" field in the report was populated (with  16) for the first time since it was first added to these reports.  This is to catch a rare situation where the mapping team updates the Map Advice, but does NOT change the Map Source or Target.  Therefore this value needs to be included in my total counts every release cycle, otherwise we run the risk of not reconciling.  Adding it now to the totals to add up from the report.

    Simple Refset files37

    28 records added/updated, plus

    9 records inactivated

    • Confirmed as matches exactly with Lateralizable refset (723264001) data in Lateralizable Report sent to me by Maria (in Section 1 of Content Handover page) - see report above

    SimpleMap files859

    838 records added/updated, plus

    21 records inactivated

    Confirmed as matches with:

  • firstly the number of CTV3 records (900000000000497000) - which in this release is 827 (as per the number of 900000000000497000 records in the SimpleMap diff files, + it's exactly the same number as new concepts this cycle - see "Concepts" tab in the Summary Component Stats report above) PLUS
    • the manual counts of ICD-0 records (446608001) - here 11 new + 21 inactivations, in the SimpleMap diff file, which also matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at 10:15 on
    • "added/updated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (new) this release     0            +
      • Total New mapped entries this release     11
    • "inactivated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (retired) this release     0        +
      • Total Retired mapped entries this release     28

     

    NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

    Relationship files11186

    7189 records added/updated, plus

    3997 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

    Relationship Concrete Values files59

    53 records added/updated, plus

    6 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

    OwlExpression (Axiom) files2349

    XXXXXX2037 records added/updated - CONFIRMED THIS IS AN ISSUE WITH THE NEW VERSION OF THE APPLE DIFF TOOL (in Mac OS Ventura v13.3.1) - RE-RAN COMPARISON FROM SEVERAL MACHINES STILL ON MONTEREY AND EVERYTHING WORKED AS EXPECTED in VERSION 2:

    2038 records added/updated, plus

    311 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    Stated Relationship files0

    0 records updated, plus

    0 records inactivated

    As expected due to full migration to OWLExpression file in the July 2019 International Edition

    TextDefinition files6

    XXXXXXX3 records added/updated - CONFIRMED THIS IS AN ISSUE WITH THE NEW VERSION OF THE APPLE DIFF TOOL (in Mac OS Ventura v13.3.1) - RE-RAN COMPARISON FROM SEVERAL MACHINES STILL ON MONTEREY AND EVERYTHING WORKED AS EXPECTED in VERSION 2:

    56 records added/updated, plus

    4 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

    NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

    MRCM AttributeDomain files0

    0 records added/updated as expected

    MRCM AttributeRange files0


    0 records added/updated as expected

    MRCM Domain files0


    0 records added/updated as expected

    MRCM ModuleScope files0

    0 records added/updated as expected


    March 2023 PRODUCTION (PUBLISHED) to April 2023 PRODUCTION (Version 1 PRE VERSIONING) traceability

    SUMMARY COMPONENT REPORT (RUN BY MARIA PRE-VERSIONING):  https://docs.google.com/spreadsheets/d/1OfYhGgisopqAGo3WzCvntMUgs6vZ0Bwxl6oeEqJmDtw/edit#gid=0

    SEP + LATERALIZABLE REFSET REPORT (RUN BY MARIA PRE-VERSIONING):  https://docs.google.com/spreadsheets/d/1s6S_tnpC2ZpWoOLxnTfCKOeEQRiAD2moMnumn3xLpBY/edit#gid=2

    Differences found in package Comparison

    Number of RF2 records impacted

    Related JIRA ticket(s)

    Rationale

    RefsetDescriptor files0

    0 records added/updated as expected

    Association Reference files1470

    1112 records added/updated, plus

    358 records inactivated

    ...as expected as the totals ALMOST match exactly with Summary Component Stats report, but you also need to incorporate SEP changes:

    In order to get an accurate comparison, we have to ALSO INCLUDE the SEP refset (734138000 + 734139008) totals from the RF2 files (manually tallied from the new Association Snapshot files) and add them to the "Hist Assoc" tab in the Summary Component Report:

    SEP (from RF2 diff files) = 36 changes:

    • 0 inactivations (734138000) + 0 inactivations (734139008)
    • 6 new/updated records (734138000) + 0 new records (734139008)

    • Confirmed as matches exactly with data in Lateralizable Report sent to me by Maria (in Section 1 of Content Handover page) - see report above

      • Report shows 6 changes - 6 new records + 0 inactivations + 0 updates

    This then, adds to the "Association" totals in the final refsets tab, in the Summary report stats:

    • 357 inactivations +
    • 1007 new/updated records

    Makes a total of:

    • 357 inactivations +
    • 1113 new/updated records  

    Which matches ALMOST exactly with the counts I got above from the RF2 files!!  

    Attribute Value files2403

    2308 records added/updated, plus

    95 inactivated

    ...as expected as the totals match exactly with Summary Component Stats report

    Language refset files5325


    4962 records added/updated, plus

    363 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    ExtendedMap files881

    595 records added/updated, plus

    286 records inactivated

    Which matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at 10:20 on :

    • "added/updated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (new) this release     1            +
      • Total New mapped entries this release     594
      • Total Changed mapped entries (modified) this release    0
    • "inactivated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (retired) this release     1        +
      • Total Retired mapped entries this release     285
    Simple Refset files6

    6 records added/updated, plus

    0 records inactivated

    • Confirmed as matches exactly with Lateralizable refset (723264001) data in Lateralizable Report sent to me by Maria (in Section 1 of Content Handover page) - see report above

    SimpleMap files868

    859 records added/updated, plus

    9 records inactivated

    Confirmed as matches with:

    • firstly the number of CTV3 records (900000000000497000) - which in this release is 853 (as per the number of 900000000000497000 records in the SimpleMap diff files, + it's exactly the same number as new concepts this cycle - see "Concepts" tab in the Summary Component Stats report above) PLUS
    • the manual counts of ICD-0 records (446608001) - here 6 new + 9 inactivations, in the SimpleMap diff file, which also matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at 09:54 on
      • "added/updated" counts from diff report matches to total of WCI report lines:
        • Total Changed mapped entries (new) this release     0            +
        • Total New mapped entries this release     6
      • "inactivated" counts from diff report matches to total of WCI report lines:
        • Total Changed mapped entries (retired) this release     0        +
        • Total Retired mapped entries this release     9

    So this also tallies with the issue raised in the last release cycle in INFRA-10658 whereby 7 records were still not inactivated when they should have been -

    Asked Rick in INFRA-10766 to confirm that the conceptID's all match with the fixed records to confirm this fix has worked as expected...CONFIRMED

    ***** EXCEPT THIS TIME IT DOESN'T MATCH WITH THE REPORTS!!!  IT'S 7 LESS THAN THE REPORTS, WHICH TALLIES WITH THE ISSUES RICK FOUND WHEN TRYING TO VERIFY THE FIGURES BEFORE FNIALISING THE MAPS!!!  INVESTIGATING on INFRA-10658...


    ModuleDependency files

    3


    3 records updated, as expected for

    March

    April 2023 effectiveTimes

    Readme file
    March


    April 2023 dates updated + Beta "x" prefixes added, as expected

    Concept files
    1488
    1354
    1063

    1047 records added/updated, plus

    425

    307 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    Description files
    3854
    2691
    3220

    2505 records added/updated, plus

    634

    186 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

    NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

    Relationship files
    15159
    11186
    8959

    7189 records added/updated, plus

    6200

    3997 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

    Relationship Concrete Values files
    147
    59
    121

    53 records added/updated, plus

    26

    6 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

    OwlExpression (Axiom) files
    2912
    2349
    2486

    2038 records added/updated, plus

    426

    311 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    Stated Relationship files0

    0 records updated, plus

    0 records inactivated

    , plus9000000000004970000 records added

    As expected due to full migration to OWLExpression file in the July 2019 International Edition

    TextDefinition files
    181
    60
    54

    56 records added/updated, plus

    127

    4 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

    NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

    MRCM AttributeDomain files0

    0 records added/updated as expected

    MRCM AttributeRange files0


    0 records added/updated as expected

    MRCM Domain files0


    0 records added/updated as expected

    MRCM ModuleScope files0

    0 records added/updated as expected