Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

February 2023 PRODUCTION (PUBLISHED) to March 2023 PRODUCTION (Version 1 POST VERSIONING) traceability

SUMMARY COMPONENT REPORT (RUN BY DEVOPS POST-VERSIONING):  

Differences found in package Comparison

Number of RF2 records impacted

Related JIRA ticket(s)

Rationale

RefsetDescriptor files0

0 records added/updated as expected

Association Reference files
1187
1600
908

1158 records added/updated, plus

279

442 records inactivated

...as expected as the totals ALMOST match exactly with Summary Component Stats report, but this report was run BEFORE we manually added in the 15 new records as part of the fixes in ISRS-1271 (spot checked these manually and they are present in new Association Snapshot + Full files as planned), so this brings us much closer to the figures in Comparison Diff files.


In order to get an accurate comparison, we have to ALSO INCLUDE the SEP refset (734138000 + 734139008) totals from the RF2 files (manually tallied from the new Association Snapshot files) and add them to the "Hist Assoc" tab in the Summary Component Report:

SEP (from RF2 diff files) = 36 changes:

This then, adds to the "Association" totals in the final refsets tab, in the Summary report stats:

  • 258 inactivations +
  • 868 new/updated records

Makes a total of:

  • 279 inactivations +
  • 908 new/updated records  

Which matches exactly with the counts I got above from the RF2 files!!  

Attribute Value files
2027
3064
1993

3000 records added/updated, plus

34

64 inactivated

...as expected as the totals match exactly with Summary Component Stats report

Language refset files
9703
8291
8589


6914 records added/updated, plus  

1114

1377 records inactivated

*NOTE -  NEED TO SEARCH THE LANG REFSET FILES FOR BOTH the following modules in order to get the full totals:

  • 20230228\t1\t900000000000207008
  • 20230228\t1\t900000000000012004

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

ExtendedMap files
1964
762
1211

383 records added/updated, plus

753

379 records inactivated

Which matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at 13:37 on  :

  • "added/updated" counts from diff report matches to total of WCI report lines:
    • Total Changed mapped entries (new) this release     571            +
    • Total New mapped entries this release     640
  • "inactivated" counts from diff report matches to total of WCI report lines:
    • Total Changed mapped entries (retired) this release     571        +
    • Total Retired mapped entries this release     182
Simple Refset files
86
37
47

28 records added/updated, plus

39

9 records inactivated

SimpleMap files
1146
859
1144

838 records added/updated, plus

2

21 records inactivated

Confirmed as matches with:

  • firstly the number of CTV3 records (900000000000497000) - which in this release is 1141 (as per the number of 900000000000497000 records in the SimpleMap diff files, + it's exactly the same number as new concepts this cycle - see "Concepts" tab in the Summary Component Stats report above) PLUS
  • the manual counts of ICD-0 records (446608001) - here 3 new + 2 inactivations, in the SimpleMap diff file, which also matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at 13:05 on
    • "added/updated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (new) this release     1            +
      • Total New mapped entries this release     2
    • "inactivated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (retired) this release     0        +
      • Total Retired mapped entries this release     2
ModuleDependency files

3


3 records updated, as expected for

February

March 2023 effectiveTimes

Readme file
February


March 2023 dates updated + Beta "x" prefixes removed, as expected

Concept files
1838
1488
1565

1063 records added/updated, plus

273

425 records inactivated

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

*NOTE -  NEED TO SEARCH THE LANG REFSET FILES FOR BOTH the following modules in order to get the full totals:

  • 20230228\t1\t900000000000207008
  • 20230228\t1\t900000000000012004
Description files
4506
3854
3951

3220 records added/updated, plus

555

634 records inactivated

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

*NOTE -  NEED TO SEARCH THE LANG REFSET FILES FOR BOTH the following modules in order to get the full totals:

  • 20230228\t1\t900000000000207008
  • 20230228\t1\t900000000000012004
Relationship files
19202
15159
11304

8959 records added/updated, plus

7898

6200 records inactivated

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

*NOTE -  NEED TO SEARCH THE LANG REFSET FILES FOR BOTH the following modules in order to get the full totals:

  • 20230228\t1\t900000000000207008
  • 20230228\t1\t900000000000012004
Relationship Concrete Values files
180
147
165

121 records added/updated, plus

15

26 records inactivated

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

OwlExpression (Axiom) files
4053
2912
3778

2486 records added/updated, plus

275

426 records inactivated

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

*NOTE -  NEED TO SEARCH THE LANG REFSET FILES FOR BOTH the following modules in order to get the full totals:

  • 20230228\t1\t900000000000207008
  • 20230228\t1\t900000000000012004
Stated Relationship files0

0 records updated, plus

0 records inactivated, plus

9000000000004970000 records added

As expected due to full migration to OWLExpression file in the July 2019 International Edition

TextDefinition files
89
181
82

54 records added/updated, plus

7

127 records inactivated

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

MRCM AttributeDomain files0

0 records added/updated as expected

MRCM AttributeRange files
1
0
1


0 records added/updated as expected

< e25ae83a-4da4-4c87-b254-f5399dd9b088    20180131    1    900000000000012004    723562003    719722006    << 719982003 |Process (qualifier value)|    (<< 363787002 |Observable entity (observable entity)| OR << 404684003 |Clinical finding (finding)|): [0..*] { [0..1] 719722006 |Has realization| = << 719982003 |Process (qualifier value)| }    723597001    723596005
---
> e25ae83a-4da4-4c87-b254-f5399dd9b088    20230228    1    900000000000012004    723562003    719722006    << 272379006 |Event (event)| OR << 404684003 |Clinical finding (finding)| OR << 71388002 |Procedure (procedure)| OR << 719982003 |Process (qualifier value)|    (<< 363787002 |Observable entity (observable entity)| OR << 404684003 |Clinical finding (finding)|): [0..*] { [0..1] 719722006 |Has realization| = (<< 272379006 |Event (event)| OR << 404684003 |Clinical finding (finding)| OR << 71388002 |Procedure (procedure)| OR << 719982003 |Process (qualifier value)|) }    723597001    723596005

As confirmed by Maria + Yong due to MRCM changes intentionally made by Yong this cycle...

*NOTE -  NEED TO SEARCH THE LANG REFSET FILES FOR BOTH the following modules in order to get the full totals:

  • 20230228\t1\t900000000000207008
  • 20230228\t1\t900000000000012004

MRCM Domain files0


0 records added/updated as expected

MRCM Domain files1

1 records added/updated as expected

As confirmed by Maria + Yong due to MRCM changes intentionally made by Yong this cycle...

*NOTE -  NEED TO SEARCH THE LANG REFSET FILES FOR BOTH the following modules in order to get the full totals:

  • 20230228\t1\t900000000000207008
  • 20230228\t1\t900000000000012004

    MRCM ModuleScope files0

    0 records added/updated as expected


    February 2023 PRODUCTION (PUBLISHED) to March 2023 PRODUCTION (Version 1 PRE VERSIONING) traceability

    SUMMARY COMPONENT REPORT (RUN BY MARIA PRE-VERSIONING): https://docs.google.com/spreadsheets/d/1A2EAHWQbZBUHiXQKddiaeSzL-kJbwQohwFdLLruK0RI/edit#gid=0

    SEP + LATERALIZABLE REFSET REPORT (RUN BY MARIA PRE-VERSIONING):  https://docs.google.com/spreadsheets/d/1DZRz82bS9ZFw_IvdUm9Q-SUdAHARYonPD3uWq5UCfl0/edit#gid=0

    Differences found in package Comparison

    Number of RF2 records impacted

    Related JIRA ticket(s)

    Rationale

    RefsetDescriptor files0

    0 records added/updated as expected

    Association Reference files1600

    1158 records added/updated, plus

    442 records inactivated

    ...as expected as the totals ALMOST match exactly with Summary Component Stats report, but you also need to incorporate SEP changes:

    In order to get an accurate comparison, we have to ALSO INCLUDE the SEP refset (734138000 + 734139008) totals from the RF2 files (manually tallied from the new Association Snapshot files) and add them to the "Hist Assoc" tab in the Summary Component Report:

    SEP (from RF2 diff files) = 36 changes:

    • 8 inactivations (734138000) + 0 inactivations (734139008)
    • 23 new/updated records (734138000) + 0 new records (734139008)
    • Confirmed as matches exactly with data in Lateralizable Report sent to me by Maria (in Section 1 of Content Handover page) - see report above

      • Report shows 31 changes - 23 new records + 8 inactivations + 0 updates

    This then, adds to the "Association" totals in the final refsets tab, in the Summary report stats:

    • 434 inactivations +
    • 1137 new/updated records

    Makes a total of:

    • 442 inactivations +
    • 1160 new/updated records  

    Which matches exactly with the counts I got above from the RF2 files!!  

    Attribute Value files3000

    3000 records added/updated, plus

    64 inactivated

    ...as expected as the totals match exactly with Summary Component Stats report

    Language refset files8291


    6914 records added/updated, plus

    1377 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    ExtendedMap files762

    383 records added/updated, plus

    379 records inactivated

    Which matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at 10:50 on :

    • "added/updated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (new) this release     21            +
      • Total New mapped entries this release     346
      • Total Changed mapped entries (modified) this release    16
    • "inactivated" counts from diff report matches to total of WCI report lines:
      • Total Changed mapped entries (retired) this release     1        +
      • Total Retired mapped entries this release     378

    ***** EXCEPT THIS TIME IT DOESN'T MATCH WITH THE REPORTS!!!  

    This was proven to be because the "Total Changed mapped entries (modified) this release" field in the report was populated (with  16) for the first time since it was first added to these reports.  This is to catch a rare situation where the mapping team updates the Map Advice, but does NOT change the Map Source or Target.  Therefore this value needs to be included in my total counts every release cycle, otherwise we run the risk of not reconciling.  Adding it now to the totals to add up from the report.

    Simple Refset files37

    28 records added/updated, plus

    9 records inactivated

    • Confirmed as matches exactly with Lateralizable refset (723264001) data in Lateralizable Report sent to me by Maria (in Section 1 of Content Handover page) - see report above

    SimpleMap files859

    838 records added/updated, pl

    21 records inactivated

    Confirmed as matches with:

    • firstly the number of CTV3 records (900000000000497000) - which in this release is 827 (as per the number of 900000000000497000 records in the SimpleMap diff files, + it's exactly the same number as new concepts this cycle - see "Concepts" tab in the Summary Component Stats report above) PLUS
    • the manual counts of ICD-0 records (446608001) - here 11 new + 21 inactivations, in the SimpleMap diff file, which also matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at 10:15 on
      • "added/updated" counts from diff report matches to total of WCI report lines:
        • Total Changed mapped entries (new) this release     0            +
        • Total New mapped entries this release     11
      • "inactivated" counts from diff report matches to total of WCI report lines:
        • Total Changed mapped entries (retired) this release     0        +
        • Total Retired mapped entries this release     28

    ***** EXCEPT THIS TIME IT DOESN'T MATCH WITH THE REPORTS!!!  IT'S 7 LESS THAN THE REPORTS, WHICH TALLIES WITH THE ISSUES RICK FOUND WHEN TRYING TO VERIFY THE FIGURES BEFORE FNIALISING THE MAPS!!!  INVESTIGATING on INFRA-10658...

    ModuleDependency files

    3


    3 records updated, as expected for March 2023 effectiveTimes

    Readme file

    March 2023 dates updated + Beta "x" prefixes added, as expected

    Concept files1488

    1063 records added/updated, plus

    425 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    Description files3854

    3220 records added/updated, plus

    634 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

    NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

    Relationship files15159

    8959 records added/updated, plus

    6200 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

    Relationship Concrete Values files147

    121 records added/updated, plus

    26 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

    OwlExpression (Axiom) files2912

    2486 records added/updated, plus

    426 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

    Stated Relationship files0

    0 records updated, plus

    0 records inactivated, plus

    9000000000004970000 records added

    As expected due to full migration to OWLExpression file in the July 2019 International Edition

    TextDefinition files181

    54 records added/updated, plus

    127 records inactivated

    Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

    NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

    MRCM AttributeDomain files0

    0 records added/updated as expected

    MRCM AttributeRange files0


    0 records added/updated as expected

    MRCM Domain files0


    0 records added/updated as expected

    MRCM ModuleScope files0

    0 records added/updated as expected