Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

SUMMARY COMPONENT REPORT:  https://docs.google.com/spreadsheets/d/1j_cizcP5-uqvhpuUFL79I3PpYzY-6T-_NOUB4l2XgYs/edit#gid=0

Differences found in package Comparison

Number of RF2 records impactedRelated JIRA ticket(s)Rationale
RefsetDescriptor files
4
0

4 records added in order to correct issue in INFRA-9277

  • > 379db3c2-0cae-4f26-ad80-f097e983af3c    20220731    1    900000000000207008    900000000000456007    1186921001    900000000000532006    900000000000460005    0
  • > 39390a5a-830a-4e0b-a023-d3312d2d6aa6    20220731    1    900000000000207008    900000000000456007    1186924009    900000000000532006    900000000000460005    0
  • > c73c609c-e3fe-457e-8cb3-f7e8d220a0ab    20220731    1    900000000000207008    900000000000456007    1186924009    900000000000533001    900000000000460005    1
  • > e3394b4a-2617-4e67-8f2b-ac706ba60400    20220731    1    900000000000207008    900000000000456007    1186921001    900000000000533001    900000000000460005    1
CONFIRMED CORRECT by Michael via slack on 19/07/22, plus by email from Yong at 17:55 on  

0 records added/updated as expected

Concept files
2226
710
1005

590 records added/updated, plus

1221

120 records inactivated

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

Description files
6104
1649
4848

1529 records added/updated, plus

1256

120 records inactivated (ALMOST matches - 1255 in the report -

 

https://jira.ihtsdotools.org/browse/INFRA-9336 raised....

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer

.Maria agreed (via slack on 19/07/22) that as we can't manually validate 1256 inactivation records we should continue for now, and investigate more thoroughly IF the post-versioning Summary Component Stats report still shows the 1 record discrepancy..

.

Confirmed Reporting issue only (see Yong's confirmation in Slack on 26/7/22) - ticket raised:  RP-617

Relationship files
11253
10240
5171

6662 records added/updated, plus

6082

3578 records inactivated

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

Relationship Concrete Values files
248
211
227

205 records added/updated, plus

21

6 records inactivated

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)  

OwlExpression files
3029
2014
1808

1867 records added/updated, plus

1221 records inactivated

147 records inactivated

XXXXXXX 145 in initial Summary Stats report....same in the new final Summary report...

Peter confirmed in INFRA-9492 that the issue here is with the content team updating already-inactive components.  This shouldn't be allowed (as agreed with the content team) and so the report doesn't account for this kind of ill-advised (but not technically illegal) change.  However, we've raised RP-617 to keep an eye on how many of these type of changes occur each cycle, and make a call from there as to whether or not we need the AP to completely block these changes, or if they're actually useful valid changes?

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)

Stated Relationship files0

0 records updated, plus

0 records inactivated, plus

0 records added

As expected due to full migration to OWLExpression file in the July 2019 International Edition

TextDefinition files
421
18
420

17 records added/updated, plus

1 records inactivated

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report) 

NOTE:  Updated total DOES NOT ALWAYS MATCH EXACTLY (like the others) - the report states 1255 inactivations instead of 1256.  This is explained by the inclusion of the "<" character (which I use to search the Diff files to separate out the different change types) in many actual Terms.  So searching for "< " instead (including the tab after <) finds instead 334 records updated, which is much closer.

SimpleMap files
802
468
802

468 records added/updated, plus

0 records inactivated

Confirmed as matches with:

  • firstly the number of CTV3 records (900000000000497000) - which in this release is
802
  • 468 (as per the number of 900000000000497000 records in the SimpleMap diff files, + it's exactly the same number as new concepts this cycle - see Summary Component Stats report above) PLUS
  • the manual counts of ICD-0 records (446608001) - here 0 new + 0 inactivation, which match with those in the SimpleMap diff report sent by Rick via email on 15/07/22 at 00:54

Which matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at

10:34 on 18 Jul

13:48 on  

  • "added/updated" counts from diff report matches to total of WCI report lines:
    • Total Changed mapped entries (new) this release     0            +
    • Total New mapped entries this release     0
  • "inactivated" counts from diff report matches to total of WCI report lines:
    • Total Changed mapped entries (retired) this release     0        +
    • Total Retired mapped entries this release     0
ExtendedMap files
1246
353
234

321 records added/updated, plus

1012

32 records inactivated

Which matches exactly with the new detailed Map Reports WCI sent off the back of Maria's Map tasks, sent in an email from noreply@snomed.org entitled "Upload Successful", at

11:04 on 18 Jul

14:17 on  :

  • "added/updated" counts from diff report matches to total of WCI report lines:
    • Total Changed mapped entries (new) this
release
    • release   
  0 
    •  1            +
    • Total New mapped entries this release    
234
    • 320
  • "inactivated" counts from diff report matches to total of WCI report lines:
    • Total Changed mapped entries (retired) this
release
    • release     1   
    •    
 
    • +
    • Total Retired mapped entries this release    
1012
    • 31
Simple Refset files
28
52
21

51 records added/updated, plus

7

1 records inactivated

1opikf-o_Dpe80sr7ddtStIWGdg4gqffL2o_5nXxTeVU
2
    • 0

    • Report shows
28
    • 52 changes -
21
    • 51 new records +
7
    • 1 inactivations + 0 updates
ModuleDependency files

3


3 records updated, as expected for

July

August 2022 effectiveTimes

Readme file
July


August 2022 dates updated + Beta "x" prefixes removed, as expected

MRCM AttributeDomain files
5
0
2

0 records

updated, plus

2 records inactivated, plus

1 record added

As confirmed by Yong to be as expected in email trail at 17:46 on  

added/updated as expected

MRCM AttributeRange files
3
0
3

0 records added/updated

, plus

0 records inactivated

As confirmed by Yong to be

as expected

in email trail at 17:46 on  

MRCM Domain files
3
0
3

0 records added/updated

, plus

0 records inactivated

As confirmed by Yong to be

as expected

in email trail at 17:46 on  

Association Reference files
1486
333
1368

261 records added/updated, plus

118

72 records inactivated

...as expected as the totals ALMOST match exactly with Summary Component Stats report, but this report was run BEFORE we manually added in the 15 new records as part of the fixes in ISRS-1271 (spot checked these manually and they are present in new Association Snapshot + Full files as planned), so this brings us much closer to the figures in Comparison Diff files.


In order to get an accurate comparison, we have to ALSO INCLUDE the SEP refset (734138000 + 734139008) totals from the RF2 files (manually tallied from the new Association Snapshot files) and add them to the "Hist Assoc" tab in the Summary Component Report:

SEP (from RF2 diff files) = 48 changes:

12
  • 1 inactivations (734138000) + 0 inactivations (734139008)
23

This then, adds to the "Association" totals in the final refsets tab, in the Summary report stats:

106
  • 71 inactivations +
1328
  • 234 new/updated records

Makes a total of:

118
  • 72 inactivations +
1351
  • 261 new/updated
records  (+ 15 manually added in ISRS-1271)
  • records  

Which matches exactly with the counts I got above from the RF2 files!!  

Attribute Value files635

634 records added/updated, plus 

+++++ Confirmed correct now by Ed Cheetham (original reporter of ISRS-1271) on 20th July 2022 in Freshdesk ticket https://ihtsdo.freshdesk.com/a/tickets/40541

XXXXXXX 633 in initial Summary Stats report....same in the new final Summary report...

MANUAL validation in the DIFF files confirms:

  • 567 records added brand new +
  • 68 records updated/inactivated:
    • 1 inactivated
    • 67 updated:
      • 44 updated existing active records
      • 23 re-activated from previous inactive records

Peter confirmed that this is a reporting issue only - fixed in https://jira.ihtsdotools.org/browse/RP-628 - so if you check out the new report here you'll see it now matches 624 added/updated + 1 inactivated: https://docs.google.com/spreadsheets/d/1ifgQwZh0rnFAq9ky8d2V65R5j41r1aOtZ1ZjFchFdoY/edit#gid=13

1

Attribute Value files7047

7024 records added/updated, plus

23

records inactivated

...as expected as the totals ALMOST match exactly with Summary Component Stats report

Language refset files
15090
3288
12655

3053 records added/updated, plus

2435

235 records inactivated

Confirmed as matches exactly with data in Summary Component Stats report - see Report linked above - ("added/updated" counts above match against total of "New" + "Changed DefnStatus" + "Reactivated" columns in report)