8 records had their UUID's reverted to December 2022 (plus 2 records that were missing from the PreProd version 4 package) + new effectiveTime of 20230607 (but NO CHANGES TO ACTUAL RECORDS) as expected, due to NEW "FIRST TIME" RELEASE:
So when compared to the old December 2022 release, the new Version 5 refsetDescriptor records are identical except for the new effectiveTime of 20230607 for each record, as expected.
ModuleDependency files
2
2 records added back in as expected, as remaining 3 from December 2022 were all related to the old dependency on the CF module, which no longer exists!
Therefore, when compared to the old December 2022 release, the new Version 5 moduleDependency records are identical (except for the new effectiveTime of 20230607 for each record) for the 2 records that are still applicable in the new world of hosting all CF + CG records in the CH module instead of in the CF + CG modules. However, we've now removed 3 of the old moduleDependency records, as we no longer need to call out the dependencies on those CF + CG modules:
7478 inactive CF module (11000241103) records have been completely removed from the package.
This is exactly as expected, due to the fixes that were applied by Rory in
December 2022 Production (PUBLISHED) vs June 2023 PreProduction (Version 4 - COMPLETE RE-START OF SWISS RELEASE, AS IF THIS IS A "FIRST TIME" RELEASE) traceability
5 records removed completey, replaced with nothing!!
SO ALL WRONG!! NEED TO REVERT BACK TO EXTERNALLYMAINTAINED INPUT FOR THIS FILE TO SEE IF THIS FIXES IT!!
Readme file
all x prefixes added in, plus PreProduction naming convention applied, as expected.
Association files
12
2 new records added/updated for 20230607,
10 records (from all different effectiveTimes) removed
...NOT as expected due to Summary Component Stats report for this cycle (see link above) showing:
2 new records added/updated for 20230607,
0 records inactivated
IS THIS TO BE EXPECTED BECAUSE WE'VE "STARTED FROM SCRATCH" IN THIS RELEASE??????
ALL HISTORY GONE FROM ASSOCIATION FILES - I GUESS THIS IS WHAT WE WERE AIMING FOR WITH A BRAND NEW RELEASE, BUT JUST NEED TO DOUBLE CHECK WITH RORY...
Yes, Rory confirmed this is correct during our call at 17:00 on
AttributeValue files
11613
6860 new records added/updated for 20230607,
11613 records (from all different effectiveTimes) removed
...NOT as expected due to Summary Component Stats report for this cycle (see link above) showing:
6860 new records added/updated for 20230607,
0 records inactivated
IS THIS TO BE EXPECTED BECAUSE WE'VE "STARTED FROM SCRATCH" IN THIS RELEASE??????
ALL HISTORY GONE FROM ATTRIBUTEVALUE FILES - I GUESS THIS IS WHAT WE WERE AIMING FOR WITH A BRAND NEW RELEASE, BUT JUST NEED TO DOUBLE CHECK WITH RORY...
Yes, Rory confirmed this is correct during our call at 17:00 on
Language Refset (de-ch) files
29491
27928 new records added/updated for 20230607 - ***** FOR REFSETID: 2041000195100 *****
1563 records (from all different effectiveTimes) removed
..NOT as expected due to Summary Component Stats report for this cycle (see link above) showing:
27928 new records added/updated for 20230607,
0 records inactivated
DOES THIS MEAN THE SCS REPORT WILL BE INVALID, AS WILL SHOW NOW INACTIVATIONS BECAUSE IT'S A "BRAND NEW RELEASE" WITH NO "PREVIOUSPUBLISHEDPACKAGE" TO COMPARE THE CONTENT TO????
So my manual validation shows:
99 inactive records (ALL OF THEM) were removed from the original Language refset file, as expected
1465 active records were removed from the original Language refset file, all in refset: 2041000195100 (Swiss German LRS)
These were all in the Swiss Module (2011000195101), so not sure why we removed these, other than to just wipe the slate clean and start again??
GOOD NEWS is that I spot checked several dozen and they're all JUST UUID REFRESHES, as they all exist in the new content being added back in, so all good as we'd expect the UUID's to be refreshed due to this being a "Brand new release"
27,928 records added back in!!!
All in the Swiss Module (2011000195101) as expected
So assuming that the 1465 original records were all replaced (just had UUID's refreshed), we're looking at 26,463 NEW records from the Common German import.
PLUS 27,928 matches exactly to the SCS report above
IS THIS TO BE EXPECTED BECAUSE WE'VE "STARTED FROM SCRATCH" IN THIS RELEASE??????
Yes, Rory confirmed this is correct during our call at 17:00 on
Language Refset (it-ch) files
2603
1292 new records added/updated for 20230607 - ***** FOR REFSETID: 2031000195108 *****
1311 records (from all different effectiveTimes) removed
So my manual validation shows:
32 inactive records (ALL OF THEM) were removed from the original Language refset file, as expected
1279 active records were removed from the original Language refset file, all in refset: 2031000195108 (Swiss Italian LRS)
This accounts for the removal of ALL it-ch records from previous package, as expected as inactives removed forever, and actives removed just to refresh UUID's
1292 records added back in!! (all with 20230607 effectiveTime, all in SWISS module (2011000195101) + all in refset: 2031000195108 (Swiss Italian LRS)
From dozens of spot checks this looks like 1279 original active records (just has UUID's refreshed) + 13 NEW records for this cycle
PLUS 1292 matches exactly to the SCS report above
...as expected ????????????????
Yes, Rory confirmed this is correct during our call at 17:00 on
Language Refset (en) files
182
96 new records added/updated for 20230607 - ***** FOR REFSETID: 900000000000508004 + 900000000000509007 *****
86 records (from all different effectiveTimes) removed
So my manual validation shows:
0 inactive records (ALL OF THEM) were removed from the original Language refset file, as expected
86 active records were removed from the original Language refset file, all in refset: 900000000000509007 (en-US LRS) + 900000000000508004 (en-GB LRS)
This accounts for the removal of ALL it-ch records from previous package, as expected as inactives removed forever, and actives removed just to refresh UUID's
98 records added back in!! (all with 20230607 effectiveTime, all in SWISS module (2011000195101) + all in refset: 900000000000509007 (en-US LRS) + 900000000000508004 (en-GB LRS)
From dozens of spot checks this looks like 86 original active records (just has UUID's refreshed) + 12 NEW records for this cycle
PLUS 98 matches exactly to the SCS report above
Language Refset (fr) files
0
0 records added/updated, as expected as this is Common French Language file??????
SUMMARY REPORT EXPECTING 0
Language Refset (fr-ch) files
260,288
161,454 new records added/updated for 20230607 - ***** FOR REFSETID: 2021000195106 *****
98,834 records (from all different effectiveTimes) removed
So my manual validation shows:
6059 inactive records (ALL OF THEM) were removed from the original Language refset file, as expected
92,775 active records were removed from the original Language refset file, all in refset: 2021000195106 (Swiss French LRS)
These were all in the Swiss Module (2011000195101), so not sure why we removed these, other than to just wipe the slate clean and start again??
******* BUT I THOUGHT WE WERE DOING SOMETHING DIFFERENT IN THIS CYCLE WITH TEH COMMON FRENCH APPROACH?? MAYBE JUST IN DESCRIPTIONS??????? *******
GOOD NEWS is that I spot checked several dozen and they're all JUST UUID REFRESHES, as they all exist in the new content being added back in, so all good as we'd expect the UUID's to be refreshed due to this being a "Brand new release"
161,454 records added back in!!! (all with 20230607 effectiveTime, all in SWISS module (2011000195101) + all in refset: 2021000195106 (Swiss French LRS)
All in the Swiss Module (2011000195101) as expected
From dozens of spot checks it looks like the 92,775 original records were all replaced (just had UUID's refreshed), so we're looking at 68,679 NEW records from the Common French import.
PLUS 161,454 matches exactly to the SCS report above
Concept files
46
25 new records added/updated for 20230607,
21 records (from all different effectiveTimes) removed
...NOT as expected due to Summary Component Stats report for this cycle (see link above) showing:
25 new records added/updated for 20230607,
0 records inactivated
IS THIS TO BE EXPECTED BECAUSE WE'VE "STARTED FROM SCRATCH" IN THIS RELEASE??????
DOES THIS MEAN THE SCS REPORT WILL BE INVALID, AS WILL SHOW NOW INACTIVATIONS BECAUSE IT'S A "BRAND NEW RELEASE" WITH NO "PREVIOUSPUBLISHEDPACKAGE" TO COMPARE THE CONTENT TO????
Some of the records removed appear to be absolutely valid, as they are previously inactive records (and therefore there's no need to keep them as "born inactive" records) (eg)
DID RORY PERHAPS INTENTIONALLY MISS OUT ALL CONTENT FOR THIS MODULE (WHEN IMPORTING THE CONTENT INTO THE FRESH NEW CODESYSTEM), BECAUSE THIS IS THE COMMON FRENCH MODULE (11000241103 | SNOMED CT Common French translation module (core metadata concept) |) AND THEREFORE WE'RE NOW GOING FOR AN APPROACH THAT JUST IMPORTS THE COMMON FRENCH CONTENT STRAIGHT INTO THE SWISS MODULE INSTEAD AND THEREFORE THERE IS NO LONGER A DEPENDENCY THERE ON THE COMMON FRENCH MODULE, AND THUS NO REASON TO INCLUDE IT IN THE SWISS PACKAGE????
Description (de-ch) files
29593
28030 new records added/updated for 20230607
1563 records (from all different effectiveTimes) removed
So my manual validation shows:
1563 records removed from original file (all in SWISS module (2011000195101))
28,041 records added back in (all in SWISS module (2011000195101))
99 inactive records (ALL OF THEM) from original Description file had new DescriptionID's assigned to them, ***BUT WERE THEN ADDED BACK IN AS BORN-INACTIVE RECORDS***
?????????? as expected ????????????
1464 active records were removed from the original Description file
These were all in the Swiss Module (2011000195101), so not sure why we removed these, other than to just wipe the slate clean and start again??
GOOD NEWS is that I spot checked several dozen and they're all JUST DescriptionID REFRESHES, as they all exist in the new content being added back in, so all good as we'd expect the ID's to be refreshed due to this being a "Brand new release"
28,041 records added in!!! (all with 20230607 effectiveTime, all in SWISS module (2011000195101)
All in the Swiss Module (2011000195101) as expected
102 of these records were born-inactive "0" status records
From dozens of spot checks it looks like the 1563 original records were all replaced (just had UUID's refreshed), so we're looking at 26,464 NEW records from the Common German import.
PLUS figures match exactly to the "Desc by Lang" tab of the SCS report above:
102 "New Inactive"
27,928 "New" (1464 original active records + 26,464 brand new records)
due to close match with TOTAL DESCRIPTION Counts in Summary Component Stats report for this cycle (see link above)
Description (en) files
68
40 new records added/updated for 20230607 -
28 records (from all different effectiveTimes) removed
So my manual validation shows:
28 records removed from original file (all in SWISS module (2011000195101))
40 records added back in (all in SWISS module (2011000195101))
0 inactive records (ALL OF THEM) from original Description file had new DescriptionID's assigned to them
28 active records were removed from the original Description file
These were all in the Swiss Module (2011000195101), so not sure why we removed these, other than to just wipe the slate clean and start again??
GOOD NEWS is that I spot checked several dozen and they're all JUST DescriptionID REFRESHES, as they all exist in the new content being added back in, so all good as we'd expect the ID's to be refreshed due to this being a "Brand new release"
40 records added in!!! (all with 20230607 effectiveTime, all in SWISS module (2011000195101)
All in the Swiss Module (2011000195101) as expected
0 of these records were born-inactive "0" status records
From dozens of spot checks it looks like the 28 original records were all replaced (just had UUID's refreshed), so we're looking at 12 NEW records from the EN lang.
PLUS figures match exactly to the "Desc by Lang" tab of the SCS report above:
0 "New Inactive"
40 "New" (28 original active records + 12 brand new records)
due to close match with TOTAL DESCRIPTION Counts in Summary Component Stats report for this cycle (see link above)
Description (fr) files
185,262
7479 new records added/updated for 20230607 -
177,783 records (from all different effectiveTimes) removed
So my manual validation shows:
177,783 records removed from original file (all in Common French Module (11000241103))
7478 (INACTIVE) records added back in (all in Common French Module (11000241103))
10,588 inactive records (ALL OF THEM) from original Description file WERE COMPLETELY REMOVED, EXCEPT FOR 7478 OF THEM WHICH WERE ADDED BACK IN WITH NEW descriptionID's????
******** WHY ONLY SOME OF THEM??? WHY ANY OF THEM????!!! ********
?????????? as expected ????????????
167,184 active records were removed from the original Description file
These were all in Common French Module (11000241103), and therefore were completely removed from the Package?????????
7478 records added in!!! (all with 20230607 effectiveTime, all in SWISS module (2011000195101)
All in the Common French Module (11000241103) ???????????
7478 of these records were born-inactive "0" status records, ****** ALL in the Common French Module (11000241103) ******
DOES NOT match figures in the "Desc by Lang" tab of the SCS report above, as the Report seems to have missed out -FR !!!:
as planned in INFRA-8967 in order to correctly split out the Swiss French records into their own "fr-ch" Description file, leaving ONLY the Common French records in this "fr" Description file.
...as expected due to close match with TOTAL DESCRIPTION Counts in Summary Component Stats report for this cycle (see link above)
Description (fr-ch) files
158774
158,602 new records added/updated for 20230607 -
147 records (from all different effectiveTimes) removed
So my manual validation shows:
147 records removed from original file (all in SWISS module (2011000195101))
158,623 records added back in (all in SWISS module (2011000195101))
21 inactive records (ALL OF THEM) from original Description file had new DescriptionID's assigned to them, ***BUT WERE THEN ADDED BACK IN AS BORN-INACTIVE RECORDS***
?????????? as expected ????????????
125 active records were removed from the original Description file
These were all in the Swiss Module (2011000195101), so not sure why we removed these, other than to just wipe the slate clean and start again??
GOOD NEWS is that I spot checked several dozen and they're all JUST DescriptionID REFRESHES, as they all exist in the new content being added back in, so all good as we'd expect the ID's to be refreshed due to this being a "Brand new release"
158,623 records added in!!! (all with 20230607 effectiveTime, all in SWISS module (2011000195101)
All in the Swiss Module (2011000195101) as expected
21 of these records were born-inactive "0" status records
From dozens of spot checks it looks like the 125 original records were all replaced (just had UUID's refreshed), so we're looking at 158,477 NEW records from the Common French import.
PLUS figures match exactly to the "Desc by Lang" tab of the SCS report above:
21 "New Inactive"
158,602 "New" (125 original active records + 158,477 brand new records)
...as expected due to close match with TOTAL DESCRIPTION Counts in Summary Component Stats report for this cycle (see link above)
Description (it-ch) files
2637
1326 new records added/updated for 20230607 -
1311 records (from all different effectiveTimes) removed
So my manual validation shows:
1311 records removed from original file (all in SWISS module (2011000195101))
1326 records added back in (all in SWISS module (2011000195101))
32 inactive records (ALL OF THEM) from original Description file had new DescriptionID's assigned to them
1279 active records were removed from the original Description file
These were all in the Swiss Module (2011000195101), so not sure why we removed these, other than to just wipe the slate clean and start again??
GOOD NEWS is that I spot checked several dozen and they're all JUST DescriptionID REFRESHES, as they all exist in the new content being added back in, so all good as we'd expect the ID's to be refreshed due to this being a "Brand new release"
40 records added in!!! (all with 20230607 effectiveTime, all in SWISS module (2011000195101)
All in the Swiss Module (2011000195101) as expected
34 of these records were born-inactive "0" status records
From dozens of spot checks it looks like the 1279 original active records were all replaced (just had UUID's refreshed), so we're looking at 13 NEW records from the IT lang.
PLUS figures match exactly to the "Desc by Lang" tab of the SCS report above:
34 "New Inactive"
1292 "New" (1279 original active records + 13 brand new records)
due to close match with TOTAL DESCRIPTION Counts in Summary Component Stats report for this cycle (see link above)
Relationship files
64
37 new records added/updated for 20230607 -
27 records (from all different effectiveTimes) removed
...NOT as expected due to Summary Component Stats report for this cycle (see link above) showing:
37 new records added/updated for 20230607,
0 records inactivated
IS THIS TO BE EXPECTED BECAUSE WE'VE "STARTED FROM SCRATCH" IN THIS RELEASE??????
Some of the records removed appear to be absolutely valid, as they are previously inactive records (and therefore there's no need to keep them as "born inactive" records) (eg)
The good news here is that the only record related to the now unnecessary Common French module (11000241103) was already inactive, and therefore gets removed anyway:
...as expected due to exact match in Summary Component Stats report for this cycle (see link above)
OWL Expression files
46
25 new records added/updated for 20230607 -
21 records (from all different effectiveTimes) removed
...as expected ????????????????
Some of the records removed appear to be absolutely valid, as they are previously inactive records (and therefore there's no need to keep them as "born inactive" records) (eg)
The good news here is that one of the records related to the now unnecessary Common French module (11000241103) was already inactive, and therefore gets removed anyway:
******** IS IT POSSIBLE TO RUN THE SCS REPORT AS IF IT'S STILL COMPARING TO THE PREVIOUS PUBLISHED PACKAGE FROM NOVEMBER, AND THEREFORE GET AN EXACT MATCH WITH THE NEW/INACTIVE COMPONENTS THAT I'M FINDING OUTSIDE OF THE EXPECTED CHANGES THAT ARE DIRECTLY LINKED TO RORY's CHANGES FOR THE COMMON FRENCH / GERMAN???
TextDefinition (de-ch) files
0
0 new records added/updated for 20230607 -
0 records (from all different effectiveTimes) removed
...as expected as this file was empty in the previous releases.
TextDefinition (en) files
0
0 new records added/updated for 20230607 -
0 records (from all different effectiveTimes) removed
...as expected as this file was empty in the previous releases.
TextDefinition (fr) files
1
0 new records added/updated for 20230607 -
1 records (from all different effectiveTimes) removed
...as expected ????????????????
1 record related to the now unnecessary Common French module (11000241103) was removed as expected: