July 2021 PRODUCTION (PUBLISHED) to January 2022 Member (Version 10) traceability
Differences found in package Comparison | Number of RF2 records impacted | Related JIRA ticket(s) | Rationale | Cross Check - SCS / SQL |
|---|---|---|---|---|
| ALL DELTA FILES | ALL DELTA FILES REMOVED AS EXPECTED!! | |||
| RefsetDescriptor files | 24 | Planned changed for Reverse Map refsets from Linda in https://docs.google.com/spreadsheets/d/1MynSF5Vz2awNz_SOTwzaWq6YWWwg11aLJxkijJdF2rE/edit#gid=0
CONFIRMED CORRECT by Alejandro via email at 20:13 on 16/12/21 | ||
| Concept files | 6754 | 1145 records updated, plus 1174 records inactivated, plus 3435 records added, ...as expected as the added (3545) + inactivated (3512) totals match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0 ...plus the updated total (1901) matches exactly with the total records in the Concepts Changed report (5413): https://docs.google.com/spreadsheets/d/1QhxK1cja523C8CADBK75wzJ4qeXgIKSOfxgSPCR6E8g/edit#gid=0 MINUS the total number of inactivations (3512) - therefore 5413-3512 = 1901 (plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on ) | There are 5 reasons for a concept to appear in the delta: New, Changed DefnStatus, Inactivated, Reactivated, New Inactive In the SCS report these columns sum to 6752. The following SQL equivalent gives 6754: select count(distinct(id)) I suspect the difference can be accounted for by an overall reversion to 20210731 state. Bingo, see SQL here gives a count of 2. | |
| Description files | 36675 | 697 records updated, plus 9010 records inactivated, plus 26968 records added ...as expected as the added (12951) + inactivated (3568) + updated (8004) totals ALMOST match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0 ****** THE PROBLEM HERE IS THAT MY COMPARISON REPORTS USE THE ">" and "<" symbols, which are also present in nearly 3000 Descriptions themselves! Therefore MY TOTALS are definitely wrong! We therefore have to trust the reports from now on.. (plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on ) | In the SCS report these columns sum to 36297. The following SQL equivalent gives 36666: select count(distinct(id)) Reversion to previous state accounts for only 5 Note: Loaded xSnomedCT_InternationalRF2_MEMBER_20220131T120000Z.zip into db to ensure accurate comparison, but SQL count unchanged. | |
| Relationship files | 74836 | 0 records updated, plus 76083 records inactivated, plus 47672 records added ...as expected as the added (51176) + inactivated (40147) the updated (3402) totals match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0 (plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on ) | In the SCS report these columns sum to 74784. The following SQL equivalent gives 74836: select count(distinct(id)) Reversion to prior state accounts for 54 rows not reported by SCS ( 74784 + 54 = 74838 ) | |
| Relationship Concrete Values files | 2150 | 0 records updated, plus 1192 records inactivated, plus 958 records added ...as expected as the added (51176) + inactivated (40147) the updated (3402) totals match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0 (plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on ) | ||
| OwlExpression files | 16419 | 10643 records updated, plus 1164 records inactivated, plus 4612 records added ...as expected as the added (4006) + inactivated (3568) the updated (12476) totals match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0 (plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on ) | In the SCS report these columns sum to 7763. The following SQL equivalent gives 16419: select count(distinct(id)) Ah, the SVS report isn't spotting "changed" when it happens between the two effective times. Changes pending... | |
| Stated Relationship files | 0 | 0 records updated, plus 0 records inactivated, plus 0 records added As expected due to full migration to OWLExpression file in the last July 2019 International Edition | ||
| TextDefinition files | 719 | 0 records updated, plus 46 records inactivated, plus 673 records added ...as expected as the added (671) + inactivated (100) + updated (0) totals ALMOST match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0 ****** THE PROBLEM HERE IS THAT MY COMPARISON REPORTS USE THE ">" and "<" symbols, which are also present in nearly 20 Text Definitions themselves! Therefore MY TOTALS are definitely wrong! We therefore have to trust the reports from now on.. (plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on ) | ||
| SimpleMap files | 4592 | 0 records updated, plus 65 records inactivated for ICD-0 (446608001) 4527 records added, as expected as:
| ||
| ExtendedMap files | 2674 | 0 records updated, plus 536 records inactivated, plus 2138 records added, as expected from the 2189 additions + 3276 inactivations + 9 updates in the ICD-10 map (449080006) Delta file that WCI sent us from the mapping tool export + NOT the figures in the icd10stats.txt file from WCI (WHICH CANNOT CURRENTLY BE USED FOR VALIDATION PURPOSES DUE TO THE EXTENDED MAP ALLOWING MULTIPLE MAP RECORDS PER CONCEPT, AND US ONLY BEING ABLE OT VALIDATE NUMBER OF MAP RECORDS (not number of concepts) ADDED/INACTIVATED IN THIS CYCLE - HAVE ASKED RICK HOW EASY IT'D BE TO UPDATE THE REPORT TO INCLUDE THESE STATS INSTEAD OF/AS WELL AS THE CURRENT Concept level STATS.... | ||
| Simple Refset files | 488 | 0 records updated, plus 123 records inactivated, plus 365 records added, as expected from the Lateralizable Refset changes (723264001) that Yong made in this cycle, exported in a Delta file from the Refset tool (plus confirmed by Maria/Yong to be as expected in email trail at 12:18 on ) | ||
| ModuleDependency files | 3 | 3 records updated, as expected for January 2022 effectiveTimes | ||
| Readme file | January 2022 dates updated + Beta "x" prefixes added, PLUS ALL DELTA FILES REMOVED AS EXPECTED!! | |||
| MRCM AttributeDomain files | 1 | 1 new record added: > 7e29d963-b054-4454-9121-8de1cffceadd 20211031 1 900000000000012004 723561005 1003735000 363787002 1 0..* 0..1 723597001 723596005
| ||
| MRCM AttributeRange files | 1 | 1 records added, plus > ae7667d7-a1e7-48ca-8cd9-575aa848d94f 20211031 1 900000000000012004 723562003 1003735000 << 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 373873005 |Pharmaceutical / biologic product (product)| << 363787002 |Observable entity (observable entity)|: [0..*] { [0..1] 1003735000 |Process acts on| = (<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 373873005 |Pharmaceutical / biologic product (product)|) } 723597001 723596005
As confirmed by Maria/Yong to be as expected in email trail at 12:18 on | ||
| MRCM Domain files | 1 | 1 records updated, < 3afa8ba9-6196-4792-afd0-224450e79166 20210731 1 900000000000012004 723560006 363787002 << 363787002 |Observable entity (observable entity)| << 363787002 |Observable entity (observable entity)| [[+id(<< 363787002 |Observable entity (observable entity)|)]]: [[0..*]] { [[0..1]] 1003703000 |Process extends to| = [[+id(<< 123037004 |Body structure (body structure)|)]], [[0..1]] 246093002 |Component| = [[+id(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 123038009 |Specimen (specimen)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)| OR << 419891008 |Record artifact (record artifact)|)]], [[0..1]] 246501002 |Technique| = [[+id(<< 254291000 |Staging and scales (staging scale)| OR << 272394005 |Technique (qualifier value)|)]], [[0..1]] 246514001 |Units| = [[+id(< 767524001 |Unit of measure (qualifier value)|)]], [[0..1]] 370130000 |Property| = [[+id(<< 118598001 |Property (qualifier value)|)]], [[0..1]] 370132008 |Scale type| = [[+id(<< 117362005 |Nominal value (qualifier value)| OR << 117363000 |Ordinal value (qualifier value)| OR << 117364006 |Narrative value (qualifier value)| OR << 117365007 |Ordinal OR quantitative value (qualifier value)| OR << 117444000 |Text value (qualifier value)| OR << 26716007 |Qualitative (qualifier value)| OR << 30766002 |Quantitative (qualifier value)|)]], [[0..1]] 370134009 |Time aspect| = [[+id(<< 7389001 |Time frame (qualifier value)|)]], [[0..1]] 405815000 |Procedure device| = [[+id(<< 49062001 |Device (physical object)|)]], [[0..1]] 424226004 |Using device| = [[+id(<< 49062001 |Device (physical object)|)]], [[0..1]] 704319004 |Inheres in| = [[+id(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 123038009 |Specimen (specimen)| OR << 125676002 |Person (person)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)| OR << 419891008 |Record artifact (record artifact)|)]], [[0..1]] 704320005 |Towards| = [[+id(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 123038009 |Specimen (specimen)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)| OR << 419891008 |Record artifact (record artifact)|)]], [[0..1]] 704321009 |Characterizes| = [[+id(<< 71388002 |Procedure (procedure)| OR << 719982003 |Process (qualifier value)|)]], [[0..1]] 704322002 |Process agent| = [[+id(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)|)]], [[0..1]] 704323007 |Process duration| = [[+id(<< 7389001 |Time frame (qualifier value)|)]], [[0..1]] 704324001 |Process output| = [[+id(<< 105590001 |Substance (substance)| OR << 719982003 |Process (qualifier value)|)]], [[0..1]] 704325000 |Relative to| = [[+id(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 123038009 |Specimen (specimen)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)| OR << 419891008 |Record artifact (record artifact)|)]], [[0..1]] 704326004 |Precondition| = [[+id(<< 404684003 |Clinical finding (finding)| OR << 703763000 |Precondition value (qualifier value)| OR << 71388002 |Procedure (procedure)|)]], [[0..1]] 704327008 |Direct site| = [[+id(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 123038009 |Specimen (specimen)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)| OR << 419891008 |Record artifact (record artifact)|)]], [[0..1]] 718497002 |Inherent location| = [[+id(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 123038009 |Specimen (specimen)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)| OR << 419891008 |Record artifact (record artifact)|)]], [[0..1]] 719715003 |Relative to part of| = [[+id(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 123038009 |Specimen (specimen)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)| OR << 419891008 |Record artifact (record artifact)|)]], [[0..1]] 719722006 |Has realization| = [[+id(<< 719982003 |Process (qualifier value)|)]] } [[+scg(<< 363787002 |Observable entity (observable entity)|)]]: [[0..*]] { [[0..1]] 1003703000 |Process extends to| = [[+scg(<< 123037004 |Body structure (body structure)|)]], [[0..1]] 246093002 |Component| = [[+scg(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 123038009 |Specimen (specimen)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)| OR << 419891008 |Record artifact (record artifact)|)]], [[0..1]] 246501002 |Technique| = [[+scg(<< 254291000 |Staging and scales (staging scale)| OR << 272394005 |Technique (qualifier value)|)]], [[0..1]] 246514001 |Units| = [[+scg(< 767524001 |Unit of measure (qualifier value)|)]], [[0..1]] 370130000 |Property| = [[+scg(<< 118598001 |Property (qualifier value)|)]], [[0..1]] 370132008 |Scale type| = [[+scg(<< 117362005 |Nominal value (qualifier value)| OR << 117363000 |Ordinal value (qualifier value)| OR << 117364006 |Narrative value (qualifier value)| OR << 117365007 |Ordinal OR quantitative value (qualifier value)| OR << 117444000 |Text value (qualifier value)| OR << 26716007 |Qualitative (qualifier value)| OR << 30766002 |Quantitative (qualifier value)|)]], [[0..1]] 370134009 |Time aspect| = [[+scg(<< 7389001 |Time frame (qualifier value)|)]], [[0..1]] 405815000 |Procedure device| = [[+scg(<< 49062001 |Device (physical object)|)]], [[0..1]] 424226004 |Using device| = [[+scg(<< 49062001 |Device (physical object)|)]], [[0..1]] 704319004 |Inheres in| = [[+scg(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 123038009 |Specimen (specimen)| OR << 125676002 |Person (person)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)| OR << 419891008 |Record artifact (record artifact)|)]], [[0..1]] 704320005 |Towards| = [[+scg(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 123038009 |Specimen (specimen)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)| OR << 419891008 |Record artifact (record artifact)|)]], [[0..1]] 704321009 |Characterizes| = [[+scg(<< 71388002 |Procedure (procedure)| OR << 719982003 |Process (qualifier value)|)]], [[0..1]] 704322002 |Process agent| = [[+scg(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)|)]], [[0..1]] 704323007 |Process duration| = [[+scg(<< 7389001 |Time frame (qualifier value)|)]], [[0..1]] 704324001 |Process output| = [[+scg(<< 105590001 |Substance (substance)| OR << 719982003 |Process (qualifier value)|)]], [[0..1]] 704325000 |Relative to| = [[+scg(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 123038009 |Specimen (specimen)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)| OR << 419891008 |Record artifact (record artifact)|)]], [[0..1]] 704326004 |Precondition| = [[+scg(<< 404684003 |Clinical finding (finding)| OR << 703763000 |Precondition value (qualifier value)| OR << 71388002 |Procedure (procedure)|)]], [[0..1]] 704327008 |Direct site| = [[+scg(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 123038009 |Specimen (specimen)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)| OR << 419891008 |Record artifact (record artifact)|)]], [[0..1]] 718497002 |Inherent location| = [[+scg(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 123038009 |Specimen (specimen)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)| OR << 419891008 |Record artifact (record artifact)|)]], [[0..1]] 719715003 |Relative to part of| = [[+scg(<< 105590001 |Substance (substance)| OR << 123037004 |Body structure (body structure)| OR << 123038009 |Specimen (specimen)| OR << 260787004 |Physical object (physical object)| OR << 373873005 |Pharmaceutical / biologic product (product)| OR << 410607006 |Organism (organism)| OR << 419891008 |Record artifact (record artifact)|)]], [[0..1]] 719722006 |Has realization| = [[+scg(<< 719982003 |Process (qualifier value)|)]] } http://snomed.org/dom363787002 0 inactivated, plus 0 new record added As confirmed by Maria/Yong to be as expected in email trail at 12:18 on | ||
| Association Reference files | 3788 | 11 records updated, plus 863 records inactivated, plus 2914 records added ...as expected as the added (8301) + inactivated (4488) + updated (2) totals ALMOST match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0 Yong confirmed that this is not quite what he expected in email trail at 12:18 on inactivation for the 734138000|Anatomy structure and entire association reference set (foundation metadata concept)| | ||
| Attribute Value files | 15159 | 0 records updated, plus 861 records inactivated, 14298 records added As confirmed by Maria/Yong to be as expected in email trail at 12:18 on | ||
| Language refset files | 73536 | 1854 records updated, plus 17765 records inactivated, plus 54367 records added ...as expected as the added (26049) + inactivated (6970) the updated (456) totals match exactly with Component Stats report: https://docs.google.com/spreadsheets/d/1-XU7byTRnBJUYaDhvlXdzFpHlFxDV746o5F2Msa1Olk/edit#gid=0 As confirmed by Maria/Yong to be as expected in email trail at 12:18 on |
January 2022 Member (version 9) to January 2022 Member (version 10) traceability
Differences found in package Comparison | Number of RF2 records impacted | Related JIRA ticket(s) | Rationale |
|---|---|---|---|
| refsetDescriptor files | 24 | INFRA-8103 - Getting issue details... STATUS | Now using externallyMaintained input files again and CAN see new records from Linda: See Delta tab in https://docs.google.com/spreadsheets/d/1MynSF5Vz2awNz_SOTwzaWq6YWWwg11aLJxkijJdF2rE/edit#gid=0
CONFIRMED CORRECT by Alejandro via email at 20:13 on 16/12/21 |
| moduleDependency files | Now using termServer input files and looks good - removed externallyMaintained files in S3 and checked it still works so all good | ||
| SimpleMap files | 568 | 568 records had their UUID's refreshed as expected |
January 2022 Member (version 8 - post-versioning) to January 2022 Member (version 9) traceability
Differences found in package Comparison | Number of RF2 records impacted | Related JIRA ticket(s) | Rationale |
|---|---|---|---|
| refsetDescriptor files | 24 | INFRA-8103 - Getting issue details... STATUS FRI-262 - Getting issue details... STATUS | Now using termServer input files BUT can't see new records from Linda: See Delta tab in https://docs.google.com/spreadsheets/d/1MynSF5Vz2awNz_SOTwzaWq6YWWwg11aLJxkijJdF2rE/edit#gid=0 |
| Readme file | Licence date now set to 2022!!! | ||
| moduleDependency files | Now using termServer input files and looks good - now need to remove externallyMaintained files in S3 and check it still works... | ||
| SimpleMap files | 568 | 568 records had their UUID's refreshed as expected | |
| .JSON file | All fields now populated, as expected |
January 2022 Member (version 7 - pre-versioning) to January 2022 Member (version 8 - post-versioning) traceability
Differences found in package Comparison | Number of RF2 records impacted | Related JIRA ticket(s) | Rationale |
|---|---|---|---|
| Readme file | Licence date still set to 2021!!! | ||
| moduleDependency files | Still using externallyMaintained refset files, but should be able to use new automated versions from termServer now as per FRI-73 | ||
| refsetDescriptor files | Still using externallyMaintained refset files, but should be able to use new automated versions from termServer now as per FRI-262 | ||
| SimpleMap files | 568 | 568 records had their UUID's refreshed as expected | |
| .JSON file | All fields now populated, as expected |