SNOMED International Release Management

Page tree

Versions Compared

Old Version 10

changes.mady.by.user Maria Braithwaite

Saved on

compared with

New Version Current

changes.mady.by.user Andrew Atkinson

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Date of Initial Handover meeting: 5 October 2023

Date of Final Handover meeting: 10 October 2023

Attendees


Page properties


Handover Status

Status
subtletrue
colourBlue
titleINITIAL Handover COMPLETE



Agenda

  1. Inappropriate content being included in the lateralizable body structure reference set. Reported to us by NLM. Requires an update to the validation rules, the ticket is logged here Image RemovedVAL-334 - RVF [update]: Exclude cell, cell structure and morphologic abnormality from valdation for Lateralizable body structure reference set CLOSED

 

Items to be discussed

Actions

1

Prerelease Content Management Activities:

  1. Inactivate the root concept synonym referencing previous release, and add synonym to reference current release.
  2. Update copyright date on synonym (January releases only)
  3. Generate + Validate SEP Refsets
  4. Generate + Validate Lateralizable Refset
  1. MBR - root synonym - 5276485010 SNOMED Clinical Terms version: 20231101 [R] (November 2023 Release) https://authoring.ihtsdotools.org/#/tasks/task/DAILYPROMO/DAILYPROMO-5661/edit
  2. MBR - root copyright date - not required
  3. SEP - https://docs.google.com/spreadsheets/d/1BqR8Aicwm6n4xi3uQgufZlXaRDgmopjBZHew7M0Dicc1TWmSyuk9cbm2g3J9b9AVa6pw2-WZbrHj6u_FlOI-LC8/edit?usp=sharing
  4. Laterality - https://docs.google.com/spreadsheets/d/1BqR8Aicwm6n4xi3uQgufZlXaRDgmopjBZHew7M0Dicc1TWmSyuk9cbm2g3J9b9AVa6pw2-WZbrHj6u_FlOI-LC8/edit?usp=sharing
2

Discussion of existing Known Issues from the previous Release

  1. Traceability issues for January 2023 release - NONE.
  2. Traceability issues for February 2023 release - https://jira.ihtsdotools.org/browse/FRI-576 2 failures both confirmed as false positives by Michael.
  3. Traceability March 2023 release - NONE on MAIN (2 failures found on project confirmed false positives not seen in daily build after promotion https://jira.ihtsdotools.org/browse/INFRA-10533)
  4. Traceability for April 2023 release - 8 failures on main checked and false positives, ticket is here INFRA-10712 - MF1, All components in the branch traceability summary must also be in the RF2 export, TRACEABILITY, f68c761b-3b5c-4223-bc00-6e181e7f68c3 CLOSED
  5. Traceability for May 2023 release - NONE
  6. Traceability for June 2023 release - https://jira.ihtsdotools.org/browse/INFRA-11004 these are valid warnings relating to the MRCM changes.
  7. Traceability for July 2023 release - 2 failures

    https://jira.ihtsdotools.org/browse/INFRA-11186 checked and false positives

  8. Traceability for September 2023 release - 3 failures false positives INFRA-11323 - CMTTWO, All components in the RF2 export must also be in the branch traceability summary, TRACEABILITY, b7f727d7-9226-4eef-9a7e-47a8580f6e7a CLOSED INFRA-11339 - QIJCA, All components in the RF2 export must also be in the branch traceability summary, TRACEABILITY, b7f727d7-9226-4eef-9a7e-47a8580f6e7a CLOSED INFRA-11347 - RVF daily build - assertionText": "All components in the branch traceability summary must also be in the RF2 export." CLOSED INFRA-11351 - QIKLI: Assertion Failure: All components in the RF2 export must also be in the branch traceability summary. CLOSED Also MRCM traceability expected changes checked here INFRA-11294 - MRCM change request : 1142142004 |Has pack size (attribute)| change from Integer to Decimal CLOSED
  9. Traceability for October 2023 release -
    1. MRCM traceability failures https://jira.ihtsdotools.org/browse/ATF-1678
    2. MRCM traceability failures https://jira.ihtsdotools.org/browse/INFRA-11496
      1. (both standard, expected warnings when MRCM changes are promoted)
    3. Traceability false positives https://jira.ihtsdotools.org/browse/INFRA-11526
    4. Traceability valid issues resolved https://jira.ihtsdotools.org/browse/INFRA-11549
      1. Unexpected issues with inferred records - fixed in a RELVAL task and promoted to MAIN, so just need to watch out for similar issues in Release Val
  10. Traceability for November 2023 release:
    Jira
    serverIHTSDO JIRA
    serverIdb202d822-d767-33be-b234-fec5accd5d8c
    keyINFRA-11672
    1 issue checked and ok to exception list.


3

Content Validation 

  1. Instead of usual manual Content validation, we now just need confirmation that all Projects had automated validation run against them, and were clean before promotion.
  2. New Issues identified by the community from the previous Monthly Release.
    1. Decision on whether to fix the issues:
      1. VERY QUICKLY in time for this upcoming release?
      2. In good time for the next monthly release?
  1. RVF failures - None Ref set description changes November 2023 release - see outstanding, issues found during editing cycle have been resolved.
    1. https://jira.ihtsdotools.org/browse/INFRA-11603
    2. https://jira.ihtsdotools.org/browse/
    MAINT
    1. INFRA-
    2290
    1. The following four new concepts are added for annotation refsets.
      1. 1292994003 |Component annotation with component value reference set (foundation metadata concept)|
      2. 1292992004 |Component annotation with string value reference set (foundation metadata concept)|
      3. 1292996001 |Member annotation with component value reference set (foundation metadata concept)|
      4. 1292995002 |Member annotation with string value reference set (foundation metadata concept)|
  2. NEW and CHANGED MRCM report - https://docs.google.com/spreadsheets/d/1bmbwspYLftyO07CDXuAkeFe7Wqy-l-u0Z0cCuDbcPJA/edit#gid=0
  3. MRCM changes for November 2023 - NONE.
    1. 11629
    2. https://jira.ihtsdotools.org/browse/INFRA-11658
    3. https://jira.ihtsdotools.org/browse/INFRA-11659
    4. https://jira.ihtsdotools.org/browse/INFRA-11660
    5. https://jira.ihtsdotools.org/browse/INFRA-11672
    6. Resolved for handover minutes https://jira.ihtsdotools.org/browse/VAL-334
  5. Ref set description changes November 2023 release - see https://jira.ihtsdotools.org/browse/MAINT-2290
    1. NO CHANGES SEEN IN THE NOVEMBER 2023 INT EDITION CONTENT
      1. WHY HAVE THEY NOT BEEN PROMOTED?  BECAUSE WE'RE STILL DISCUSSING FINAL SOLUTION?????????????????????
    2. The following four new concepts are added for annotation refsets.
      1. 1292994003 |Component annotation with component value reference set (foundation metadata concept)|
      2. 1292992004 |Component annotation with string value reference set (foundation metadata concept)|
      3. 1292996001 |Member annotation with component value reference set (foundation metadata concept)|
      4. 1292995002 |Member annotation with string value reference set (foundation metadata concept)|
    3. AAT TO VERIFY THESE ARE IN LINE WITH YONG'S REQUIREMENTS IN:
      1. https://confluence.ihtsdotools.org/display/mag/SNOMED+CT+Annotations
    4. IF ANY DEVIATIONS DUE TO THE AUTOMATED GENERATION OF THE REFSETDESCRIPTOR RECORDS:
      1. a)  Discuss with Yong to see if his suggestions or automated generations are correct, and
      2. b) If Yong is right, I'll hav to manually add them into this release instead
  6. NEW and CHANGED MRCM report -https://docs.google.com/spreadsheets/d/1jm8EMLMuJ4Sr9nZWM2UpbDo0Pt1rCwf90HZOjaSC6zw/edit?usp=sharing
  7. MRCM changes for November 2023 - NONE.


4Mapping schedule

January 2023:

  • ICD-0 - 1 new records + 0 inactivations expected
  • ICD-10 - expecting 550 ish changes (plus tonight's drip feed) due to large number of intentional inactivations this cycle
  • No expected issues this cycle...
    • Confirmed in final numbers!

February 2023:

  • ICD-0 - 1 new records + 0 inactivations expected
  • ICD-10 - expecting 500
4Mapping schedule

January 2023:

  • ICD-0 - 1 new records + 0 inactivations expected
  • ICD-10 - expecting 550 ish changes (plus tonight's drip feed) due to large number of intentional inactivations this cycle
  • No expected issues this cycle...
    • Confirmed in final numbers!

February 2023:

  • ICD-0 - 1 new records + 0 inactivations expected
  • ICD-10 - expecting 500 ish changes (plus tonight's drip feed) due to large number of intentional inactivations this cycle
  • No expected issues this cycle...
    • Confirmed in final numbers!

March 2023:

  • ICD-0 - 2 new records + 0 inactivations expected
  • ICD-10 - expecting 315 ish changes (plus tonight's drip feed) due to large number of intentional inactivations this cycle
  • No expected issues this cycle...
    • Confirmed in final numbers!

April 2023:

  • ICD-0 - 6 new records + 2 inactivations expected
    • + for the specific fixes for this cycle we're expecting 7 records that should have been inactivated in March but were not, but should be now
    • + Rick is going to tweak the Mapping Dashboard to give Donna more visibility of the final expected map figures (EXCLUDING "no target" maps which she would normally include in her figures but which we wouldn't see coming out of the Delta files)
  • ICD-10 - expecting 537 ish changes (plus tonight's drip feed) due to large number of intentional inactivations this cycle
  • No expected issues this cycle...
    • Confirmed in final numbers!

May March 2023:

  • ICD-0 - 3 2 new records + 0 inactivations expected
  • + Rick is going to tweak the Mapping Dashboard to give Donna more visibility of the final expected map figures (EXCLUDING "no target" maps which she would normally include in her figures but which we wouldn't see coming out of the Delta files)
  • ICD-10 - expecting 150 ish changes (ICD-10 - expecting 315 ish changes (plus tonight's drip feed) due to large number of intentional inactivations this cycle
  • No expected issues this cycle...
    • Confirmed in final numbers!

***** NOTE:  Make sure we keep an eye on the upgrade to ICD-0 version 3.2/3.4/4.0, as it "MAY" happen at some point in 2023 (though unlikely now) *****

  • Hi @Andrew @WCI support This is the comment I was referring to so lets say any deprecation or new map to 3.2 is "unlikely" ICD-O-3.2 is out of numbers. So, multiple histologies that are different entities are being lumped together at the moment.
  • ICD-O-4 should address this many-to-one lumping and the comment version should be available by the end of the year.
  • The Blue Book 5th edition is still in Beta, and the ICD-3.2 codes assigned to each morphology by chapter are not completely correct and subject to change.
  • We decided on our call yesterday with Jim Case's comments taken into consideration that we will focus on the map to 4 along with the histology quality work. A reverse map to 3.2 will be possible at that point and be straight forward to complete. So, we will not be spending much, if any, time on further 3.2 work

June 2023 release - ICD-O no new maps for June.  

New content was added, promoted to main and has since been deleted, the content was mapped, 16 concepts:

April 2023:

  • ICD-0 - 6 new records + 2 inactivations expected
    • + for the specific fixes for this cycle we're expecting 7 records that should have been inactivated in March but were not, but should be now
    • + Rick is going to tweak the Mapping Dashboard to give Donna more visibility of the final expected map figures (EXCLUDING "no target" maps which she would normally include in her figures but which we wouldn't see coming out of the Delta files)
  • ICD-10 - expecting 537 ish changes (plus tonight's drip feed) due to large number of intentional inactivations this cycle
  • No expected issues this cycle...
    • Confirmed in final numbers!

May 2023:

  • ICD-0 - 3 new records + 0 inactivations expected
    • + Rick is going to tweak the Mapping Dashboard to give Donna more visibility of the final expected map figures (EXCLUDING "no target" maps which she would normally include in her figures but which we wouldn't see coming out of the Delta files)
  • ICD-10 - expecting 150 ish changes (plus tonight's drip feed) due to large number of intentional inactivations this cycle
  • No expected issues this cycle...
    • Confirmed in final numbers!

***** NOTE:  Make sure we keep an eye on the upgrade to ICD-0 version 3.2/3.4/4.0, as it "MAY" happen at some point in 2023 (though unlikely now) *****

  • Hi @Andrew @WCI support This is the comment I was referring to so lets say any deprecation or new map to 3.2 is "unlikely" ICD-O-3.2 is out of numbers. So, multiple histologies that are different entities are being lumped together at the moment.
  • ICD-O-4 should address this many-to-one lumping and the comment version should be available by the end of the year.
  • The Blue Book 5th edition is still in Beta, and the ICD-3.2 codes assigned to each morphology by chapter are not completely correct and subject to change.
  • We decided on our call yesterday with Jim Case's comments taken into consideration that we will focus on the map to 4 along with the histology quality work. A reverse map to 3.2 will be possible at that point and be straight forward to complete. So, we will not be spending much, if any, time on further 3.2 work

June 2023 release - ICD-O no new maps for June.  

New content was added, promoted to main and has since been deleted, the content was mapped, 16 concepts:

  • Postpartum acute cystitis (disorder) 10752111000119109
  • Postpartum anxiety (finding) 10756431000119109
  • Postpartum bacterial vaginosis (disorder) 10752211000119104
  • Postpartum calculus of gallbladder (disorder) 10754741000119103
  • Postpartum cellulitis of breast
  • Postpartum acute cystitis (disorder) 10752111000119109
  • Postpartum anxiety (finding) 10756431000119109
  • Postpartum bacterial vaginosis (disorder) 10752211000119104
  • Postpartum calculus of gallbladder (disorder) 10754741000119103
  • Postpartum cellulitis of breast (disorder) 10751991000119105
  • Postpartum cholestasis (disorder) 10753141000119100
  • Postpartum disorder of lactation (disorder) 15755591000119106
  • Postpartum edema (disorder) 16737621000119100
  • Postpartum heart murmur (finding) 10755991000119107
  • Postpartum hyperthyroidism (disorder) 10754961000119101
  • Postpartum hypothyroidism (disorder) 10753681000119101
  • Postpartum inflammation of cervix uteri (disorder) 10752031000119100
  • Postpartum iron deficiency anemia (disorder) 10755381000119108
  • Postpartum mood disorder (disorder) 10755001000119102
  • Postpartum thyroid disease (disorder) 10757711000119106
  • Pain during postpartum period due to and following cesarean section (finding) 10756061000119109

These concepts may impact mapping numbers for June release.

July 2023 release - Donna is on leave but sent these notes:

  • GMDN is complete and ready for the July release to progress.
  • ICD-10 has no unmapped concepts but final few tomorrow to map/review before 12:00 noon.
  • Mapped 3 concepts in the ICD-O map waiting for Nicki to review.
  • Estimated numbers for ICD-10 roughly 335 and ICD-O 4 new concepts but potentially only 2 are classifiable.
  • No problems I can see with completing ready for the release to progress

Chris will contact Rick via slack to schedule timing for Rundeck.

September 2023 release - 

  • GMDN is complete and ready for the July release to progress.
  • ICD-10 has no unmapped concepts but final few tomorrow to map/review before 12:00 noon.
  • Mapped 1 concepts in the ICD-O map waiting for Nicki to review.
  • Estimated numbers for ICD-10 roughly 540 and ICD-O 1 new concepts but potentially only 0 are classifiable
    • *This means it won't show up in the stats! *
  • No problems I can see with completing ready for the release to progress

Rick raised a risk that the 0901 date could cause issues with map scripts - Chris Morris already aware and has made pre-emptive changes, but could still be an issue... we will find out tomorrow (Friday) when the email comes out with the Map stats reports - if they have the right date then it'll be fine...  If not, RICK will go in and manually fix it...

October 2023 release   

Invalid New content was added (authored by 3M but promoted by internal authors), promoted to main and has since been deleted, the content was mapped, 18 concepts:

  • 1290139003|Reactive arthritis of hip joint (disorder)
  • 104671000119108|Reactive arthritis of joint of ankle (disorder)
  • 1290146007|Reactive arthritis of joint of elbow (disorder)
  • 1290138006|Reactive arthritis of knee joint (disorder)
  • 1290145006|Reactive arthritis of glenohumeral joint (disorder)
  • 16047151000119104 |Hydroxyapatite deposition disease of bilateral hip joints (disorder)|
  • 16046311000119104 |Hydroxyapatite deposition disease of left hip joint (disorder)|
  • 16047191000119109 |Hydroxyapatite deposition disease of right hip joint (disorder)|
  • 16046431000119103 |Hydroxyapatite deposition disease of joint of bilateral ankles (disorder)|
  • 16046551000119105 |Hydroxyapatite deposition disease of joint of right ankle (disorder)|
  • 16046871000119103 |Hydroxyapatite deposition disease of joint of left ankle (disorder)|
  • 16046511000119109 |Hydroxyapatite deposition disease of joint of bilateral hands (disorder)|
  • 16046711000119103 |Hydroxyapatite deposition disease of joint of left hand (disorder)|
  • 16047071000119107 |Hydroxyapatite deposition disease of joint of right hand (disorder)|
  • 16046831000119101 |Hydroxyapatite deposition disease of joint of bilateral feet (disorder)|
  • 1288004000 16046711000119103 |Hydroxyapatite deposition disease of joint of left hand (disorder)|
  • 16046791000119107 16047071000119107 |Hydroxyapatite deposition disease of joint of right foot hand (disorder)|16047231000119100
  • 16046831000119101 |Hydroxyapatite deposition disease of joint of left foot bilateral feet (disorder)|

So we need to ensure that:

  • 1288004000 |Hydroxyapatite deposition disease of joint of hand (disorder)|
  • 16046791000119107 |Hydroxyapatite deposition disease of joint of right foot (disorder)|
  • 16047231000119100 |Hydroxyapatite deposition disease of joint of left foot (disorder)|

So we need to ensure that:

  1. None of the above maps are actually propagated through to the Release content, plus
    1. AAT spot checked in
  2. None of the above maps are actually propagated through to the Release content, plus
    1. AAT spot checked in PreProd release on 11/9/23 - could not find any of the concepts above in the final Map files
  3. The predicted figures from Mapping are adjusted accordingly to remove these 18 changes (which are no longer part of MAIN)
    1. However, Rick is going to reload the DailyBuild from tonight, and therefore the Mapping Stats Report should (in theory) take account of their removal from MAIN, but the time they're run tomorrow (Friday 8th)
    2. AAT checked final Map tool figures against PreProd release on 11/9/23 - all Reported figures match could not find any of the concepts above in the final Map files as expected

1x ICD0 Map record showing as Non-classifiable so the counts again will need to be readjusted.

Donna to confirm final figures tomorrow...
  2. The predicted figures from Mapping are adjusted accordingly to remove these 18 changes (which are no longer part of MAIN)
    1. However, Rick is going to reload the DailyBuild from tonight, and therefore the Mapping Stats Report should (in theory) take account of their removal from MAIN, but the time they're run tomorrow (Friday 8th)
    2. AAT checked final Map tool figures against PreProd release on 11/9/23 - all Reported figures match
    final Map files as expected
5Brief run through of the known issues already identified by the content team during the QA batch process, to ensure that technical team are aware of them, and can either resolve them in time for the release, or confirm as known issues.6DevOps resource confirmed
7Versioning and Change Freeze

Plan is to follow the new processes as now defined:

8Stats Report

Reports run via the reporting platform:

Summary Component stats for edition 5 October 2023

https://docs.google.com/spreadsheets/d/1KEpagTylxWV3a2Z0R5xUB1MxhKbd1vP3EEpzCKiuoYo/edit?usp=sharing

    1. final Map files as expected

1x ICD0 Map record showing as Non-classifiable so the counts again will need to be readjusted.

Donna to confirm final figures tomorrow...

  1. AAT checked final Map tool figures against PreProd release on 11/9/23 - all Reported figures match final Map files as expected

November 2023 release - 

  • ICD-10 has no unmapped concepts but final few tomorrow to map/review before 12:00 noon.
  • Mapped 60 concepts in the ICD-O map waiting for Nicki to review.
  • Estimated numbers for ICD-10 roughly 210 new concepts 
  • No problems I can see with completing ready for the release to progress
  • FINAL FIGURES FROM PREPROD RELEASE:
    • ICD-0:
      • 39 records new/updated + 
      • 2 records inactivated
    • ICD-10:
      • 248 records new/updated + 
      • 65 records inactivated
  • TWO DIFFERENT FAILURES FOR SAME MAP RECORD IN THE RELEASE VALIDATION:
    • ISRS-1664
    • ISRS-1665
    • RESOLUTION:  SNOMED International Mapping Team confirmed that this situation is valid and therefore no action is required (ISRS-1663)


5Brief run through of the known issues already identified by the content team during the QA batch process, to ensure that technical team are aware of them, and can either resolve them in time for the release, or confirm as known issues.



6DevOps resource confirmedChris to do this release
7Versioning and Change Freeze

Plan is to follow the new processes as now defined:

8Stats Report

Reports run via the reporting platform:

Summary Component stats for edition 6 October 2023

https://docs.google.com/spreadsheets/d/10XE3I9bYMs_kvvh0p0htWxKwngrhy1z-PBxyNI5JZnY/edit?usp=sharing

9Risks



10AOB

1. Release notes SNOMED CT November 2023 International Edition - SNOMED International Release notes

9Risks10AOB

1. Release notes SNOMED CT October 2023 International Edition - SNOMED International Release notes

2. Rick raised risk that the Daily Build upload script may still be using the Last of the Month dates instead of the new First of the month - Chris to verify... RECEIVED RESOLUTION CONFIRMATION FROM CHRIS on 7/9/23:

"Auto Run and Reload" job has been updated with the same fix as we did last month for the "Generate release and upload to Snowstorm" job, details added to that ticket for info -  Image RemovedINFRA-11292 - Updating RunDeck job: "Generate release and upload to Snowstorm" CLOSED

SIGNED OFF ON 12/9/23 WITH THE PROVISO THAT Maria + Yong WOULD FIND NO NEW ISSUES IN THEIR REVIEW OF THE MRCM CHANGES THIS AFTERNOON......