SNOMED International Release Management

Page tree

Versions Compared

Old Version 13

changes.mady.by.user Andrew Atkinson

Saved on

compared with

New Version Current

changes.mady.by.user Andrew Atkinson

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Date of Initial Handover meeting: 7 September 2023

Date of Final Handover meeting: 12 September 2023

Attendees


Page properties


Handover Status

FINAL HANDOVER COMPLETE



Agenda

 

Items to be discussed

Actions

1

Prerelease Content Management Activities:

  1. Inactivate the root concept synonym referencing previous release, and add synonym to reference current release.
  2. Update copyright date on synonym (January releases only)
  3. Generate + Validate SEP Refsets
  4. Generate + Validate Lateralizable Refset
  5. Content Team to confirm to Release Manager that 4x MRCM refset files are complete and ready to be released (they are then extracted from the termServer during release builds via the termServer Export)
  1. MBR - root synonym - 5268601017 SNOMED Clinical Terms version: 20231001 [R] (October 2023 Release) https://authoring.ihtsdotools.org/#/tasks/task/DAILYPROMO/DAILYPROMO-5382/edit
  2. MBR - root copyright date - not required
  3. SEP - https://docs.google.com/spreadsheets/d/1hAy60SYrffTpwCp71so8UKIB_Hpx6hchaEaxl6gSCxcIXRC1GdA5lNK06fgrMRGoadTT3oaKQnyfnvV9VzvYTY/edit?usp=sharing
  4. Laterality - https://docs.google.com/spreadsheets/d/1hAy60SYrffTpwCp71so8UKIB_Hpx6hchaEaxl6gSCxcIXRC1GdA5lNK06fgrMRGoadTT3oaKQnyfnvV9VzvYTY/edit?usp=sharing
2

Discussion of existing Known Issues from the previous Release

  1. Traceability issues for January 2023 release - NONE.
  2. Traceability issues for February 2023 release - https://jira.ihtsdotools.org/browse/FRI-576 2 failures both confirmed as false positives by Michael.
  3. Traceability March 2023 release - NONE on MAIN (2 failures found on project confirmed false positives not seen in daily build after promotion https://jira.ihtsdotools.org/browse/INFRA-10533)
  4. Traceability for April 2023 release - 8 failures on main checked and false positives, ticket is here
    Jira
    serverIHTSDO JIRA
    serverIdb202d822-d767-33be-b234-fec5accd5d8c
    keyINFRA-10712
  5. Traceability for May 2023 release - NONE
  6. Traceability for June 2023 release - https://jira.ihtsdotools.org/browse/INFRA-11004 these are valid warnings relating to the MRCM changes.
  7. Traceability for July 2023 release - 2 failures

    https://jira.ihtsdotools.org/browse/INFRA-11186 checked and false positives

  8. Traceability for September 2023 release - 3 failures false positives
    Jira
    serverIHTSDO JIRA
    serverIdb202d822-d767-33be-b234-fec5accd5d8c
    keyINFRA-11323
    Jira
    serverIHTSDO JIRA
    serverIdb202d822-d767-33be-b234-fec5accd5d8c
    keyINFRA-11339
    Jira
    serverIHTSDO JIRA
    serverIdb202d822-d767-33be-b234-fec5accd5d8c
    keyINFRA-11347
    Jira
    serverIHTSDO JIRA
    serverIdb202d822-d767-33be-b234-fec5accd5d8c
    keyINFRA-11351
    Also MRCM traceability expected changes checked here
    Jira
    serverIHTSDO JIRA
    serverIdb202d822-d767-33be-b234-fec5accd5d8c
    keyINFRA-11294
  9. Traceability for October 2023 release -
    1. MRCM traceability failures https://jira.ihtsdotools.org/browse/ATF-1678
    2. MRCM traceability failures https://jira.ihtsdotools.org/browse/INFRA-11496
      1. (both standard, expected warnings when MRCM changes are promoted)
    3. Traceability false positives https://jira.ihtsdotools.org/browse/INFRA-11526
    4. Traceability valid issues resolved https://jira.ihtsdotools.org/browse/INFRA-11549
      1. Unexpected issues with inferred records - fixed in a RELVAL task and promoted to MAIN, so just need to watch out for similar issues in Release Val


3

Content Validation 

  1. Instead of usual manual Content validation, we now just need confirmation that all Projects had automated validation run against them, and were clean before promotion.
  2. New Issues identified by the community from the previous Monthly Release.
    1. Decision on whether to fix the issues:
      1. VERY QUICKLY in time for this upcoming release?
      2. In good time for the next monthly release?
  1. RVF failures -
    Jira
    serverIHTSDO JIRA
    serverIdb202d822-d767-33be-b234-fec5accd5d8c
    keyINFRA-11526
    false positives
  2. Ref set description changes October 2023 release - none found in descriptions report https://docs.google.com/spreadsheets/d/1_-LeGdVX-V5KOeBn95eXFu6JmgHgSvobRULzY-6lXoE1Bl5hKo-ZXhWwixCiU8FKDK2LHLVWjCpkBBYjPr6hhwY/edit#gid=0
  3. NEW and CHANGED MRCM report -https://docs.google.com/spreadsheets/d/1l2ftpbxzYyu9yOPAEvDOaNiArzVrNDEE16p7FbAoRso/edit#gid=0 sent 114B51X8HokMEX-5ZW-0-9bPwQSi1MTkU8g6M5l-1tRY/edit?usp=sharing sent to Yong for review- There is one issue with the proximal primitive refinement. It has existed for a while. We can fix it in the next release, as we discussed. The rest of the changes are expected. - will wait for November release to resolve.
  4. MRCM changes for October 2023 - https://jira.ihtsdotools.org/browse/ATF-167 and https://jira.ihtsdotools.org/browse/INFRA-11496


4Mapping schedule

January 2023:

  • ICD-0 - 1 new records + 0 inactivations expected
  • ICD-10 - expecting 550 ish changes (plus tonight's drip feed) due to large number of intentional inactivations this cycle
  • No expected issues this cycle...
    • Confirmed in final numbers!

February 2023:

  • ICD-0 - 1 new records + 0 inactivations expected
  • ICD-10 - expecting 500 ish changes (plus tonight's drip feed) due to large number of intentional inactivations this cycle
  • No expected issues this cycle...
    • Confirmed in final numbers!

March 2023:

  • ICD-0 - 2 new records + 0 inactivations expected
  • ICD-10 - expecting 315 ish changes (plus tonight's drip feed) due to large number of intentional inactivations this cycle
  • No expected issues this cycle...
    • Confirmed in final numbers!

April 2023:

  • ICD-0 - 6 new records + 2 inactivations expected
    • + for the specific fixes for this cycle we're expecting 7 records that should have been inactivated in March but were not, but should be now
    • + Rick is going to tweak the Mapping Dashboard to give Donna more visibility of the final expected map figures (EXCLUDING "no target" maps which she would normally include in her figures but which we wouldn't see coming out of the Delta files)
  • ICD-10 - expecting 537 ish changes (plus tonight's drip feed) due to large number of intentional inactivations this cycle
  • No expected issues this cycle...
    • Confirmed in final numbers!

May 2023:

  • ICD-0 - 3 new records + 0 inactivations expected
    • + Rick is going to tweak the Mapping Dashboard to give Donna more visibility of the final expected map figures (EXCLUDING "no target" maps which she would normally include in her figures but which we wouldn't see coming out of the Delta files)
  • ICD-10 - expecting 150 ish changes (plus tonight's drip feed) due to large number of intentional inactivations this cycle
  • No expected issues this cycle...
    • Confirmed in final numbers!

***** NOTE:  Make sure we keep an eye on the upgrade to ICD-0 version 3.2/3.4/4.0, as it "MAY" happen at some point in 2023 (though unlikely now) *****

  • Hi @Andrew @WCI support This is the comment I was referring to so lets say any deprecation or new map to 3.2 is "unlikely" ICD-O-3.2 is out of numbers. So, multiple histologies that are different entities are being lumped together at the moment.
  • ICD-O-4 should address this many-to-one lumping and the comment version should be available by the end of the year.
  • The Blue Book 5th edition is still in Beta, and the ICD-3.2 codes assigned to each morphology by chapter are not completely correct and subject to change.
  • We decided on our call yesterday with Jim Case's comments taken into consideration that we will focus on the map to 4 along with the histology quality work. A reverse map to 3.2 will be possible at that point and be straight forward to complete. So, we will not be spending much, if any, time on further 3.2 work

June 2023 release - ICD-O no new maps for June.  

New content was added, promoted to main and has since been deleted, the content was mapped, 16 concepts:

  • Postpartum acute cystitis (disorder) 10752111000119109
  • Postpartum anxiety (finding) 10756431000119109
  • Postpartum bacterial vaginosis (disorder) 10752211000119104
  • Postpartum calculus of gallbladder (disorder) 10754741000119103
  • Postpartum cellulitis of breast (disorder) 10751991000119105
  • Postpartum cholestasis (disorder) 10753141000119100
  • Postpartum disorder of lactation (disorder) 15755591000119106
  • Postpartum edema (disorder) 16737621000119100
  • Postpartum heart murmur (finding) 10755991000119107
  • Postpartum hyperthyroidism (disorder) 10754961000119101
  • Postpartum hypothyroidism (disorder) 10753681000119101
  • Postpartum inflammation of cervix uteri (disorder) 10752031000119100
  • Postpartum iron deficiency anemia (disorder) 10755381000119108
  • Postpartum mood disorder (disorder) 10755001000119102
  • Postpartum thyroid disease (disorder) 10757711000119106
  • Pain during postpartum period due to and following cesarean section (finding) 10756061000119109

These concepts may impact mapping numbers for June release.

July 2023 release - Donna is on leave but sent these notes:

  • GMDN is complete and ready for the July release to progress.
  • ICD-10 has no unmapped concepts but final few tomorrow to map/review before 12:00 noon.
  • Mapped 3 concepts in the ICD-O map waiting for Nicki to review.
  • Estimated numbers for ICD-10 roughly 335 and ICD-O 4 new concepts but potentially only 2 are classifiable.
  • No problems I can see with completing ready for the release to progress

Chris will contact Rick via slack to schedule timing for Rundeck.

September 2023 release - 

  • GMDN is complete and ready for the July release to progress.
  • ICD-10 has no unmapped concepts but final few tomorrow to map/review before 12:00 noon.
  • Mapped 1 concepts in the ICD-O map waiting for Nicki to review.
  • Estimated numbers for ICD-10 roughly 540 and ICD-O 1 new concepts but potentially only 0 are classifiable
    • *This means it won't show up in the stats! *
  • No problems I can see with completing ready for the release to progress

Rick raised a risk that the 0901 date could cause issues with map scripts - Chris Morris already aware and has made pre-emptive changes, but could still be an issue... we will find out tomorrow (Friday) when the email comes out with the Map stats reports - if they have the right date then it'll be fine...  If not, RICK will go in and manually fix it...

October 2023 release   

Invalid New content was added (authored by 3M but promoted by internal authors), promoted to main and has since been deleted, the content was mapped, 18 concepts:

  • 1290139003|Reactive arthritis of hip joint (disorder)
  • 104671000119108|Reactive arthritis of joint of ankle (disorder)
  • 1290146007|Reactive arthritis of joint of elbow (disorder)
  • 1290138006|Reactive arthritis of knee joint (disorder)
  • 1290145006|Reactive arthritis of glenohumeral joint (disorder)
  • 16047151000119104 |Hydroxyapatite deposition disease of bilateral hip joints (disorder)|
  • 16046311000119104 |Hydroxyapatite deposition disease of left hip joint (disorder)|
  • 16047191000119109 |Hydroxyapatite deposition disease of right hip joint (disorder)|
  • 16046431000119103 |Hydroxyapatite deposition disease of joint of bilateral ankles (disorder)|
  • 16046551000119105 |Hydroxyapatite deposition disease of joint of right ankle (disorder)|
  • 16046871000119103 |Hydroxyapatite deposition disease of joint of left ankle (disorder)|
  • 16046511000119109 |Hydroxyapatite deposition disease of joint of bilateral hands (disorder)|
  • 16046711000119103 |Hydroxyapatite deposition disease of joint of left hand (disorder)|
  • 16047071000119107 |Hydroxyapatite deposition disease of joint of right hand (disorder)|
  • 16046831000119101 |Hydroxyapatite deposition disease of joint of bilateral feet (disorder)|
  • 1288004000 |Hydroxyapatite deposition disease of joint of hand (disorder)|
  • 16046791000119107 |Hydroxyapatite deposition disease of joint of right foot (disorder)|
  • 16047231000119100 |Hydroxyapatite deposition disease of joint of left foot (disorder)|

So we need to ensure that:

  1. None of the above maps are actually propagated through to the Release content, plus
    1. AAT spot checked in PreProd release on 11/9/23 - could not find any of the concepts above in the final Map files
  2. The predicted figures from Mapping are adjusted accordingly to remove these 18 changes (which are no longer part of MAIN)
    1. However, Rick is going to reload the DailyBuild from tonight, and therefore the Mapping Stats Report should (in theory) take account of their removal from MAIN, but the time they're run tomorrow (Friday 8th)
    2. AAT checked final Map tool figures against PreProd release on 11/9/23 - all Reported figures match final Map files as expected

1x ICD0 Map record showing as Non-classifiable so the counts again will need to be readjusted.

Donna to confirm final figures tomorrow...

  1. AAT checked final Map tool figures against PreProd release on 11/9/23 - all Reported figures match final Map files as expected


5Brief run through of the known issues already identified by the content team during the QA batch process, to ensure that technical team are aware of them, and can either resolve them in time for the release, or confirm as known issues.


6DevOps resource confirmedJoe
7Versioning and Change Freeze

Plan is to follow the new processes as now defined:


8Stats Report

Reports run via the reporting platform:

Summary Component stats for edition 7 8 September 2023

https://docs.google.com/spreadsheets/d/1nc_OiP-4FOi-2HUcbEQHh9_A3w3TVYPRiPI1wRk74JM/edit?usp=sharing1lkcsr5FRfgK2ArqgErOHiEv31y5VXx3cvR8VvHZ-GdI/edit#gid=0

9Risks10AOB
  1. Volume of Laterality and SEP refset changes (due to large Anatomy project change promotion) has caused problems in the AP with timing out of promotions
    1. For now we have worked around it, but requires Dev team to run
promotions
    1. SEP ref set update on Maria's behalf for now
    2. Requires AP fixes going forward
    3. However, Maria confirmed that she is comfortable with the final content changes now promoted to MAIN
  2. Inappropriate content being included in the lateralizable body structure reference set. Reported to us by NLM. Requires an update to the validation rules, the ticket is logged here
    Jira
    serverIHTSDO JIRA
    serverIdb202d822-d767-33be-b234-fec5accd5d8c
    keyVAL-334
2.
  1. Chris raised effective time change for next month, ok for July release however if naming the next release September 2023 may impact existing templates, any automated scripts, to discuss further on Tuesday final handover call probably ok but need to check.
  2. AAT found unexpectedly small number of Concrete Domain changes in October 2023 release - might be fine, best to check with Maria to ensure this is expected in a Release that otherwise contains a lot of change!  
    1. October 2023 = 18 records added/updated
    2. Prior Average  =  Several hundred / month
    3. MARIA CONFIRMED in Final Handover (12/9/23) that this was expected, as several large projects had been promoted for this release (hence the large volume of change in other files) but nothing in this area - so this is a valid state


10AOB


13. Release notes SNOMED CT October 2023 International Edition - SNOMED International Release notes

42. Rick raised risk that the Daily Build upload script may still be using the Last of the Month dates instead of the new First of the month - Chris to verify... RECEIVED RESOLUTION CONFIRMATION FROM CHRIS on 7/9/23:

"Auto Run and Reload" job has been updated with the same fix as we did last month for the "Generate release and upload to Snowstorm" job, details added to that ticket for info - 

Jira
serverIHTSDO JIRA
serverIdb202d822-d767-33be-b234-fec5accd5d8c
keyINFRA-11292


SIGNED OFF ON 12/9/23 WITH THE PROVISO THAT Maria + Yong WOULD FIND NO NEW ISSUES IN THEIR REVIEW OF THE MRCM CHANGES THIS AFTERNOON......