Page tree

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

TECHNICAL REVIEW

IssueResolution actions

ISRS-85

Born inactive stated relationships found for PreAlpha20170131 release

https://docs.google.com/spreadsheets/d/1hUA7jb-MBtH5XRIy2Pm-mwSUWxEgqpprlaA2eY94YwQ/edit#gid=1362981644

RESOLUTION: Relevant born inactive relationships deleted.

MCH - These born inactive concepts and stated relationships were not identified during authoring validation due to we don't run these type of assertions as they compare against previous release package which slows down the validation process. Maybe we should consider to update existing assertions so that they can be run at task/project level validations as well. These assertions are run during the daily release build.

AAT - we therefore asked Monica/Donna whether or not we have scope to have the RVF slightly in order to cover these issues as part of the authoring task validation. Monica confirmed this would not be possible if these do slow down the validation process.

  • ACTION: MCH therefore will look into whether there is an alternative way of running these 4 assertions without including other "release type" validations (more than 80) that compare current content against previous release. At the meantime Michael will walk through using the Daily Build RVF results with Monica, which will give them quick access to the same results.

ISRS-86

Born inactive concepts found for preAlpha 20170131 release

717739000 20170131 0 900000000000207008 900000000000074008
717747000 20170131 0 900000000000207008 900000000000074008

RESOLUTION: Relevant born inactive concepts deleted.

Same as above

ISRS-99

The following new RVF failure appeared after applying the Alpha feedback fixes that the Content Team implemented:

testCategory: "release-type-validation",
assertionUuid: "89ceaf00-79b9-11e1-b0c4-0800200c9a66",
assertionText: "All stated relationships inactivated in current release must have been active in the previous release.",
queryInMilliSeconds: 4513,
failureCount: 12,

RESOLUTION: 12 Relationships deleted completely, as they were new to the 20170131 Release cycle, and therefore not previously published.

Same as above

ISRS-100

The following RVF failure was newly added after the Alpha fixes that the Content Team implemented:

testCategory: "release-type-validation",
assertionUuid: "5f1a51a3-6200-4463-8799-d75998165278",
assertionText: "New inactive states follow active states in the CONCEPT snapshot.",
queryInMilliSeconds: 91168,
failureCount: 1,
firstNInstances: { conceptId: 723067001, detail: "CONCEPT: id=723067001: is inactive but no active state found in the previous release." }

RESOLUTION: Concept 723067001 deleted completely, as it was new to the 20170131 Release cycle, and therefore not previously published.

Same as above

ISRS-113

Six concepts are in the 'SNOMED CT model component module (core metadata concept)' module but the relationships in question here are in the 'SNOMED CT core module (core metadata concept)' module. The associated descriptions are all in the same module as the concept entries.

718291003 
718292005
718497002
715502004
715515008
900000000000441003

RESOLUTION: 5 Inferred relationships have been inactivated, and 5 new ones activated with the correct module ID, in order to align the Concept moduleID with the related Relationship moduleID's.

The final concept (900000000000441003) is the Model Component concept, and therefore has its Relationship in the Core module and not the Model Component module for a valid reason, as follows:

• The 2 root modules (Core and Model Component) were setup in the first place so that the Core was dependent on the Model Component module
• This meant that you could distribute the Model Component module standalone, but not the Core module
• Therefore all of the components of this Concept reside correctly in the Model Component module
• However, the Relationship cannot reside inside the Model Component module, as if this module is then distributed standalone the relationship would be a broken one, as the concept it relates to would be inside the Core module and not part of the Model Component module

The only action taken for this concept, therefore, was to update the comments in the code to ensure that this valid state is retained going forward.

 This was a defect in the classifier wrapper, which MCH has now resolved.

ISRS-103, ISRS-104, ISRS-106, ISRS-107, ISRS-108, ISRS-109 and ISRS-110

These are all to be ignored as warnings - do we need to whitelist these? (especially as we've now open-sourced the RVF)

Some of these can be fixed by whitelisting, but some are restraints in the assertions - so we need to fix them. The whitelisting framework is still a reasonably long way away due to capacity - most likely Q3/Q4 2017.

The Release Feedback process is labour intensive and could be refined
  • Action: AAT to setup meeting at the April conference to improve the process (Michael is currently testing a new option in UAT)
  • AAT also to give the requirements for the long term automation in this area to Hunter MacDonald...


CONTENT REVIEW

IssueResolution actions

ISRS-45

Three retired concepts have a historical relationship of an inappropriate type:
139521000
267174001
700043003

RESOLUTION: IHTSDO Content Team resolved as follows:

139521000: Tingling: [sensation] or [has sensation] (finding) now retired as ambiguous
267174001: Tingling: [sensation] or [has sensation] (finding) now retired as amibiguous
(both with Possibly equivalent to 274676007 Tingling of skin (finding))

The third concept (700043003) was found to be valid, and therefore no action required

Simply a genuine human error, so the content team will improve the editorial guidance in order to prevent these issues going forward.

ISRS-46

Ten RF1 descriptions for active concepts are status 10 (MOVED_TO), alongside descriptions with active status:
473038012: Hyperprolinemia type II
473040019: Hyperprolinemia, type II
357693015: Lichen planus pigmentosus
377070012: Joubert syndrome
378213010: Irapa type spondyloepimetaphyseal dysplasia
1787720010: Frontal fibrosing alopecia
473039016: Hyperprolinaemia type II
473043017: Hyperprolinaemia, type II
113698011: Warkany syndrome
187742012: Caroli's disease

RESOLUTION: IHTSDO Content team have inactivated all of the descriptions in question with reason "moved elsewhere"

 The Task originally created to resolve this issue somehow got deleted as part of the process, and so never made it into the Jan 2017 Release.

ISRS-47

Three concepts in RF1 have more than one historical relationship (except MAY_BE_As, MOVED_TOs OR WAS_As):
79965005
137650007
410068002

RESOLUTION: IHTSDO Content Team remodelled so that the three concepts now have one reason for inactivation and one historical relationship each as appropriate.

Simply a genuine human error, so the content team will improve the editorial guidance in order to prevent these issues going forward.

ISRS-53

As part of the previous editing cycle, a minor issue was found with several relationships, which had targets with different semantic tags to their sources. In discussion with the Content Team at the time, we agreed to fix all but one, which was seen to be an example of the exception to the rule, and therefore a valid relationship to retain:

id effectiveTime active moduleId sourceId destinationId relationshipGroup typeId characteristicTypeId modifierId
6598284022 20160731 1 900000000000207008 718447001 363013003 0 116680003 900000000000011006 900000000000451002

RULEID SCTID DETAILS TERMLIST
187 718447001 718447001 (finding) : 363013003 (disorder) 718447001: Difficult intubation (finding) - 363013003: Complication of introduction procedure (disorder) 9

RESOLUTION: IHTSDO Content Team remodelled this concept and removed the disorder parent.

Simply a genuine human error, so the content team will improve the editorial guidance in order to prevent these issues going forward.

ISRS-89

The following 3 concepts had the Core module assigned to them during authoring, instead of the Concept Model module:

719367001
720486002
723282003

RESOLUTION: 3 records updated to the correct ModuleID in the Concept Delta file in the Beta release

These were not assigned, the tool defaulted to the incorrect module ID even when a concept was cloned. Core module vs Model component. This should be default as per hierarchy selected. This was a new item introduced by SCA. Previously it was not a choice for an author to make. Now the team are aware and guidance has been written into the Ed. guide.

  • Action: Monica to continue to chase SCA ticket for improvement
ISRS-90

The concept 722541007 has concept modeling of Causative agent (attribute) = Infectious process (qualifier value). The value "infectious process" should not be allowed because it is not in the range for causative agent.

RESOLUTION: Relationship record deleted, to remove the erroneous attribute Causative agent (attribute)

This was identified by the new MRCM validation, and therefore the long term solution for this is to get the MRCM rules into both the SCA input validation, and the RVF, so that these issues can be resolved as part of the editing cycle going forward.

ISRS-91

The concept 723017008 has After (attribute) = Intraocular lens implant (physical object). This violated the range for After attribute that should only take values from clinical finding hierarchy or procedure hierarchy.

RESOLUTION: Relationship record updated, to change the erroneous attribute Intraocular lens implant (physical object) (313236002), and add in the new attribute 69724002|Insertion of prosthetic intraocular lens (procedure)|

MRCM rules ought to pick this up or not allow improper selection. Batch uploads bypass the MRCM rules therefore these can slip through.

Since this occurred, the validation of ICD-11 has been changed from small amounts of spot checks to thorough checking by the ICD-11 authors.

ISRS-92

A new concept - 723067001 | Transcatheter aortic valve replacement (procedure) | - is a duplicate and so has been inactivated within the same authoring cycle.

RESOLUTION: Concept deleted completely, as it was new to the 20170131 Release cycle, and therefore not previously published.

This was not a duplicate in fact but in as much as it was questioned by an member from a clinical perspective so the right thing to do was to pull it back till further investigation of meaning was carried out.

Therefore this was a one off and will not re-occur.

ISRS-93

ADHA ran the alpha package through their validation routines. Technically, it passed – from a content persective there looks like a number of concept model violations..

· AFTER(255234002) - only modelled with valid destination concepts
6795991026 Displacement of intraocular lens (disorder) After (attribute) Intraocular lens implant (physical object)

RESOLUTION: 1 Relationship deleted completely, as it was new to the 20170131 Release cycle, and therefore not previously published.

Same as ISRS 91:

Do these ADHA-discovered issues need to be covered in our input validation and/or the RVF?

ISRS-94

ADHA ran the alpha package through their validation routines. Technically, it passed – from a content persective there looks like a number of concept model violations..

· CAUSATIVE AGENT(246075003) - only modelled with valid destination concepts
6806717028 Megacolon co-occurrent and due to infectious colitis (disorder) Causative agent (attribute) Infectious process (qualifier value)

RESOLUTION: 1 Relationship record updated, in order to replace the Causative agent attribute with Pathological process.

Same as ISRS 90:

Do these ADHA-discovered issues need to be covered in our input validation and/or the RVF?

ISRS-95

ADHA ran the alpha package through their validation routines. Technically, it passed – from a content persective there looks like a number of concept model violations...

· HAS INTERPRETATION(363713009) - only modelled with valid destination concepts
6795824028 Androgen excess caused by drug (finding) Has interpretation (attribute) Androgen level (procedure)
6799904021 Transient neonatal neutropenia co-occurrent and due to neonatal bacterial sepsis (finding) Has interpretation (attribute) Neutrophil count (procedure)
6804767021 Transient neonatal neutropenia due to congenital viral infection (finding) Has interpretation (attribute) Neutrophil count (procedure)

RESOLUTION: 3 records removed, plus 3 records added in the Relationship and Stated Relationship Delta files in the Beta release, in order to change the attribute to "Interprets".

 Do these ADHA-discovered issues need to be covered in our input validation and/or the RVF?


ICD-11 batch allows incorrect attributes to be selected.

ISRS-96

ADHA ran the alpha package through their validation routines. Technically, it passed – from a content persective there looks like a number of concept model violations..

· OCCURRENCE(246454002) - only modelled with valid destination concepts
6622179020 Acquired postural plagiocephaly (disorder) Occurrence (attribute) Acquired (qualifier value)
6646405025 Acquired arteriovenous malformation (disorder) Occurrence (attribute) Acquired (qualifier value)

RESOLUTION: 2 Relationships deleted completely, as they were new to the 20170131 Release cycle, and therefore not previously published.

 Do these ADHA-discovered issues need to be covered in our input validation and/or the RVF?

ICD-11 batch allows incorrect attributes to be selected. This is partly due to the fact that an allowable value for this attribute is CONGENITAL so it is easy to presume that ACQUIRED would belong here too.

Guidance has been clarified in the Ed. guide.

ISRS-97 

ADHA ran the alpha package through their validation routines. Technically, it passed – from a content perspective there looks like a number of concept model violations..

I’ve got almost 700 observable entity concepts failing the tests below… but…

· observable entity(363787002) only approved defining attributes used
· COMPONENT(246093002) - only modelled with valid source concepts
· SCALE TYPE(370132008) - only modelled with valid source concepts
· TIME ASPECT(370134009) - only modelled with valid source concepts
· USING DEVICE(424226004) - only modelled with valid source concepts
· All concepts within hierarchies without information models are primitive|900000000000074008| or are concepts with less than 2 |Is a| relationships
· Only concepts within hierarchies with information models are defined|900000000000073002| or are concepts with 2 or more |Is a| relationships
It’s likely the concept model here has been updated, and our tests need updating… However, I’ve just checked the most editorial guide and it still lists Observable entity in Table 5 as a “Top-Level Hierarchies That Have No Defining Attributes”.

RESOLVED: This was traced back to a change that was made to the Concept model for Observables, that was implemented in September 2016. The editorial guide was updated accordingly, but has not been published since the update was made, and so ADHA did not have visibility of the updates. IHTSDO therefore provided them with the information on the new Concept model, and they will update their validation rules accordingly. This is therefore a non-issue and no action is required.

 Do these ADHA-discovered issues need to be covered in our input validation and/or the RVF?


Publish the updated editorial guidance along with the Alpha release.

ISRS-101

The following RVF failure is now reporting 7 Active Descriptions that have Inactivation reasons assigned to them:

assertionText: "Active descriptions do not have active inactivation indicators",
queryInMilliSeconds: 6970,
failureCount: 7,

Either the Descriptions need to be inactivated accordingly, or the reasons updated/removed as the Descriptions should remain Active.

RESOLUTION: 6 Inactivation reasons were inactivated (as they were previously published), and 1 was deleted (as it was new to this release cycle).

  • Action: Monica to test this in UAT SCA, and if it still causes issues with the invalid inactivation reasons being created then she will raise an SCA bug ticket - if not then we know this was a one-off issue and will not re-occur.

ISRS-111

The new refset being added to the January 2017 International Edition (723264001 - Lateralizable body structure reference set (foundation metadata concept)) needs a new record added to the International edition refsetDescriptor files.

RESOLUTION: The following refsetDescriptor record has been added accordingly:

bbdcc9fc-5bc6-415a-a5ee-c5adfc569bd5 20170131 1 900000000000207008 900000000000456007 723264001 449608002 900000000000461009 0

This kind of issue is now being addressed by the new Service Acceptance process, which will prevent these kind of pre-dependencies from being missed at the start of projects.

ISRS-114

5251000119108 |Acquired arteriovenous malformation (disorder)| incorrectly uses 255396000 |Acquired (qualifier value)| as the value of |Occurrence|

IHTSDO removed attribute value pair of Occurrence - Acquired.

Concept therefore needs to be changed to primitive.

The related concept, 402847002 |Acquired arteriovenous malformation of the skin (disorder)| was also identified to have an invalid attribute.

RESOLUTION: Both concepts have been remodelled accordingly.

Same as ISRS-96

ISRS-115

Three retired metadata concepts were erroneously moved into the Core module:

CONCEPTID CONCEPTSTATUS FULLYSPECIFIEDNAME
447564002 1 Non-human simple reference set
(foundation metadata concept)
449609005 1 ICD-10 map category reference set
(foundation metadata concept)
700043003 5 Example problem list concepts reference
set (foundation metadata concept)

These metadata concepts were transferred into the core module when they became inactive, so the RF1 conversion tool thinks they're relevant. The RF1 conversion filters out concepts with a metadata semantic tag, but only if they're also in the model module.

RESOLUTION: ModuleID for all three concepts assigned to the Model Component module (900000000000012004).

Simply a genuine human error, so the content team will improve the editorial guidance in order to prevent these issues going forward.

ISRS-117

There are 21 Historical Associations that are active, but which have been found to have inactive concepts for their targetComponentID:

id effectivetime active moduleid refsetid referencedcomponentid targetcomponentid
817ddce9-894d-54b3-84ee-4a94cee2acb5 20100131 1 900000000000207008 900000000000528000 193369009 399625000
946f56dc-684d-5cad-99c7-6f3f5e202a73 20100131 1 900000000000207008 900000000000528000 204273002 204270004
a7d5339d-d51d-5a1f-865c-0bce6af6da90 20100131 1 900000000000207008 900000000000528000 138107003 81877007
acfbb45c-a1b1-5b08-b8a9-1e6e0f0a2ca0 20100131 1 900000000000207008 900000000000528000 137020000 265987007
ad545d56-19c0-5a57-bed4-d0a946d24d79 20100131 1 900000000000207008 900000000000528000 193371009 399625000
b463afa5-7d24-5281-b6a8-ec21b4b0bf9b 20100131 1 900000000000207008 900000000000528000 149532003 274033006
d59ef95e-e87e-5411-bff7-f35c7c4d72ad 20100131 1 900000000000207008 900000000000528000 266937006 81877007
f356bb7a-0fda-5ccc-ba8b-4453fae7f824 20100131 1 900000000000207008 900000000000528000 159721006 265987007
f53222ee-9de3-553a-b192-a85b744a5bac 20100131 1 900000000000207008 900000000000528000 193366002 399625000
01c6981e-075b-511f-b1a3-2a332bdbcaa8 20100131 1 900000000000207008 900000000000528000 287840006 274033006
08e4cfd5-01ba-5ea9-a05c-4aa5ffd8450b 20100131 1 900000000000207008 900000000000528000 186296003 398599000
31c7aadc-1628-5597-8d9a-d7bead9a9661 20100131 1 900000000000207008 900000000000528000 154851005 88339003
3afd517b-1eda-5904-9866-9530e19f3af8 20100131 1 900000000000207008 900000000000528000 136834007 159564001
4f8b9c16-070a-5f49-b9fe-fe9c9c8fe98c 20100131 1 900000000000207008 900000000000528000 267609006 399625000
53202a69-5329-5c06-8242-db94c348892e 20100131 1 900000000000207008 900000000000528000 139355001 267052005
55b96987-32b8-5db6-96bf-d2b282179841 20100131 1 900000000000207008 900000000000528000 162079002 267052005
641f1731-de51-558e-b27b-f135674fa28f 20100131 1 900000000000207008 900000000000528000 193355009 399625000
6b3085fd-51d1-5fd6-a23e-19300773fb02 20100131 1 900000000000207008 900000000000528000 193368001 399625000
75b0053f-210f-5c35-a8ed-53ef0ea33f90 20100131 1 900000000000207008 900000000000528000 159566004 159564001
7b85085f-496b-5163-93d3-f7679cba2d78 20100131 1 900000000000207008 900000000000528000 286932008 88339003
7e9381b9-b964-5517-b419-041eb0339b5e 20100131 1 900000000000207008 900000000000528000 193372002 399625000

RESOLUTION: It was discovered that 2 of the above source concepts actually had 2 concepts referenced, and so 23 associationReference records were updated in order to replace the inactive targetComponentID's with the relevant active concepts. In addition to this, the system then automatically inactivated 12 additional associationReference records, where the source concept was also associated to "Limited components" ([900000000000486000|limited]):

95d6b955-adb9-59fc-a011-93ee592153b1 20170131 0 900000000000207008 900000000000527005 149532003 287840006
f26e9e9e-230a-59a8-8833-c91f916a9ca2 20170131 0 900000000000207008 900000000000527005 287840006 149532003
de91b7cb-7e7b-5ce1-8f68-6664f702d7cb 20170131 0 900000000000207008 900000000000527005 137020000 159721006
39c3ce30-764f-54c3-8fd6-c835100e3883 20170131 0 900000000000207008 900000000000527005 159721006 137020000
d4e899ca-28a1-5aff-8f21-1dac26145649 20170131 0 900000000000207008 900000000000527005 138107003 266937006
faa7f07c-1bb3-5c7a-a90b-4e6b1ad76754 20170131 0 900000000000207008 900000000000527005 139355001 162079002
d9e24c55-5379-5b82-afe8-e8acf8b8d8a8 20170131 0 900000000000207008 900000000000527005 162079002 139355001
01d104e1-cf86-5d04-a42b-a162de76da8b 20170131 0 900000000000207008 900000000000527005 154851005 286932008
e416f825-01e5-59ec-be00-8ec638c0e541 20170131 0 900000000000207008 900000000000527005 136834007 159566004
e28804d0-042d-59c1-940b-7b6b1be69415 20170131 0 900000000000207008 900000000000527005 286932008 154851005
51ccb59d-2090-5611-b2a9-896edde0e029 20170131 0 900000000000207008 900000000000527005 159566004 136834007
39763acf-0f7d-50b5-872d-94741fcd69bb 20170131 0 900000000000207008 900000000000527005 266937006 138107003

This issue needs particular attention, as one of our members is asking why the fix for this changed history?

The issue here is that when the targetComponentID has been changed in the past, the record was inactivated and re-created with the new targetComponentID. However, the termServer considered this a mutable field, and therefore since we moved to the termServer if we change the targetComponentID field it will simply update the record instead of inactivating and re-creating.

  • Action: One of the members has complained about this approach, and so AAT will speak to David/Linda about whether or not the targetComponentID can be considered a mutable field.
  • AAT emailed the question - will post the response once discussed and agreed

Both David and Linda agreed the following:

 

"As far as I can tell there is nothing in the documents that these fields to be immutable. However, there are some reasons that suggest to me it might be better for them to be immutable.

 

For example:

 

  • If the nature of the historical association changes then new rows are needed as they would be in another refset. Similarly, I would be a bit concerned in the case of the ambiguous case "POSSIBLY EQUIVALENT TO" because in that case it would be arbitrary to simply use the same association and change the target concept.
  • The association refsets are similar in function to the relationships ... where both sourceId and destinationId are immutable.
  • If the churn level is fairly low, immutability has a very low-cost and offers significant additional clarity.

 

Arguably the only case where it would "reasonable" to treat the target as mutable would be where

 

 

A(inactive)=B(active)

 

Then B is inactivated and a new historical relationship is added:

 

 

B(inactive)=C(active)

 

 

in this case one could argue that the transitive result represents an update of the existing association.

 

 

A(inactive)=C(active)

 

 

However, overall I would suggest that immutability is clearer and safer in all cases.

We therefore need to take a look at the termServer functionality and update it accordingly...

 

Mapping Release Notes - They were questioned by our members due to some inaccuracies in the ICD10 map wording.
  • Action: AAT will ensure that from now on Donna will also be included in both meetings and Release Notes review processes going forward.

 

  • No labels