Note |
---|
This specification might evolve based on the development constraints. |
Summary
Claim AI-based Adjudication System
...
The AI input model is represented by a matrix having on each row one Medical Item/Service from a Claim. If the FHIR Claim Bundle contains multiple Claims then the AI input model will contain all Items/Services from all Claims. Each row contains the following informations (either FHIR Medical OR ActivityDefinition, representing an Item in FHIR Claim):
FHIR Medication fields | FHIR ActivityDefinition fields | FHIR Claim fields | FHIR Patient fields | FHIR HealthcareService fields |
---|
identifier (ItemUUID) | identifier (ServiceUUID) | identifier (ClaimUUID) | identifier (InsureeUUID, CHFID) | identifier (HfUUID) |
extension.unitPrice | unitPrice | billablePeriod (start, end) | birthDate (to calculate age) | location (HFLocationUUID) |
frequency | frequency | created | gender | category |
extension.useContext (ItemPatCat) | useContext (ServicePatCat) | type | extension.isHead | type |
type (always “Medication”) | type (always “ActivityDefinition”) | item.quantity | extension.povertyStatus | |
| | item.unitPrice | extension.locationCode (LocationUUID) | |
| | diagnosis.diagnosisReference (for icd_0 get ICDID) | extension.group (FamilyUUID) | |
| | diagnosis.diagnosisReference (for icd_1 get ICDID) | | |
| | enterer (ClaimAdminUUID) | | |
...
Note |
---|
In this project, the generated AI Model is only valid for Nepal openIMIS implementation. Any usage in other context/implementation will give wrong categorization responses. For other context/implementation, the retraining of the AI Model, based on already categorized Claims, is mandatory. |
Several data files are to be loaded and saved during the AI Model execution:
encoded fields data file
scalling file
AI model file
The AI Model file name with full path (or relative path) is configured in the modules configuration key ai_model_file
. Each time the model is executed, the model file is loaded, allowing to change the filename on execution in the configuration (hot-reload).
...
The following module configuration is defined:
Code Block |
---|
|
{
'authentication': [string], // Authentication key list. Default:String
[] ai'claim_modelresponse_fileurl': string'http://localhost:8000/claim_ai/ClaimResponse', // AI Model file name with full path. Default: ./ai_model.pkl
claim_response_organization: stringURL set in the ClaimResponse. String
'ai_model_file': "joblib_Voting_Model.pkl", // Value to build the insurer reference in the ClaimResponse. Default: openIMIS-Claim-AI
}AI Model file name, relative location to module folder. String
'ai_scaler_file': "scaler.pkl", // AI Scaler file name, relative location to module folder. String
'ai_encoder_file': "Encoder.obj", // AI Encoder file name, relative location to module folder. String
'claim_response_organization': 'openIMIS-Claim-AI', // Organisation name in ClaimResponse. String
'date_format': '%Y-%m-%d', // Date format to use. String
'first_date': '2016-01-01' // First date for date transformation. String
}
|
Note |
---|
The default AI Model filename will be defined after finalizing the AI Algorithm development. |
...
FHIR Contained Resources feature allows to integrate the referred resourced. Because AI-model is requiring information from other resources referenced by the Claim, these resources must to be accessible from the Claim sent by Claim-AI Quality module. In case of FHIR Claim, these are Patient, Condition, Medication, HealthcareService, Practitioner, ActivityDefinition. The mechanism to build Claim resource with Contained Resources is developed in the openIMIS FHIR R4 module. In FHIR R4 module, the inclusion of Contained Resources should be possible based on the query variable contained=true/false
(default false
).
...
Plantumlcloud |
---|
filename | ClaimStatusStateDiagram.png |
---|
data | pVdRb9sgEP411tJJqdykXbtHJ2mlPLSbEmmvEbVp4o6Y1uB02arVhRb5swEP41SO2kVIS06/fAcYGDLHTSZFjmZIklbKQ7spkfYaUXBTdwan2LTLfv3OBoNt7EDSSSgFfN9n3313Z9PgOmQ8KXmVkyCM4YInjoIoDKLoruCohNsFSXAOz3CbMPUsB3GxE6a3c4GFm5v5l+BmCXeTSTC7g7/sSCmVibBar55ayBoWxYeiFZpgHN4tCg9omcmgDDlQsmC270Yvo0g1Yo3eMPlrEKiPC9Yupx1zyrzjq5ojTFO15PYkPtUavKOWYFmuUMFpYqFCibpe96K8ruZi7YocLcbN4QelvGfBWCGFSj8vBTgq5DsXVWf1KCM4SsRS5uAVc6QvFKRIRh0sh+uPvuDhxdx4yjkld7EsUJ2J4OYT5pnrKQRtNVcniwbSUMiwomx86QytmQu6YEHgWQWcN7TGcmQHKVFdnGG4IrFNEYyj6akNVTCfT76IwhuGvgNmiP/OCJ42gSR5PJfcFxCbdzgvI9PMMtYvpZDubFVpjezgQWbm5mX6ObBdyNx9H0Hv6lFc7E2DTRzw2lAsWJZRiEZjmPbuaFAXVN5NAaHKhYNF20o6PJhR+wwoccfzSIZUaE66OrgLnkX3LczpGkKX7japIQaoVfccpzWqwwYrRwULFE3S460V9VcjH3xTYvxM18h9PfMuCNEMJEjcvBVgq5Ds3VWv1CJM+QWIpc3Bx+6Y7mKRYRh59GdsUIcgjzdfW8B20MVSVLANNQyrDgbHZsDZ2YCbkTQuBZBJ3VtKdwdgZoU1OdfrglsEkxGULRVRuq4mp89V0URhMaP4MOja6jgZGU4uOszl61DJVikmsubNd0j+04+lB2+GoL4fr1RRj0Cm5u8B9+mQr0BuWb9wqWyY+XH4htUkjCLS3zv0A0XbwgwnBT91/gr6AySTl9gyt9CcyxFAPJEi57mkE0mEKKQoBgH5BSSPjKd7jo98RfcnKCpOJ0DyFOBUu9eFaHvKm8ZHmq4mBUTO+iT5Wc7bRWNkikYSEDJzWSpdFyrATxVVgYdI7UvKzw5/ngtsSsItzbZM/z/YGg7bbTkIXrwarwgaytYo2JrOAHWqoRT5V0SYb1l56Fm73FgD8fdYmMxr1M/ynkcDpTx66vkjXYAUIBkC+UZpP4gEgl20G4rB9RAatpNDTKWI00AvpqWQltytxfxVam63R0iTSmO4GTwE+U62xrt1z5QrRD6QE5imxWDZFTuJTNHCdpnKR+kgSGlZuSfo7+480wR4d5GfKvzznTLadQP+9Tc8bC71VeYjefejPFmLk9F3mpOinW1kYP0gilNEd6g9MRfaGlFdL6iOIjcxQz6lFN45YasNfdFnpTYJ9pSM5vkZ35+zvk4w/ZIY19pMsVPIcNiUlnk/PEpDmdhTcgl2XYt0cIPTihPQQe1YUfBvsCk/yA7SQKWzt1aYyP7k4czn6WNMWM2V9A9Uund3dn1h7A+bkSh8VOgDSRxAet7FOlNpMCfOvE0G6W56wgoIRLMTu+IcY8FOok/JHzHa30N0CmNKq/2OGFKVWQsdfhE1hHZ2PcipYHH6o/T+z8pjp9ousYF1m1J/8AwqFUvZJnj7VkH0+OHqI2HbFBTd0RL/hQXNls8JYehTnCV6qxDjW45zyIGl1Ane35c0/yQv29OCof9ODLfAXRHulKbNPDe5yjzVpkYmqqwtlDXNoV5hXcGSayFsNzRHZpq6UGZ2NhZi+deXftCZGXEalZUIRUXIeTSm7h2Pp8nFKxHMitMcop6K+Rp/WKNC2+vi1bEeB6NiLTb6WJMzPVNie4kUzGdgZUu80pq8kTOunuYHnaI+Lyt0Pp9eWv1t7TTf70my2/W2QOG6t1BcIGNz3iAii/qelvWIo3D6JOM6+sDC9W6uwZ8OMiaCaDLI9Ekhx9MNtsgoLKgsGk738EufhwMgX9SaReF7QqBXdDXhKOuHpIDVtBpqZVyPtAK6arkWWpd5uIqNTFfpaBMpTH8CK4EfKVfZ1gaifgE3ufSAHEQ2QyBlHOGnbOc4SmMl9aMk0KzslHRzDB8oxzk6zkuff0PO6W5ZhXq+T+2pFnYsXCI7nwYzRZu5O4k6qXop1tXGAFILpTRP1AanIvpMSyOkzanFRWYpptVjPY1dasDedFvoTZ59piUZeWb2w8Z21t6yhxvrww/ZWLXtp8/lPdGNCWVvb3SEsj3n+fctm2XcR6IPPboOHASOZBF+aOxLRPA7MnPPb22VszZ+8U0txNH8f5Y0RYyZn6rNS6vl92dWHsBJvALGfoAUkcR7rcycVmZSgK+9GJo99pQVeJSwKeaHfcKYg6L+fvjA/IVW6msiqzVq/rUCL3SpvIyDDh/BWjpr40a0HHhf/Tli5zZV6RNch6jIqpz8Aw== |
---|
width | |
---|
compressed | true |
---|
revision | 914 |
---|
|
Expand |
---|
|
state "Enter Claim" as ClaimEntering { |
[*] --> Entered : Enter Claim |
Entered --> Entered : Edit\nClaim |
Entered : ClaimStatus=Entered (2) |
Entered : ReviewStatus=Idle (1) |
Entered : ClaimItemStatus=Accepted (1) |
Entered : RejectionReason=Accepted (0) |
state "Rule Engine Checking" as RuleEngineCheck { | RuleEngineValidation <<choice>>Entered RuleEngineValidation <<choice>>
Entered --> RuleEngineValidation : Submit Claim |
RuleEngineValidation --> RejectedByRuleEngine : Reject\nAll Items |
RejectedByRuleEngine : ClaimStatus=Rejected (1) |
RejectedByRuleEngine : ClaimItemStatus=Rejected (2) |
RejectionReason=[1-19]RejectedByRuleEngine --> [*] RuleEngineValidation --> CheckedIdle : Accept \n Some Items CheckedIdle : ClaimStatus=Checked (4) CheckedIdle : RejectionReason=[1-19]
RejectedByRuleEngine : json_ext.claim_ai_quality.was_categorized=false
RejectedByRuleEngine : json_ext.claim_ai_quality.request_time=ValidityFrom
RejectedByRuleEngine : json_ext.claim_ai_quality.response_time=ValidityFrom
RejectedByRuleEngine : json_ext.claim_ai_quality.ai_result=Rejected (2)
RejectedByRuleEngine --> [*]
RuleEngineValidation --> CheckedIdle : Accept \n Some Items
CheckedIdle : ClaimStatus=Checked (4)
CheckedIdle : json_ext.claim_ai_quality.was_categorized=false |
} state
}
state "AI Automatic Categorisation" as AICheck { |
state AIClaimCategorisation <<choice>> |
CheckedIdle --> AIClaimCategorisation |
AIClaimCategorisation --> CheckedAIAccepted : Accept\nAll Items |
CheckedAIAccepted : json_ext.claim_ai_quality.was_categorized=true |
CheckedAIAccepted : json_ext.claim_ai_quality.ai_result=Accepted (1) |
AIClaimCategorisation --> CheckedAIFlagged : Reject\nSome Items |
CheckedAIFlagged : ReviewStatus=SelectedForReview (4) |
CheckedAIFlagged : ClaimItemStatus=Rejected (2) |
CheckedAIFlagged : RejectionReason=Rejected by AI (-2) |
CheckedAIFlagged : json_ext.claim_ai_quality.was_categorized=true |
CheckedAIFlagged : json_ext.claim_ai_quality.ai_result=Rejected (2) |
note top of CheckedAIFlagged : Rejected Items values |
} state
}
state "Manual Review" as ManualReview { |
state SelectForReview <<choice>> |
CheckedAIAccepted --> SelectForReview |
SelectForReview --> CheckedNotSelected : Select manually\nnot to review |
CheckedNotSelected : ReviewStatus=Not Selected (2) |
CheckedNotSelected : RejectionReason=Accepted (0) |
SelectForReview --> CheckedSelected : Select manually\nto review |
CheckedSelected : ReviewStatus=Selected (4) |
CheckedSelected : RejectionReason=Accepted (0) |
state RequireManualReview <<choice>> |
CheckedSelected --> RequireManualReview |
CheckedAIFlagged --> RequireManualReview : Selected automatically\nfor review |
RequireManualReview --> CheckedRejected : Manual Review\nReject All | Items
Items
CheckedRejected: ClaimStatus=Rejected (1)
CheckedRejected: ClaimItemStatus=Rejected (2) |
CheckedRejected : RejectionReason=Rejected by MO (-1) |
RequireManualReview --> CheckedAccepted : Manual Review\nAccept Some Items |
CheckedAccepted : ClaimItemStatus=Accepted (1) |
CheckedAccepted : RejectionReason=Accepted (0) |
CheckedAccepted --> CheckedReviewed : Deliver review |
CheckedReviewed : ReviewStatus=Reviewed (8) |
state "Processing" as Process { |
CheckedReviewed --> ValuatedAccepted : Process |
ValuatedAccepted : ClaimStatus=Valuated (16) |
CheckedNotSelected --> ValuatedAccepted : Process |
CheckedAccepted --> ValuatedBypassed : Process \nwithout \ndelivering \nreview |
ValuatedBypassed : ClaimStatus=Valuated (16) |
ValuatedBypassed : ReviewStatus=Bypassed (16) |
|
Only the Claims which contains Items/Services rejected by Claim-AI module will have the fields updated. The json_ext fields are always updated, even for the totally accepted Claim.
...
Code Block |
---|
Claim.json_ext.claim_ai_quality.was_categorized = false
Claim
Claim.json_ext.claim_ai_quality.request_time = null
Claim.json_ext.claim_ai_quality.response_time = null |
If Claim.ClaimStatus == Rejected (Value 1) Then add
Code Block |
---|
Claim.json_ext.claim_ai_quality.was_categorized = false
Claim.json_ext.claim_ai_quality.request_time = Claim.ValidityFrom
Claim.json_ext.claim_ai_quality.response_time = Claim.ValidityFrom
ClaimService.json_ext.claim_ai_quality.requestai_timeresult = nullClaimService.ClaimServiceStatus
ClaimClaimItem.json_ext.claim_ai_quality.responseai_timeresult = nullClaimItem.ClaimItemStatus |
If Claim.ClaimStatus in [Rejected (Value 1), Reviewed Reviewed/Processed (Value 8), Valuated (Value 16)] Then add
...
ClaimFilterMedicalItem
allows Medical Officers to filter the Claims list based on a specific Medical Item (only one from autocomplete list)
ClaimFilterMedicalService
allows Medical Officers to filter the Claims list based on a specific Medical Service (only one from autocomplete list)
ClaimFilterAIProcessed
allows Medical Officers to display or hide the non AI-processed Claims (checkbox, default checked)dropdown with options: Show all
, AI-Categorized Claim Only
, Not AI-Categorized Claims Only
, default AI-Categorized Claim Only
)
Custom Claim Review Search Results - Frontend
The following column will be added to the claim.Searcher
result list:
ClaimResultsAIProcessed
will display the value of Claim.json_ext.claim_ai_quality.was_categorized
as True/False.
AI Categorisation Misclassification Report
...
total number of Claims
accuracy score ( Accuracy = (TP+TN)/(TP+TN+FP+FN) )
number of True Positives results
number of True Negative results
number of False Positive results
number of False Negative results
Table with Claim that were fixed (ClaimItem.json_ext.claim_ai_quality.ai_result != ClaimItem.ClaimItemStatus
- same for ClaimService)
To generate this report, the user will have have to filter through the Review Claims search form and trigger the report through a button (label is “AI Misclassification Report”). Only the filtered Claims will be considered for the report.
...
Plantumlcloud |
---|
filename | openIMIS-AI-Modules-Deployment.png |
---|
data | lVTLboMwEPwaSpVXbboMwDP2aSNsDUkSp+0BySJEOTtJo1pqDqX9ATdsE0tpyWTUNaH8b2A1nx2kghIBIe9vdzuBQaQqGaZEGIfU6c+IGwODiQiGrDK1PnklCGpooMSEiLElRyTD6TvJSQgzLciEKhg2t8kDDsA/fsujxTi4EKkFTK7O4O9M4Zk1HlRDLjQltxG7f8p2KvCwUOnHyILnIj0VWSxgxNbM47B2hD8WSj5pLYX5n4SzBRxd0h+VorQhlGIbz4Eg5ISm0Jhh31LUnTaMJip3GURg4UzUEEZLvPuL5ARrZxQDYvzsY2zDJuDmi1ButHo2xmFz42Z8FHGZHSzanZR8YN/5x37blYwtxmmuSwUajBdeWoMF4fBB0vTagG9hT9p0bHq+k9WlNVjE5E4JqY+2qBWMmNosLq+FdArF+HstlPQ/UTjj+Oib/mE7vPI8z+5YmjSu8iyAYgSIhKy3hXAXKMh6n5DVS3CwFWsYVzuMGieMdQzKIqeYYgs++CgjUoZ7as9BNvtuEdV2ajMjf0T2cW+afmdLvNO2Jq12j9mI8WkndFxjCdH48lucbpGgosCmlA7znRf+Shifz9/op2jpcxJzecvYW7Pz+QT+iS7H5+BwjA5uZOuhn5WQRprzrFBD45xETJ1tJf1FR4b91tzboWc09THykcGfwUAlPLjwmswRLvL5oGNGwRT4P/0FZ6XN24K9JtYXw5jRD/3+AymbVd3A0mouyWWqPNJjRotPGYTFniV1rLNZYIdo/44adbJMhZoHWFw4EtC6snXHdWE1r6HMx1UcPYSb/tIw/+ia7Hp6DxGDXclK2DflVcKKHOi4UaApdKxOS5qIS55DOH/W7vhSHGqdYgwxRKKU78Tmb4jrF/rpeCJ4FH6ncGBRU3oK9V9CWzvneqFjMmXJnhdN01MosoqAz/GX8= |
---|
width | |
---|
compressed | true |
---|
revision | 24 |
---|
|
Expand |
---|
|
database openIMISDB node openIMISImplementation as
node openIMISImplementation as "openIMIS Implementation" { |
component ClaimModule as "Claim Module" |
component ClaimAIQualityModule as "Claim AI Quality Module" |
component FHIRR4Module as "FHIR R4 Module" |
FHIRR4Module -[dashed]-> ClaimModule: <<use>> |
ClaimAIQualityModule -[dashed]-> FHIRR4Module : <<use>> |
ClaimAIQualityModule --^ ClaimModule} openIMISImplementation
ClaimAIQualityModule --^ ClaimModule
database openIMISDB
ClaimModule -[dashed]-> openIMISDB: | <<use>>node openIMISClaimAIImplementation as "openIMIS <<use>>
}
node openIMISClaimAIImplementation as "openIMIS Claim-AI Implementation" { |
component ClaimAIModule as "Claim-AI Module" |
artifact ClaimAIModel as "Claim-AI Model" |
ClaimAIModule -[dashed]-> ClaimAIModel: <<use>> |
} ClaimAIModule
}
ClaimAIModule -0)- ClaimAIQualityModule: FHIR Claim |
ClaimAIModule -(0- ClaimAIQualityModule: FHIR ClaimResponse |
node ClaimAITraining as "openIMIS Claim-AI Training" { |
component ClaimAIAlgorithm as "Claim-AI ML Algorithm" |
ClaimAIAlgorithm
artifact openIMISDBReplica as "openIMIS Claim Data"
ClaimAIAlgorithm -[dashed]-> ClaimAIModel: | <<generates>> ClaimAIAlgorithm <<generates>>
openIMISDBReplica -[dashed]-> openIMISDB: <<replicates>>
ClaimAIAlgorithm -[dashed]-> | openIMISDB openIMISDBReplica: <<use>> |
|
Testing
Testing the WebSocket from JavaScript console
...