Evaluating inter-rater reliability of indicators to assess performance of medicines management in health facilities in Uganda

Blick, Belinda; Nakabugo, Stella; Garabedian, Laura F.; Seru, Morries; Trap, Birna

doi:10.1186/s40545-018-0137-y

Journal of Pharmaceutical Policy and Practice

Table 4 Average IRR scores (%) for 24 SPARS indicators and tests of change, by domain and indicator category

From: Evaluating inter-rater reliability of indicators to assess performance of medicines management in health facilities in Uganda

		Assessment		Assessments
	1	2	3	1 to 2	2 to 3	1 to 3
Number of teams (facilities assessed by each team)	2 (3)	10 (2)	10 (2)
Number of assessments	n=6	n=20	n=20	iwo sample test lor proportions
Dispensing quality domain
1. Dispensing time	67	55	60	0.602	0.749	0.757
2. Packaging material	83	100	100	0.060	-	0.060
3. Dispensing equipment	71	90	80	0.245	0.376	0.641
4. Services available at dispensing area	67	81	78	0.470	0.814	0.583
5. Patient care	37	72	64	0.117	0.588	0.240
6. Labeling	79	83	75	0.823	0.535	0.841
7. No discrepancy between prescribed and dispensed medicines cotrimoxazole/ amoxicillin- Rational prescribing	50	45	75	0.829	0.053	0.245
Dispensing quality domain	65	75	76	0.630	0.941	0.593
Prescribing quality domain
8. Correct use of prescription recording system	33	65	70	0.164	0.736	0.102
9. Rational Prescribing	30	76	63	0.038	0.372	0.154
10. Adherence to standard treatment guidelines diarrhea	67	60	60	0.757	1.000	0.310
11. Adherence to standard treatment guidelines cough and cold	67	45	65	0.345	0.204	0.928
12. Adherence to standard treatment guidelines malaria	25	65	63	0.084	0.895	0.101
Prescribing quality domain	44	62	64	0.434	0.896	0.382
Sto ck management do main
13. Availability of stock card/ledger book	17	55	85	0.102	0.038	0.002
14. Correct filling of stock card	50	50	55	1.000	0.752	0.829
15. Does physical count agree with stock card	100	75	90	0.173	0.212	0.420
16. Stock book correctly filled	100	95	75	0.576	0.077	0.173
Sto ck management do main	67	69	76	0.926	0.62	0.66
Storage management domain
17. Cleanliness of the pharmacy	33	40	55	0.757	0.342	0.345
18. Hygiene of the pharmacy	57	77	75	0.337	0.882	0.395
19. System of storage of medicines and supplies	63	84	79	0.267	0.684	0.425
20. Storage conditions	79	88	88	0.578	1.000	0.578
21. Storage practices of medicines in pharmacy (stores and dispensary)	64	77	68	0.524	0.524	0.855
Storage management domain	59	73	73	0.513	1.00	0.513
Ordering and reporting domain
22. Reorder level calculation	33	50	95	0.464	0.001	0.001
24. Accuracy of HMIS report	67	70	45	0.889	0.110	0.345
25. Filing	50	45	70	0.829	0.110	0.366
Ordering and reporting domain	50	55	70	0.829	0.327	0.366
Overall Score	57	67	72	0.653	0.731	0.488
Indicator categories
Complex	55	65	68	0.657	0.841	0.558
Simple	60	71	75	0.611	0.776	0.475

Back to article page

ISSN: 2052-3211

Contact us

Submission enquiries: Access here and click Contact Us
General enquiries: info@biomedcentral.com