NWSS-M007 — Monitoring-plan compliance
Provisional. Usable pending approval; a project-proposed concept only by the project that proposed it.
- Code: NWSS-M007
- Version: NWSS-2026-11-09
- Approval status: Provisional
Derivation of each scheduled visit’s status from the records that fulfil it and its visit window, and of each missed service’s follow-up from the follow-up records at the service point; with the share of scheduled evaluations completed and the share of missed services followed up.
underlying principles and assumptions
A scheduled visit is issued from the monitoring plan and never edited, only cancelled or superseded; its status is derived (ADR-0005). Attempts are records and are never filtered. A record outside the plan is an unscheduled observation: kept as evidence, never counted toward compliance. A missed service is followed up on the ground so that its cause is known. The visit window and follow-up window are project parameters (ADR-0010).
methods and procedures
Issue scheduled visits from the monitoring plan, each for one service point and date. Visit each inside its window and record the visit outcome, linking the record to the scheduled visit. For each service that is not recorded on its scheduled service day, visit the service point inside the follow-up window and record the failure reason found and the state of its containers. Derive and count as the rules state.
data requirements and inputs
Scheduled visits with service point, scheduled date and any cancellation or supersession; evaluation records with the scheduled visit they fulfil, visit outcome and observedAt; missed-service follow-up records with service point, visit outcome, failure reason and observedAt; the service status of each eligible service point-period and its scheduled service day from NWSS-M003. From the project design: the monitoring plan’s sample size and visit window, and the follow-up window.
calculation and transformation rules
- For a scheduled visit v neither cancelled nor superseded, with scheduled date t, its window runs from t to t + V, V the project parameter visit window (default 0 days: the scheduled date only). Status at reading time r: completed if a record fulfilling v, dated in the window, has visit outcome completed; else open if r is not past the window; else attempted if a record fulfilling v is dated in the window; else missed. A record fulfilling v dated outside its window does not count for v and is unscheduled. Scheduled evaluations completed = 100 × (v completed) / (v completed, attempted or missed), over v with t in the reporting period; alongside: the counts by status, visit success = completed / (completed + attempted), and the evaluation records in the period that fulfil no scheduled visit (unscheduled). (2) For each eligible service point-period (x, p) with status missed, with scheduled service day d, it is followed up when a missed-service follow-up record at x is dated from d to d + F, F the project parameter follow-up window (default 7 days). Missed services followed up = 100 × (followed up) / (all missed (x, p)) over closed periods in the reporting period; alongside: the share of those follow-ups with visit outcome completed (reach) and the count of each failure reason found.
outputs and units of measure
Scheduled evaluations completed (PERCENT) with counts by status, visit success and unscheduled evaluations alongside; missed services followed up (PERCENT) with reach and failure reasons alongside; by period, service area and zone.
validation and verification approach
Validation: a reviewer with Knowledge and Skills Reputation in survey and monitoring design checks that the monitoring plan declares its sampling frame, sample size, visit window and follow-up window. Verification: a reviewer in field team supervision checks that scheduled visits were issued before their dates and never edited, that completed visits are inside their windows, and that no evaluation was made by the collector of the round serving the service point.
limitations and applicability boundaries
Compliance measures whether the plan was followed, not whether it was a good plan. The follow-up window opens on the scheduled service day, before the period closes, so a follow-up may find a service that was delivered late within the carry-forward window; its failure reason then records that. The visit window default is strict; a project that schedules by week declares a wider window.
rationale
Two reports computed compliance against different denominators and the follow-up rule changed between versions. Deriving every scheduled visit’s status from its window, and every follow-up from the missed statuses of the eligible frame, fixes one rule for each and keeps unscheduled visits out of the rates every evaluation indicator rests on.
Indicators it serves
Activity types
- Missed-service follow-up
- Service point evaluation
Knowledge domains a reviewer needs
- Field team supervision
- Survey and monitoring design
Variables
| Variable | Role | Unit | Description |
|---|---|---|---|
| Missed services followed up | DerivedOutput | PERCENT | 100 x missed eligible service point-periods with a follow-up inside the follow-up window / missed eligible service point-periods. |
| Scheduled evaluations completed | DerivedOutput | PERCENT | 100 x completed / (completed + attempted + missed), scheduled date in the period. |
| Scheduled visit status | DerivedOutput | UNITLESS | Completed, attempted, missed or open, derived from fulfilling records and the visit window; never captured. |
| Service status | DerivedOutput | UNITLESS | The status of an eligible service point in a service period by the NWSS-M003 ladder; fixed once the period closes. |
| Observed at (t) | MeasuredInput | UNITLESS | The instant the observation or record was made; its local date in the project’s time zone is the record’s date. |
| Restated record | MeasuredInput | UNITLESS | The earlier record a record replaces; of a record and its restatements only the latest counts (ADR-0006). |
| Scheduled date (t) | MeasuredInput | UNITLESS | The date a scheduled visit is planned for. |
| Scheduled service point | MeasuredInput | UNITLESS | The service point a scheduled visit is planned at. |
| Scheduled visit cancelled | MeasuredInput | UNITLESS | A scheduled visit cancelled with no replacement; it is no longer due. |
| Scheduled visit fulfilled | MeasuredInput | UNITLESS | The scheduled visit an evaluation record answers; absent for an unscheduled observation. |
| Scheduled visit superseded | MeasuredInput | UNITLESS | The earlier scheduled visit a reissued one replaces; the superseded visit is no longer due. |
| Service failure reason | MeasuredInput | UNITLESS | Why a service was missed, as found on a follow-up. |
| Service point (x) | MeasuredInput | UNITLESS | The service point a record or observation is about. |
| Visit outcome recorded | MeasuredInput | UNITLESS | Completed, no respondent or wrong service point. |
| Withdrawn record | MeasuredInput | UNITLESS | The record a withdrawal declares never happened; a withdrawn record never counts (ADR-0006). |
Monitoring requirements
- Evaluations follow the monitoring plan: Evaluation rates use only records fulfilling a scheduled visit inside its window; scheduled visits are issued before their dates and never edited.