Reliably evaluating program engagement across large participant communities has become easier. New technology doesn’t overcome the need for good program planning and management and evaluation using indicators, but it takes monitoring and evaluation of the social dimensions to a whole new level.

Capturing participant voice

I was recently introduced to SenseMaker , a ‘pattern detection’ software. As a sophisticated decision-support tool, it ensures social narrative as collected source data is not altered by significant levels of subjective filtering by the social researcher’s analysis. It allows insight into people’s perspectives, attitudes, and values in the domain of researcher interest.

Having worked in both International Development Aid and natural resource management – where community engagement is applied to resolve the complex issues which arise from the need to effect broad-scale social change within complex systems –  the value of such tools is immediately apparent.

Access to mass data sets

The software facilitates the ‘mass capture’ of the experiences and perceptions of research participants engaged in programs working within complex systems. It stores the meanings they attribute to those experiences in narrative form, and these response can be used to informs responsive engagement and inclusion strategies. It enables continuous program improvement.

Timely program response to emergent changes

The software detects weak signals, emergent opportunities or threats –  which gives insight into change as it emerges and allows for ongoing program adjustments and responses in real time. The evidence-based qualitative and quantitative data it generates is both directly and quickly accessible.

Sense-making of complexity enables timely responses to emergent patterns in fragmented social data from multiple sources and interactions.

The software features both statistical analysis and multiple visual displays of the patterns of perceptions so program managers  can compare critical elements of a complex system in real time. When applied to complex human social systems, the impact of a new engagement or inclusion initiatives can be tracked and adaptations responsively undertaken.

Probing complexity

‘Testable nodes’ where social and physical elements intersect within complex systems can be ‘probed ‘-  i.e. key management interfaces of social and natural landscapes or the patient and service delivery points within a health system – where human data is captured and analysed in real time using this software tool. Overall management system health and the effectiveness of the engagement interventions applied become understandable…making sense of complexity.

Adapt Strategic Communications: www.adaptstrategic.com.au