Visual Impairment Screening Assessment (VISA)

Evidence Reviewed as of before: 20-01-2023
Author(s)*: Annabel McDermott, OT
Editor(s): Annie Rochette
Expert Reviewer: Fiona Rowe

Purpose

The Visual Impairment Screening Assessment (VISA) is designed to identify visual impairment following stroke, to allow referral for specialist visual assessment. The VISA was developed by the VISION research unit, University of Liverpool.

In-Depth Review

Purpose of the measure

The Visual Impairment Screening Assessment (VISA) is designed to identify visual impairment following stroke. The VISA screens for common visual impairments following stroke including impaired central vision, eye movement problems, visual field deficits and visual inattention. The VISA can be used to detect ocular signs separate from reporting of vision symptoms.

Available versions

The VISA was developed from a review of stroke and vision research studies, and in collaboration with a panel of stroke specialists and patients, and validated in a clinical study.

The VISA is available in print and as a software app.

Features of the measure

 Items:

The VISA comprises five sections:

  1. Case history – to screen for visual symptoms and observed signs – in person or by proxy.
  2. Visual acuity – to screen central vision at near (33cm) and distance (3m) using LogMAR (Logarithm of the Minimum Angle of Resolution) or Grating acuity; monocular or binocular depending on the ability of the patient.
  3. Ocular alignment and movement – to screen presence/absence of strabismus and eye movement problems.
  4. Visual field* – to screen peripheral and central field of vision by a guided confrontation method.
  5. Visual perception – to screen for visual inattention/neglect using (i) line bisection task, (ii) cancellation task and (iii) clock drawing assessment.

*Visual field assessment – print version: confrontation follows a typical method with the clinician seated directly opposite the patient at a distance of 1m and following stages that involve the patient indicating when a 10mm red target is seen in the periphery of their vision, finger counting in each quadrant of the visual field and comparison of examiner facial features.

*Visual field assessment – app version: a kinetic visual field assessment is undertaken at a test distance of 30cm and a screen width of 24.6cm, allowing an assessment of the 40degree visual field. The patient is asked to fixate a static fixation point in the corner of the screen while a stimulus moves from the other edges. They are asked to tap the tablet screen when the stimulus is seen. This is repeated with the fixation target positioned at all four corners of the screen.

Scoring:

Administration of the VISA screening tool does not result in a score. Rather, the tool serves as a guide for referral for specialist visual assessment as per observations outlined in the VISA Instructions for Use booklet.

What to consider before beginning:

The VISA screens for common forms of visual impairment that occur from brain injury but does not screen for all possible visual impairments. As such a negative screen does not rule out the presence of visual impairment.

The individual may not be able to complete all sections of the VISA at one time (e.g. due to fatigue, cognitive difficulties, communication difficulties). In this instance the VISA can be completed over several visits.

The individual is permitted to wear glasses (if required) for some assessment items.

The VISA must be performed in good lighting conditions.

Time:

The VISA takes approximately 10 minutes to administer, but longer if multiple visual problems and if associated cognitive issues.

Equipment:

Equipment is outlined in the VISA Instructions for Use booklet and includes:

  • Pen torch
  • Occlusive tape
  • 10mm red target
  • +3.00 power reading glasses
  • 3 metre string/tape measure
  • Matching card for visual acuity check
  • Visual attention worksheets
  • Pencil
  • VISA recording sheet

Client suitability

Can be used with:

Individuals with acute stroke

Individuals with community/cognitive difficulties who are unable to comply with any letter test – The assessor can use a grating chart that uses a preferential looking technique.

Stroke patients have reported that it is easier to respond using the touch screen (VISA app) than traditional pen and paper tasks when using their non-dominant hand.

Should not be used with:

The VISA may not be completed in full due to cognitive difficulty or fatigue. Information regarding the individual’s vision history can be gathered from reliable family members. VISA app cannot be used on small devices such as iPad Mini or smartphones.

Languages of the measure

English – print and app
Dutch – print
Norwegian – print

Requests for translations are welcome. The VISA researchers will work closely with translators using the WHO-recommended translation process.

Summary

What does the tool measure? Visual impairment
What types of clients can the tool be used for? The Visual Impairment Screening Assessment can be used with individuals with stroke.
Is this a screening or assessment tool? Screening
Time to administer 10 minutes – may be longer if multiple visual problems
ICF Domain Impairment
Versions There is a print version and an app version of the VISA.
Languages English
Dutch
Norwegian
Measurement Properties
Reliability Internal consistency:
No studies have reported on internal consistency of the VISA.
Test-retest:
No studies have reported on test-retest reliability of the VISA.
Intra-rater:
No studies have reported on intra-rater reliability of the VISA.
Inter-rater:
Two studies reported substantial agreement on inter-rater reliability evaluation of the VISA.
Validity Content:
Pilot validation of the VISA was conducted in collaboration with medical students (naïve screeners) and orthoptists.
Criterion:
Concurrent:
No studies have reported on concurrent validity of the VISA.
Predictive:
No studies have reported on predictive validity of the VISA.
Construct:
Convergent/Discriminant:
Two studies reported poor to substantial test component agreement between the VISA screen and specialist vision assessments.
One study reported perfect agreement between kinetic visual field test using the VISA app and formal perimetry.
Known Groups:
No studies have reported on known group validity of the VISA.
Floor/Ceiling Effects No studies have reported on floor/ceiling effects of the VISA. Two studies noted false positives and false negatives on individual components of the tool.
Does the tool detect change? No studies have reported on responsiveness of the VISA.
Acceptability Two studies reported on acceptability of the VISA, from a sample of stroke patients and orthoptists.
Feasibility The VISA is suitable for administration in various settings. The VISA requires minimal specialist equipment or training.
One study noted that the VISA is time-intensive when used in the hyperacute stage with unwell patients.
How to obtain the tool? The VISA is available in print or as an app (Medicines and Healthcare products Regulatory Agency regulatory approved): https://www.liverpool.ac.uk/population-health/research/groups/vision/visa/?

Further information regarding the tool and administration guidelines can be found here: https://youtu.be/-s6i–PfXNY

Psychometric Properties

Overview

The Visual Impairment Screening Assessment (VISA) was developed by the VISION Research Unit, University of Liverpool in consultation with an expert panel of stroke-specialist clinical orthoptists, stroke research orthoptists, stroke-specialist occupational therapists and neuro-ophthalmologists (Rowe et al., 2018). A literature search was conducted to identify all relevant publications on the psychometric properties of the VISA pertinent to use with participants following stroke. Two studies were identified.

Floor/Ceiling Effects

Floor/ceiling effects of the VISA have not been measured.

Reliability

Internal consistency:
Internal consistency of the VISA has not been measured.

Test-retest:
Test-retest reliability of the VISA has not been measured.

Intra-rater:
Intra-rater reliability of the VISA has not been measured.

Inter-rater :
Rowe et al. (2018) examined inter-rater agreement of the VISA in a sample of 116 individuals with stroke, whereby each individual underwent two vision assessments: a specialist vision assessment performed by orthoptists/ophthalmologists (n=5) and the VISA screening assessment, completed by medical students (n=2) and orthoptists (n=4). Agreement regarding need to make a referral to specialist eye services due to visual impairment was measured using kappa values. Overall agreement was substantial (k=0.736, 95% CI 0.602 to 0.870). As expected, a higher rate of false positives and false negatives were found among screeners naïve to vision testing (n=2 medical students) vs. experienced screeners (n=5 orthoptists/ophthalmologists).

Rowe et al. (2020) examined inter-rater agreement of the VISA in a sample of 221 individuals with stroke, whereby each individual underwent two vision assessments: a specialist vision assessment performed by orthoptists/ophthalmologists and the VISA screening assessment. The outcome was the presence/absence of visual impairment*. Agreement was substantial for the VISA print (k=0.648, 95% CI 0.424 to 0.872) and for the VISA app (k= 0.690, 95% CI 0.528 to 0.851).

*Presence/absence of visual impairment was defined as one or more of: reduced distance vision <0.2 logMAR, reduced near vision <0.3 logMAR (equivalent to N6), deviated eye position, eye movement abnormality (incomplete eye rotations in any position of gaze), visual field loss, visual inattention with displaced line bisection, <42 score on cancellation task and/or incomplete/displaced clock drawing.

Validity

Content:

Pilot validation of the VISA was conducted in collaboration with medical students (naïve screeners) and orthoptists; independent specialist vison assessment was performed by orthoptists/ophthalmologists. Written and verbal feedback was gathered from screeners and a thematic approach to analysis of qualitative date was used. A modified grounded theory approach was adopted to revise themes iteratively as analyses continued (Rowe et al., 2018).

Criterion:

Concurrent:
Concurrent validity of the VISA has not been measured.

Predictive:
Predictive validity of the VISA has not been measured.

Construct

Convergent/Discriminant :
Rowe et al. (2018) examined test component agreement between the VISA screen and specialist vision assessments (visual acuity, ocular alignment and movement, visual fields, visual perception) in a sample of 116 individuals with stroke, using kappa values. Agreement of items ranged from poor to substantial:

  • Near visual acuity (k=0.682, CI 0.543 to 0.820; 10 false negatives, 7 false positives)
  • Distance visual acuity (k=0.785, CI 0.665 to 0.904; 8 false negatives, 3 false positives)
  • Ocular alignment (k=0.585, CI 0.221 to 0.949; 4 false negatives, 0 false positives)
  • Ocular motility (k=0.120, CI -0.071 to 0.311; 21 false negatives, 6 false positives)
  • Visual fields (k=0.741, CI 0.599 to 0.884; 3 false negatives, 8 false positives)
  • Visual inattention (k=0.361, CI 0.144 to 0.578; 1 false negative, 16 false positives).

Rowe et al. (2020) examined test component agreement of the VISA print and VISA app screening assessments with specialist vision assessments (visual acuity, ocular alignment and movement, visual fields, visual perception) in a sample of 221 individuals with stroke, using kappa values. Agreement of individual components between VISA print and orthoptic vision assessment ranged from poor to moderate:

  • Near visual acuity (k=0.236, CI 0.045 to 0.427; 23 false negatives, 12 false positives)
  • Distance visual acuity (k=0.565, CI 0.405 to 0.725; 9 false negatives, 13 false positives)
  • Ocular alignment (k=0.388, CI 0.110 to 0.667; 5 false negatives, 7 false positives)
  • Ocular motility (k=0.365, CI 0.181 to 0.553; 10 false negatives, 19 false positives)
  • Visual fields (k=0.504, CI 0.339 to 0.668; 7 false negatives, 18 false positives)
  • Visual inattention (k=0.500, CI 0.340 to 0.659; 7 false negative, 21 false positives).

Agreement of individual components between VISA app and orthoptic vision assessment ranged from fair to substantial:

  • Near visual acuity (k=0.416, CI 00.227 to 0.605; 19 false negatives, 3 false positives)
  • Distance visual acuity (k=0.783, CI 0.656 to 0.910; 6 false negatives, 4 false positives)
  • Visual fields (k=0.701, CI 0.564 to 0.838, 3 false negatives, 12 false positives)
  • Visual inattention (k=0.323, CI 0.108 to 0.538; 6 false negatives, 16 false positives).

Rowe et al. (2020) examined agreement between kinetic visual field test using the VISA app and formal perimetry using the binocular Esterman programme with 25 individuals with stroke, using kappa values. There was perfect agreement (k=1.00) between measures.

Known Group:
Known group validity of the VISA has not been measured.

Responsiveness

Sensitivity & Specificity:
Rowe et al. (2018) examined sensitivity and specificity of the VISA in a sample of 89 individuals with stroke by comparison with a binary assessment of the presence/absence of visual impairment (low vision <0.2 logMAR, visual field loss, eye movement abnormality, visual perception abnormality). Sensitivity was defined as the proportion of patients with visual impairment who are correctly identified by the screener; sensitivity of 90.24% was found. Specificity was defined as the proportion of patients without visual impairment who were correctly identified by the screener; specificity of 85.29% was found. The positive and negative predictive values were 93.67% and 78.36% (respectively).

Rowe et al. (2018) also compared sensitivity and specificity of the VISA when performed by naïve screeners (n=2 medical students) vs. experienced screeners (n=5 orthoptists/ophthalmologists). When used by a naïve screener the VISA screen had a sensitivity of 82.93% and specificity of 80.95%; when used by an experienced screener the VISA screen had a sensitivity of 97.56% and specificity of 92.31%.

Rowe et al. (2020) examined sensitivity and specificity of the VISA in a sample of 221 individuals with stroke. Sensitivity was estimated as the proportion of patients with visual impairment as diagnosed by the gold-standard clinical examination, which are correctly identified by the screener; sensitivity of the VISA print and VISA app was 97.67% and 88.31% (respectively). Specificity was estimated as the proportion of patients without visual impairment that are correctly identified by the screener; specificity of the VISA print and VISA app was 60.00% and 86.96% (respectively). The positive and negative predictive values of the VISA print were 93.33% and 81.82%. The positive and negative predictive values of the VISA app were 95.77% and 68.97% (respectively).

Acceptability:
Rowe et al. (2018) examined acceptability of the VISA tool through process evaluation of written feedback and interviews with stroke patients and stroke specialists. Qualitative data regarding number of items, clarity of questions, time and ease of testing was gathered and analysed using a thematic approach, and a modified grounded theory approach was subsequently used to revise themes as interviews and analyses progressed.

Rowe et al. (2020) examined acceptability of the VISA tool through process evaluation of clinician feedback sheets and stroke patients interviews. Qualitative feedback regarding duration of assessment, presentation of tests on the VISA app and referral guides were received.

References

Rowe, F.J., Hepworth, L.R., Hanna, K.L., & Howard, C. (2018). Visual Impairment Screening Assessment (VISA) tool: pilot validation. BMJ Open, 8:e020562. doi:10.1136/bmjopen-2017-020562

Rowe, F.J., Hepworth, L., Howard, C., Bruce, A., Smerdon, V., Payne, T., Jimmieson, P., & Burnside, G. (2020). Vision Screening Assessment (VISA) tool: diagnostic accuracy validation of a novel screening tool in detecting visual impairment among stroke survivors. BMJ Open, 10:e033639. doi:10.1136/bmjopen-2019-033639

See the measure

How to obtain the Visual Impairment Screening Assessment (VISA)

The VISA is available in print or as an app (Medicines and Healthcare products Regulatory Agency regulatory approved).

The VISA Instructions for Use booklet can be found here: https://www.liverpool.ac.uk/population-health/research/groups/vision/visa/?

The VISA Instructions for Use video can be found here: VISA stroke vision screening video – YouTube

Table of contents
Survey