About the Author(s)


Karen Rispin Email symbol
Department of Biology and Kinesiology, LeTourneau University, Longview, United States

Abigail B. Davis symbol
Department of Biology and Kinesiology, LeTourneau University, Longview, United States

Vicki L. Sheafer symbol
Department of Psychology, LeTourneau University, Longview, United States

Joy Wee symbol
Canadian Association of Physical Medicine and Rehabilitation, Kingston, Canada

Citation


Rispin, K., Davis, A.B., Sheafer, V.L. & Wee, J., 2019, ‘Development of the Wheelchair Interface Questionnaire and initial face and content validity’, African Journal of Disability 8(0), a520. https://doi.org/10.4102/ajod.v8i0.520

Original Research

Development of the Wheelchair Interface Questionnaire and initial face and content validity

Karen Rispin, Abigail B. Davis, Vicki L. Sheafer, Joy Wee

Received: 28 Mar. 2018; Accepted: 27 Sept. 2018; Published: 28 Mar. 2019

Copyright: © 2019. The Author(s). Licensee: AOSIS.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background: Because resources are limited in low- and middle-income countries (LMIC), the development of outcome measures is of interest. Wheelchair outcome measures are useful to support evidence-based practice in wheelchair provision.

Objectives: The Wheelchair Interface Questionnaire (WIQ) is being developed to provide a professional perspective on the quality of the interface between a wheelchair and its user. This article discusses the development of the WIQ and its face and content validity.

Method: During field studies in Kenya, we sought to include professional report data on the wheelchair–user interface that could be analysed to inform design changes. None of the existing measures was focused on the interface between users and their wheelchairs. The WIQ was developed to meet this need. To investigate face and content validity, 24 experienced wheelchair professionals participated in a study that included two rounds of an online survey and a focus group in Kenya.

Results: Responses were categorised by topic and the WIQ was modified following each iteration. Participants affirmed the usefulness of a brief professional report measure to provide a snapshot of the user–wheelchair interface. Participants emphasised the importance of brevity, wide applicability and provision of specific feedback for wheelchair modification or design changes. The focus group agreed that the final version provided useful data and was applicable to virtually all wheelchair users in LMIC.

Conclusion: These preliminary studies indicate initial face and content validity of the WIQ as a method for providing a professional perspective on the interface between a user and his or her wheelchair.

Keywords: Outcome measure; wheelchair assessment; user–wheelchair interface; wheelchair appropriateness; professional report.

Introduction

It is estimated that about 1% of the global population requires a wheelchair. A large percentage of the people who do not have access to wheelchairs live in low- and middle-income countries (LMIC) (World Health Organization 2011). In addition, many wheelchairs lack adequate durability, do not provide satisfactory facilitation of mobility or are inappropriate for users’ needs and situations (Pearlman 2006; Visagie et al. 2016). Yet access to effective and appropriate wheelchairs has many important health, economic and social benefits for individuals, as well as societal benefits such as productivity and effective use of health resources (Bray et al. 2014; Visagie et al. 2016; World Health Organization 2011). Because of the growing need for wheelchairs and the issue of wheelchair effectiveness, it is critical to provide evidence-based data to assess wheelchair appropriateness (Cooper, Cooper & Boninger 2008; Hoenig, Giacobbi & Levy 2007; Horn & Gassaway 2007). Outcome measures provide information useful to wheelchair users, therapists, service providers, designers and manufacturers (Cooper et al. 2008). Evidence-based practice is also necessary for the effective use of funds, something that is especially crucial in LMIC (Cooper et al. 2008; Mortenson, Miller & Auger 2008).

Evidence-based practice can involve the appropriate application of individual knowledge of professional experts (Karthikeyan & Paris 2010). Thus, clinical judgement about the interaction between a wheelchair and its user can inform evidence-based practice. In this article, the term ‘interface’ refers to all user–wheelchair interaction. The need for evidence based on clinical judgements in no way minimises the widely recognised importance of patient report outcomes (Burke et al. 2008). However, while patient report measures are based on the experience of wheelchair users, professional report measures are informed by clinical judgement developed from training and experience. Unlike most wheelchair users, wheelchair providers are familiar with a wide range of wheelchair options (Batavia 2010). Wheelchair service providers with depth of wheelchair experience have the broadest base of experience for the assessment of the user–wheelchair interface. This experience informs individual clinical assessment (World Health Organization 2008) and can also inform the development of a brief measure intended for preliminary data or for tracking broad patterns in larger populations. Although based on clinical judgement, the best measure would also reflect an individual user’s experience.

Several characteristics of questionnaires must be considered in the development of a measure proposed to meet these needs. For some questionnaires it is not clear if they are meant to be completed by wheelchair providers or wheelchair users (Kumar et al. 2013; Schmeler et al. 2017). It is important that a questionnaire give information about who should complete it, as well as describe the target audience and purpose of the data collected (Horn & Gassaway 2007; Williams 2003). In addition to lack of specificity to participant population, a lack of specific focus on target information resulting in low discriminatory validity is also a challenge of many questionnaires (Hoenig et al. 2007; May 1997). Some measures are applied to many types of assistive technology (Demers, Weiss-Lambrou & Ska 2002) and as such offer little data on the impact of specific parts of the users’ wheelchair (May 1997). Many wheelchair outcomes are aimed at assessing the users’ ability or quality of life rather than the users’ interface with their wheelchair. As might be expected, these are very sensitive to differences in wheelchair users’ capacity, resulting in any information on the interface being overwhelmed by wide differences in users’ capacity (Kirby et al. 2004; Mills 2003; Mortenson, Miller & Miller-Pogar 2007; Rushton et al. 2011; Stanley et al. 2003). Other tools assess multiple factors together, such as maintenance condition and appropriateness, or combine multiple components into one score (Karmarkar, Collins & Cooper 2009) and consequently have low resolution for data that could result in responsive changes in the design of a specific wheelchair component (Rispin et al. 2017b). To be useful for wheelchair modification and design changes, a tool must also have high discriminatory validity (Jerosch-Herold 2005; May 1997). This means that data should not be grouped in domains in such a way that individual factors become obscured (Williams 2003). Numerical data suitable for parametric statistical analysis, such as data produced by visual analogue score responses, has been shown to increase discriminatory validity (Rispin et al. 2013; Rispin, Tutt & Sosa-Saenze 2016; Walpole et al. 2006; Wewers & Lowe 1990). In addition, a mixed-methods tool that yields both quantitative and qualitative data also increases discriminatory ability, because it provides qualitative explanations, which can be categorised to explain numerical results (Fielding 2012). For example, instead of merely reporting low scores for transferring into and out of a specific wheelchair type, a mixed-methods tool would also report comments, which might refer to armrests, chair height, brakes and so on. The repetition of a specific part that hinders transfers in the comments would allow researchers to discriminate between parts of the wheelchair that are functioning well and those that are not.

For utility in clinical practice and field studies, an outcome measure must be as brief as possible. The length of research questionnaires has an impact on administrative burden, and thus usefulness, for busy professionals (Burns et al. 2008). There exists a tension between brevity and collection of comprehensive data. However, a questionnaire that is too long for general use will yield little useful data in practice. In addition, tracking clients over time is challenging in LMIC (Rispin et al. 2017a), so cross-sectional data collection is more likely to be used than data collected over time. While an instrument appropriate for cross-sectional data collection may also be used over time, it is important that it be able to be used at a single time as well. A professional report tool that is based only on professional opinion could be employed even when wheelchair users and caregivers only speak a local language not held in common with wheelchair professionals, as may occur in LMIC. English is becoming a key global language of higher education and Internet communication with the result that an outcomes tool written in globally accessible English has the broadest scope of use internationally (Park & Wee 2017). Thus, while there is a need for such a questionnaire to have precise wording, there is also a need for simple wording that is easy to understand and translate. Finally, a tool intended for use in LMIC would logically focus on wheelchair types present there, and almost all wheelchairs encountered in most LMIC are manual wheelchairs (Pearlman et al. 2009).

The Wheelchair Interface Questionnaire (WIQ) is being developed to meet the need for a tool to yield highly discriminatory data based on a professional report snapshot of the interface between a user and his or her wheelchair. Our hypothesis was that repeated survey rounds with wheelchair professionals with international experience would support the face and content validity of the WIQ.

Methods

Questionnaire development

The Wheels Project is an interdisciplinary undergraduate research programme started at LeTourneau University in 2010. The Wheels Project partners with a school for children with disabilities in Thika, Kenya, to conduct field studies. The goal of these field studies is to provide manufacturers with data that can spark responsive design changes: changes to wheelchair design based on their function in a real-world environment. In addition to data on durability, user satisfaction and ease of rolling for different wheelchair types, we sought an outcome measure that would provide professional report data specifically on the quality of the interface between a user and his or her wheelchair. Over several years, we collaborated with other wheelchair researchers and conducted informal searches of the available literature seeking to find an outcome measure that would work for this purpose in our studies in Kenya. We attempted to use the Wheelchair Assessment Checklist. However, much of the data concerned wheelchair maintenance condition, and the questions to do with the user–wheelchair interface were categorised and analysed in a way that merged the two data types and merged components (Karmarkar et al. 2009). We then tried to use a simple modification of the Wheelchair Components Questionnaire (Wee & Rispin 2015). However, we found that while this gave distinct information on components, it did not include some key aspects of the interface between a user and a wheelchair.

Development of the WIQ began with a rough draft composed by the research team, informed by experience gained through these earlier studies. The focus of the WIQ was to be solely the interface between users and their wheelchairs. It was not to directly address any other aspect of quality of life. Questions were designed to be specific enough to isolate problems and inform responsive change. To address the need for high discriminatory validity, questions utilised a visual analogue scale format to provide numerical data suitable for parametric statistical analysis, with accompanying comments providing explanatory qualitative data. Like the Wheelchair Components Questionnaire, the WIQ retained questions regarding regions of the wheelchair corresponding to regions of a user’s body. Additional questions were added to the initial draft to assess other aspects of the interface. Because of heterogeneity in the capacity of wheelchair users, these questions had to be worded very carefully to keep a level playing field for all wheelchair users. For example, using the WIQ, mobility should be rated comparatively to the maximum mobility possible for a particular user. This way, an appropriate interface would not receive a low score because its user has very limited mobility. There was a commitment that the questionnaire would be brief and that the language would be clear to those speaking English as a second language.

To avoid difficulties in tracking wheelchair users over time, this tool was to be a snapshot of the quality of the interface between a wheelchair user and his or her wheelchair. To avoid loss of data when a wheelchair user was non-verbal or spoke a different language than the researcher, the WIQ was designed to be completed without verbal interaction with the wheelchair user. In other words, the WIQ did not include a formal interview process and could be completed using solely the rater’s informed clinical opinion based on visual and tactile observation. However, if verbal interaction with the wheelchair user or caregiver was possible, the assessor may choose to broaden their observations to include information obtained from the wheelchair user or caregiver. The assessor’s clinical judgement may sometimes be influenced by these interactions. Similarly, the WIQ does not require the user to perform movements, so raters can assess an interface without communicating actions to the wheelchair user. However, the accuracy of a rating would be improved if the wheelchair user did perform some movements for the rater, so communication is encouraged when possible. The target audience for data resulting from the use of the WIQ was initially wheelchair manufacturers addressing design issues. For example, if wheelchair providers repeatedly give low scores for many users regarding the ease of transfer into and out of a certain type of wheelchair, designers might consider modifications to address that low rating. However, as development continued, the target audience broadened to include service providers in clinical settings.

Methodology for validity study

Any tool used in clinical research must be valid (Karmarkar et al. 2009). Validity is the degree to which a test measures what it is intended to measure (Williams 2003). Face validity, which is considered the initial form of validity, considers whether the tool appears valid to the population qualified to utilise the tool. Content validity takes into account both comprehensiveness and representativeness of the content of a tool (Yaghmale 2009 2003). Content validity is assessed by professional judgement and is improved by the inclusion of at least five experts (Yaghmale 2009). Informed opinion that approaches consensus from multiple experts during the development of a tool indicates the face and content validity of that tool (Burns et al. 2008; Williams 2003; Yaghmale 2009). One method for reaching consensus among experts is called the Delphi method, which involves the conduction of several rounds of a survey, utilising feedback to adjust after each round (Brady 2015). If participants involved have a similar background, only 10–15 participants are needed, and fewer than three rounds may be acceptable for a study (Hsu & Sandford 2007). A Delphi-style survey of wheelchair experts was planned to investigate the face and content validity of the WIQ. At least two Delphi rounds would be included, with the option to continue the survey format or conduct a less traditional focus group.

Participant characteristics

Because wheelchair service providers would be completing the questionnaire, a cadre of service providers was sought as study participants to assist with the development, face validity study and content validity study of the WIQ. A range of service providers was desired, with a majority of occupational therapists and physical therapists. Clinicians known to the researchers and met through professional contacts were invited to participate in the study. Although the WIQ was developed for use in Kenya, it was also intended to be used in other LMIC around the world, so service providers with international wheelchair experience were approached. International experience, defined for this study as experience outside of Europe and North America, was self-reported by participants. For the online surveys, exclusion criteria included less than 5 years of experience, no global wheelchair experience or no measurable certifications or qualifications.

Ethical considerations

The study design was approved by the Institutional Review Board at LeTourneau University in an approval letter (protocol number 1703001174, reference: Biology Department of LeTourneau University).

The first stage of the study included a two-round online survey, loosely based on a Delphi study. A snowball sampling method was used, with those who had initially joined the study recommending others. The survey rounds were followed by an in-person focus group in Kenya for validation expressly in the Kenyan context.

Study design

Participants in all three rounds were given a copy of the latest draft of the WIQ along with background information about the purpose and focus of the WIQ. They then completed a survey, which enabled them to respond to the purpose of the questionnaire, rate the current draft, provide feedback and make recommendations about what would be important to include in such a tool. A total of 17 of the wheelchair professionals invited participated in the two surveys. Surveys were conducted using LimeSurvey version 2.5, an open source application that allowed researchers to develop an original survey, send it to participants and collect responses for analysis. The online format was beneficial because it was accessible to participants anywhere around the world. In addition, responses could be anonymous, allowing for a wide range of opinions to be voiced. Changes were made to the WIQ in response to the first survey round, and an updated draft of the WIQ and LimeSurvey response survey was sent to the participants involved in Round 1 as well as newly invited participants joining the study for the first time. Questions on the LimeSurvey asked participants to rate and comment on the value of and need for the WIQ; the title, format and usefulness; and to rate and respond to individual questions on the questionnaire. Each aspect of the questionnaire and each question was rated on a seven-point Likert scale, with a space for comments. After each round, the ratings were analysed, and the comments were categorised by topic. Questions that received two or more ratings below four on the seven-point scale were changed or deleted. Repeated and important comments were considered in editing each draft of the questionnaire.

After the two online survey rounds, a focus group was conducted in Kenya. Kenya was chosen as a representative low-income country because the researchers were conducting ongoing studies in Kenya and knew there would be a group of wheelchair professionals with broad experience in LMIC present. Nine of these professionals were chosen by convenience sampling to participate in the study. Each participant used the most recent draft of the WIQ to rate the interface between a wheelchair user and his or her chair. Two of the participants used that draft of the WIQ to evaluate more than 20 wheelchair users and their wheelchairs. Fifty WIQs were completed in total. This hands-on experience gave participants insight and understanding of the WIQ. Participants then rated the WIQ on a paper version of the online survey that had been used in the previous two rounds of the study. Subsequently, there was open discussion, which was recorded by a research assistant. Written comments from the paper version of the survey along with comments from the open discussion were categorised and responded to, both in person during the focus group study and during editing of the WIQ.

Results

Because our participants were recruited using snowball sampling, more participants were added throughout the study. Eight participants with global wheelchair experience completed the first round of the survey, with nine additional participants in the second round. Table 1 shows qualifications and years of wheelchair experience for each of the participants. Participants included occupational therapists, physical therapists, seating specialists and medical doctors with experience in rehabilitation and wheelchair provision. Participants in the Kenya focus group included occupational therapists, physical therapists, orthopaedic technologists, wheelchair technicians and one educator with extensive experience working with students in wheelchairs. Two of the focus group participants had been a part of the online survey.

TABLE 1: Study participants for each stage of research (n = 24).†

Table 2 shows mean Likert scores for aspects of the WIQ and topics of the questions included in the final version of the questionnaire. The table is divided by rounds of the online surveys and the focus group in Kenya. As the table shows, the average scores for all final questions were above four on a seven-point scale.

TABLE 2: Mean Likert scores from Delphi Round 1, Round 2 and focus group.

Table 3 shows the participants’ comments from the online survey, categorised by topic. Both Likert scale scores and comments indicated consensus on the need for a questionnaire focused on the user–wheelchair interface and completed by service providers. Participants used comments to indicate what they felt would be important to include in such a tool. There was consensus that the focus on manual wheelchairs was appropriate for use in LMIC. Participants supported the idea that the WIQ would be useful in field studies to provide data to manufacturers that would enable design change. They felt it could also be useful in clinical practice as an initial overview before a more detailed clinical assessment. Comments about the demographic information collected at the top of the questionnaire resulted in the inclusion of a five-point scale for upper body strength and for trunk and head control. Comments strongly emphasised the importance of clear and simple vocabulary easily understood by second language English speakers. It was thought that in the future this would also facilitate translation of the WIQ. Several study participants emphasised the importance of brevity. There was an emphasis on the importance of a tight focus on the wheelchair interface. The importance of grouping body areas according to the impact of different wheelchair regions was discussed to allow for meaningful responsive change in design and fitting. Several participants offered alternative wording of questions on the WIQ.

TABLE 3: The frequency of comments by topic.

In responding to participant comments, questions were simplified, clarified and shortened. The question regarding pain was divided by body region. Several participants suggested that a question regarding toilet activities should be deleted because for many wheelchair users it would not be directly impacted by the user–wheelchair interface, or the factors that were impacted were already addressed in a question about mobility in small spaces. Because this question had low mean ratings, it was deleted. Participants also suggested adding a question regarding postural support and another regarding the facilitation of desk and table activities.

The focus group in Kenya again emphasised the importance of brevity. Consensus was reached that the subtitle should include the term ‘service provider’. It was suggested that service providers mark questions ‘N/A’ for questions that do not apply to the interface they are rating to discriminate between questions that truly do not apply and questions forgotten by a rater. This would minimise the possibility of missing data. Wording for the question regarding the wheelchair’s facilitation of social interaction was discussed and modified. There was consensus that a question regarding a wheelchair’s facilitation or hindering of transfers should be included. This grew out of the assessment of one type of wheelchair. Those with extensive experience with that wheelchair type knew that it consistently hindered transfers and wanted an avenue to provide feedback to manufacturers. The group agreed this was an important part of a user’s interface with his or her wheelchair and came to consensus on wording for this additional question. There was consensus on the value of a questionnaire that can be administered with or without interaction with the wheelchair user. This would enable the WIQ to be useful when a wheelchair user is a child, non-verbal adult or a speaker of a different language. However, there was also consensus on encouraging wheelchair providers to include auditory information from the users and caregivers whenever possible to broaden their frame of reference while rating a wheelchair.

After modification and refinement following each round of the study, the WIQ now has nine questions. The first question regarding pain has sub-questions regarding four body regions that are to be analysed as individual questions. Box 1 shows the wording of the questions on the WIQ. Each question is answered using a visual analogue scale format with an accompanying comment, to yield both qualitative and quantitative data. Figure 1 is an example of a question on the WIQ.

FIGURE 1: An example of a question on the Wheelchair Interface Questionnaire.
BOX 1: The wording of the questions included in the most recent version of the questionnaire.

Discussion

Discussion of results

Input from 24 participants with over 300 combined years of wheelchair experience confirmed and informed the face and content validity of the WIQ and each of its questions. Focus group members’ hands-on experience using the questionnaire informed their feedback about the questionnaire’s content. Our results support the hypothesis that the WIQ has initial face and content validity. With additional reliability and validity testing, it can become a useful tool for assessing the user–wheelchair interface in LMIC.

Agreement among study participants confirmed our hypothesis that a tool to yield professional opinion on the quality of the interface between a wheelchair and user would indeed be useful. There was also agreement that the lack of a standardised level of verbal interaction with a wheelchair user or caregiver would greatly increase the WIQ’s utility and applicability in large studies. The ability to complete the questionnaire without interviewing users allows service providers to assess the wheelchair interface of users who cannot be interviewed. In LMIC, wheelchair providers may not always be able to communicate easily with wheelchair users or their caregivers because of language barriers. In other cases, wheelchair users who are non-verbal or very young may be in an institutional or boarding school situation without a long-term established personal caregiver. Feedback from the focus group confirmed these considerations. However, participants felt that any feedback possible should be considered as part of the observational data informing the wheelchair provider’s professional opinion as expressed through the WIQ.

The fact that the WIQ is intended to be a brief snapshot of the interface between a user and his or her wheelchair at a given moment in time also broadens the venues in which it may be used. At the same time, because the WIQ is a brief questionnaire based solely on a professional opinion of the interface at a given moment in time, it is necessarily much less complete than a clinical relationship with repeated clinical assessments and records kept over a client’s lifespan. While there was feedback that the WIQ might be of clinical use, it would not in any way replace the need for a full assessment or clinical records. Instead, the WIQ could function as an initial indication of what assessment might be needed. Some participants suggested that if thresholds for overall score were established, it could be used as an evidence-based indication of the need for a new chair or a modified chair.

Repeated confirmation that a brief questionnaire using simple language was more likely to be utilised by busy providers reminded researchers to keep questions brief and simple. This facilitates quick comprehension and completion for those who may speak English as a second language, as well as easier translation. Because the WIQ is intended as a professional report tool, and most wheelchair providers have had some variety of post-secondary education, it is likely that the WIQ may need only to be translated into the languages used for higher education.

Unlike measures focused on the quality of life, mobility level, skills or confidence levels of wheelchair users, the WIQ is designed to avoid rating the wheelchair users’ capability level. This was a challenge because it required that questions be written to enable a level playing field for all users. Because the WIQ is intended only for manual wheelchairs, this means that each interface is compared to the assessor’s understanding of the best possible manual wheelchair interface for that user. Yet there will be users who would have benefitted from a power wheelchair. Currently, this is not reflected in the results from the WIQ. In the future, as the global situation changes, a version of the WIQ could be developed to include the option of power wheelchairs.

Participants confirmed the value of the inclusion of questions about specific wheelchair regions. The wheelchair was divided by region, supporting different body parts, rather than by part to avoid loss of data when wheelchairs do not all have the same part: for example, questions ask about postural support instead of about backrests and armrests because a wheelchair may not have an armrest. This division also keeps the questionnaire focused on the wheelchair user. It is interesting that participants wanted to group the questions regarding pain or discomfort into one question but keep aspects of the wheelchair interface divided by body part. This was to enable quicker clinical response to ameliorate problems leading to pain or damage. The WIQ may also enable specific feedback to wheelchair manufacturers if there are repeated characteristic problems with a certain wheelchair type.

Limitations and future work

A greater number of participants would have provided more feedback. Although some study participants had international experience in South America, Africa and Asia, most were from North America and Kenya. The inclusion of wheelchair providers familiar with global wheelchair work delivers a broad framework of experience. However, further studies that include Asian and South American wheelchair providers would be beneficial. The final focus group in Kenya gave an additional level of validation, but limited time in the earlier online survey resulted in only two rounds, diverging from a traditional three-round Delphi-style survey.

Additional validity testing remains to be done. The time to complete the WIQ was not formally tracked, and this needs to be done in a systematic way to confirm that the WIQ is brief enough to be useful in many settings. Inter-rater reliability testing is planned as this is the method most commonly utilised to assess the reliability aspect of validity. It is done by comparing the scores of a group of assessors rating the same subjects. Construct validity compares results from one measure to another somewhat similar measure to see if they move together as expected. A study of construct validity is also planned. Test–retest reliability and other tests remain to be done as well.

The WIQ itself is necessarily limited by a rater’s knowledge, experience, biases and training. Raters’ knowledge is not only limited by their qualifications and experience but also by the level of communication they can have with the user. An important strength of the WIQ is that it does not require a standardised level of communication. However, communication adds to a rater’s depth of understanding, so the variance of communication ability among raters will have at least some impact on their ratings. Because of this intrinsic limitation, the results of the planned inter-rater reliability study are of interest.

Discriminatory validity is the ability of a measure to discern meaningful difference in a sensitive manner. Study participants confirmed the importance of qualitative and quantitative data, as well as that of data that would provide information specific enough to enable responsive modification and design changes. In other questionnaires using a similar format, the visual analogue scale provides continuous quantitative data while the comments provide qualitative data that gives a reason behind the rating (Rispin et al. 2013; Rispin et al. 2017b). High discriminatory validity for the WIQ cannot be confirmed until a large study with multiple sets of 10 or more individuals in different types of wheelchairs is completed. This is planned to confirm that the WIQ is able to identify repeated patterns in specific chair types. For example, the WIQ should be able to identify a design issue that hinders transfers for most users.

Conclusion

This study supports the face and content validity of the WIQ as a measure focused specifically on obtaining professional report data on the interface between a wheelchair user and his or her wheelchair at a specific moment in time. Two rounds of a survey of expert opinion and one focus group supported face and content validity and informed the final draft of the questionnaire. The WIQ is intended to be used by wheelchair providers with a background that enables informed clinical judgement. Questions are designed to identify specific problems with the user–wheelchair interface. When further validation is completed, the WIQ could be used in large field studies to provide data that facilitates responsive design changes by manufacturers. In a clinical setting, the WIQ could indicate problem areas, which could be investigated further in a more detailed clinical assessment.

Acknowledgements

The authors would like to thank LeTourneau University for study approval. They would also like to thank the participants who gave up their time to be a part of this study, both online and in the in-person focus group.

Competing interests

The authors declare that they have no conflicts of interest resulting from any financial or personal relationships.

Authors’ contributions

A.B.D. is a student studying at LeTourneau University in preparation for a career in occupational therapy. Her contributions included implementation of study design method, data collection, preliminary analysis, initial drafting, editing and corresponding with authors. K.R. leads the Wheels Project at LeTourneau University. Her contributions included study design, intellectual content, data analysis, revising and redrafting, and final approval of the article. V.L.S. is the Chair of the Psychology Department at LeTourneau University. Her contributions included research method approval, statistical analysis, intellectual content regarding questionnaire validity, editing and final approval of the article. J.W. is a member of the Colleges of Physicians and Surgeons of B.C. and Ontario; fellow of Royal College of Physicians and Surgeons of Canada. Her contributions included intellectual content regarding clinical implications and revising later drafts of the article.

Funding

The study in Kenya was funded in part by LeTourneau University’s global studies programme and in part by donations from individuals to support the work of the Wheels Project.

References

Batavia, M., 2010, The wheelchair evaluation: A clinician’s guide, Jones & Bartlett Learning. Sudbury, MA.

Brady, S.R., 2015, ‘Utilizing and adapting the Delphi method for use in qualitative research’, International Journal of Qualitative Methods 14(5), 1–6. https://doi.org/10.1177/1609406915621381

Bray, N., Noyes, J., Edwards, R.T. & Harris, N., 2014, ‘Wheelchair interventions, services and provision for disabled children: A mixed-method systematic review and conceptual framework’, BMC Health Services Research 14(1), 309. https://doi.org/10.1186/1472-6963-14-309

Burke, L.B., Kennedy, D.L., Miskala, P.H., Papadopoulos, E.J. & Trentacosti, A.M., 2008, ‘The use of patient reported outcome measures in the evaluation of medical products for regulatory approval’, Clinical Pharmacology & Therapeutics 84(2), 281–283. https://doi.org/10.1038/clpt.2008.128

Burns, K.E., Duffett, M., Kho, M.E., Meade, M.O., Adhikari, N.K., Sinuff, T. et al., 2008, ‘A guide for the design and conduct of self-administered surveys of clinicians’, Canadian Medical Association Journal 179(3), 245–252. https://doi.org/10.1503/cmaj.080372

Cooper, R.A., Cooper, R. & Boninger, M.L., 2008, ‘Trends and issues in wheelchair technologies’, Assistive Technology 20(2), 261–272. https://doi.org/10.1080/10400435.2008.10131933

Demers, L., Weiss-Lambrou, R. & Ska, B., 2002, ‘The Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST 2.0): An overview and recent progress’, Technology and Disability 14, 101–105.

Fielding, N.G., 2012, ‘Triangulation and mixed methods designs data integration with new research technologies’, Journal of Mixed Methods Research 6(2), 124–136. https://doi.org/10.1177/1558689812437101

Hoenig, H., Giacobbi, P. & Levy, C.E., 2007, ‘Methodological challenges confronting researchers of wheeled mobility aids and other assistive technologies’, Disability and Rehabilitation: Assistive Technology 2(3), 159–168. https://doi.org/10.1080/17483100701374405

Horn, S.D. & Gassaway, J., 2007, ‘Practice-based evidence study design for comparative effectiveness research’, Medical Care 45(10), 50–57. https://doi.org/10.1097/MLR.0b013e318070c07b

Hsu, C.C. & Sandford, B.A., 2007, ‘The Delphi technique: Making sense of consensus’, Practical Assessment Research & Evaluation 12(10), 1–8.

Jerosch-Herold, C., 2005, ‘An evidence-based approach to choosing outcome measures: A checklist for the critical appraisal of validity, reliability and responsiveness studies’, The British Journal of Occupational Therapy 68(8), 347–353. https://doi.org/10.1177/030802260506800803

Karmarkar, A.M., Collins, D.M. & Cooper, R.A., 2009, ‘Development of a wheelchair assessment checklist: Preliminary psychometric analyses’, in Proceedings of the Rehabilitation Engineering and Assistive Technology Society of North America Conference, RESNA, New Orleans, LA, June 26, pp. 23–27.

Karthikeyan, G. & Pais, P., 2010, ‘Clinical judgement & evidence-based medicine: Time for reconciliation’, The Indian Journal of Medical Research 132(5), 623.

Kumar, A., Schmeler, M.R., Karmarkar, A.M., Collins, D.M., Cooper, R., Cooper, R. et al., 2013, ‘Test-retest reliability of the functional mobility assessment (FMA): A pilot study’, Disability and Rehabilitation: Assistive Technology 8(3), 213–219. https://doi.org/10.3109/17483107.2012.688240

Kirby, R.L., Dupuis, D.J., MacPhee, A.H., Coolen, A.L., Smith, C., Best, K.L. et al., 2004, ‘The wheelchair skills test (version 2.4): Measurement properties’, Archives of Physical Medicine and Rehabilitation 85(5), 794–804. https://doi.org/10.1016/j.apmr.2003.07.007

May, L., 1997, ‘The challenge of measuring change: Responsiveness of outcomes measurements’, Canadian Journal of Rehabilitation 10(1), 15–24.

Mills, T.L., 2003, ‘Functioning every day with a wheelchair: Development and validation of self-report and performance based observation instrument to measure functional outcomes of seating-mobility intervention’, Doctoral Dissertation, Department of Occupational Therapy, University of Pittsburgh, p. 278.

Mortenson, W.B., Miller, W.C. & Auger, C., 2008, ‘Issues for the selection of wheelchair-specific activity and participation outcome measures: A review’, Archives of Physical Medicine and Rehabilitation 89(6), 1177–1186. https://doi.org/10.1016/j.apmr.2008.01.010

Mortenson, W.B., Miller, W.C. & Miller-Pogar, J., 2007, ‘Measuring wheelchair intervention outcomes: Development of the wheelchair outcome measure’, Disability and Rehabilitation: Assistive Technology 2(5), 275–285. https://doi.org/10.1080/17483100701475863

Park, J.S.Y. & Wee, L., 2017, ‘English as a Lingua Franca: Lessons for language and mobility’, Multilingual Margins: A Journal of Multilingualism from the Periphery 1(1), 40.

Pearlman, J., 2006, ‘Review session: Review of literature on wheelchairs for developing countries & Review of wheelchair provision in developing countries’, Consensus Conference on Wheelchairs for Developing Countries, 6–11 November 2006, Bengaluru, India.

Pearlman, J., Cooper, R., Chhabra, H.S. & Jeffered, A., 2009, ‘Design, development and testing of a low-cost electric powered wheelchair for India’, Disability and Rehabilitation: Assistive Technology 4(1), 42–57. https://doi.org/10.1080/17483100802338440

Rispin, K., Dittmer, M., McLean, J. & Wee, J., 2017a, ‘Preliminary reliability and internal consistency of the wheelchair components questionnaire for condition’, Disability and Rehabilitation: Assistive Technology 12(8), 852–856. https://doi.org/10.1080/17483107.2016.1277793

Rispin, K.L., Hamm, E. & Wee, J., 2017b, ‘Discriminatory validity of the aspects of Wheelchair Mobility Test as demonstrated by a comparison of four wheelchair types designed for use in low-resource areas’, African Journal of Disability 6(0), 332. https://doi.org/10.4102/ajod.v6i0.332

Rispin, K., Goodwin, S., Wesley, C. & Wee, J., 2013, ‘Preliminary development and validation of the wheelchair parts questionnaire for use to assess the condition of individual wheelchairs and the design of types of wheelchairs’, Proceedings of the Rehabilitation Engineering and Assistive Technology Society of North America Conference, RESNA, Bellevue, WA, July 22–24.

Rispin, K., Tutt, E. and Saenz, S.S., 2016 ‘Reliability and discriminatory validity of the preliminary version of Wheelchair Components Questionnaire for users’, Proceedings of the Rehabilitation Engineering and Assistive Technology Society of North America Conference, RESNA, Crystal City, VA, July 12–15.

Rushton, P.W., Miller, W.C., Kirby, R.L., Eng, J.J. & Yip, J., 2011, ‘Development and content validation of the Wheelchair User Confidence Scale: A mixed-methods study’, Disability and Rehabilitation: Assistive Technology 6(1), 57–66. https://doi.org/10.3109/17483107.2010.512970

Schmeler, M. Schein, R., Schiappa, V. & Digiovine, C., 2017, ‘IC04: Update on functional mobility assessment and uniform data set’, International Seating Symposium, University of British Columbia, Nashville, TN, March 2–4.

Stanley, R.K., Stafford, D.J., Rasch, E. & Rodgers, M.M., 2003, ‘Development of a functional assessment measure for manual wheelchair users’, Journal of Rehabilitation Research and Development 40(4), 301. https://doi.org/10.1682/JRRD.2003.07.0301

Visagie, S., Mlambo, T., Van der Veen, J., Nhunzvi, C., Tigere, D. & Scheffler, E., 2016, ‘Impact of structured wheelchair services on satisfaction and function of wheelchair users in Zimbabwe’, African Journal of Disability 5(1), 1–11. https://doi.org/10.4102/ajod.v5i1.222

Walpole, R., Myers, R., Myers, S. & Ye, K., 2006, Probability & statistics for engineers & scientists, 8th edn., Pearson Prentice Hall, Upper Saddle River, NJ.

Wee, J. & Rispin, K., 2015, ‘Piloting the wheelchair components questionnaire for triangulation purposes’, Canadian Association of Physical Medicine & Rehabilitation Annual Scientific Meeting, Canadian Association of Physical Medicine and Rehabilitation, Vancouver, BC, May 20–23, pp. 20–23.

Wewers, M.E. & Lowe, N.K., 1990, ‘A critical review of visual analogue scales in the measurement of clinical phenomena’, Research in Nursing & Health 13(4), 227–236. https://doi.org/10.1002/nur.4770130405

Williams, A., 2003, ‘How to write and analyze a questionnaire’, Journal of Orthodontics 30, 245–252. https://doi.org/10.1093/ortho/30.3.245

World Health Organization, 2011, World report on disability, viewed 19 October 2017, from http://www.who.intl

World Health Organization, 2008, Guidelines on the provision of manual wheelchairs in less resourced settings. WHO Press, Geneva, Switzerland

Yaghmale, F., 2009, ‘Content validity and its estimation’, Journal of Medical Education 3(1).


 

Crossref Citations

1. The maintenance and interface of two wheelchairs used by children with cerebral palsy in Kenya: a cross-sectional study
Jessica Tsotsoros, Hailey Chamberlin, Reagan Collins, Katlyn McDonald, Luke McAuley
Disability and Rehabilitation: Assistive Technology  first page: 1  year: 2024  
doi: 10.1080/17483107.2024.2374047