BACKGROUND: Survey research, as a method for data collection, is suffering from low response rates due to the difficulty in contacting respondents and high rates of refusals, and the growing concern is that the low response rates are leading to greater non-response errors in surveys. In addition, where surveys are left in the field for extended periods in order to increase response rates, the time period between data collection and data analysis can be very long, making it difficult to understand emerging problems in anything approaching real time. This exploratory research was funded by CSTE.
METHODS: We tested a new approach to survey data collection to reach respondents where they are, reduce the burden of survey response, and collect data more quickly than traditional survey methods allow. We developed a smartphone app that would push out notifications when new surveys were available to those who downloaded the app and provided basic demographic data. The surveys would be very short and direct (low burden) and tie back into the user's demographic information. The trial population for this initial test of the app was students in the Vermont State College (VSC) system.
RESULTS: We had mixed results in the success of participation, but the study revealed a potential for reaching respondents who might not participate in more burdensome studies. The first discovery was the difficulty in convincing participants to download the app onto their phones; this, essentially, is the greatest barrier to participation through this means. Second, many participants blocked the push notifications, fearing that they would be inundated with survey requests. However, for those who participated, they found the app to be very simple, direct, and user friendly. A focus group of users suggested that they might participate in surveys through this app, whereas they would be very unlikely to participate in more burdensome studies.
CONCLUSIONS: Given the need to push forward with alternative modes for survey data collection, we need to test a multitude of approaches with the notion that there is unlikely to be a single approach that addresses the current problems facing survey research today. The survey app may reach a demographic who are (a) difficult to reach through phone and mail requests and (b) open to sharing information on smartphones.