by Carolyn Doi
Education and Music Library, University of Saskatchewan
You’ve designed a survey, found the right participants, and waited patiently while responses come streaming in. The initial look at responses can be thrilling, but what happens next? I’ve used questionnaires as a data collection technique, and made the mistake of thinking the work is over once the survey closes. Kelley, Clark, Brown and Sitzia warn us about treating survey research as a method requiring little planning or time:
“Above all, survey research should not be seen as an easy, ‘quick and dirty’ option; such work may adequately fulfil local needs… but will not stand up to academic scrutiny and will not be regarded as having much value as a contribution to knowledge.”1
Let’s consider some steps to explore once data collection has been completed.
1) Data cleaning and analysis
Raw survey data is usually anything but readable. It takes some work to transform results into meaningful and shareable research findings. First of all, familiarize yourself with some of the relevant terminology, before moving on to actually working with the data. Before touching the dataset, you’re going to need to create four worksheets, one for raw data, one for cleaning in progress, one for cleaned data, and one for data analysis. Each worksheet shows a stage in the process, which will allow you to backtrack, or find errors. If you haven’t taken a stats class recently, I like this introductory Evaluation Toolkit, which clearly describes the processes of cleaning, tabulation, and analysis for both quantitative and qualitative data.
2) Visualization and reporting
Consider data visualization to bring your survey data to life, but remember to choose a visualization tool that makes sense for the data you’re trying to represent. The data visualization catalogue is a handy tool to learn more about the purpose, function, anatomy, and limitations of a wide range of visualizations. It includes links to software and examples of each visualization. There are lots of free or inexpensive programs to help create visualization including Microsoft excel, Google sheets, or Tableau Public. If you’re looking for some inspiration, take a browse through the stunning work of Information is Beautiful for ideas.
Likely you will want to share the outcomes of your research, either at your institution or in a paper or presentation. Kelley, Clark, Brown, and Sitzia provide a great checklist of information to include when reporting on any survey results, including research purpose, context, how the research was done, methods, results, interpretation, and recommendations.2 Clarity and transparency in the research process will help your audience to better understand and evaluate the research and its applicability to their context.
3) Data preservation and access
Consider an open data repository such as the Dataverse Project to make your data discoverable and accessible. Sharing your data comes with benefits such as “web visibility, academic credit, and increased citation counts.” You may also be required to archive your data to satisfy a data management plan or grant funding requirements, such as those from the Tri-Council. When archiving in a repository, remember to share your data in an accessible file format, and include accompanying files such as a codebook, project description, survey instrument, and outputs such as the associated report or paper. As a rule of thumb, aim to provide enough documentation that another researcher would be able to replicate your study. A dataset is a publication that you can cite in your CV, ORCID profile, in a paper, or presentation. Doing so is a great way encourage others to learn about your research or to build on your research project.
Getting your hands dirty and working directly with survey data is where you’ll be able to explore and eventually tell a compelling story based on your research. Be curious, persistent, and enjoy the process of research discovery!
1KATE KELLEY, BELINDA CLARK, VIVIENNE BROWN, JOHN SITZIA; Good practice in the conduct and reporting of survey research, International Journal for Quality in Health Care, Volume 15, Issue 3, 1 May 2003, Pages 261–266, https://doi.org/10.1093/intqhc/mzg031
2Ibid. p. 265.
This article gives the views of the author(s) and not necessarily the views of the Centre for Evidence Based Library and Information Practice or the University Library, University of Saskatchewan.