Web Survey Methodology
The book's primary contribution is the integration of web survey methodology — and its distinctive features — into the broader framework of the established field of survey methodology, which has itself been evolving for over a century. An equally important contribution lies in the definition and delineation of the Core Web Survey Process, which is distinguished from both Preliminary Research Activities and Advanced Analysis, Processing and Validation. The core web survey process is then organized into three phases encompassing twelve stages:
- Pre-fielding: Mode Elaboration, Sampling, Questionnaire Preparation, Technical Preparations, Nonresponse Strategy, and General Management.
- Fielding: Processing and Monitoring, Recruiting, and Measurement.
- Post-fielding: Preliminary Results, Data Preparation, and Data Exporting and Documentation.
This clear conceptual structure enables effective treatment of each stage, supports their interconnection and integration, and allows overarching methodological principles to be applied consistently throughout the process.
Index
Full Table of Contents
- 1. Survey Research and Web Surveys
- 1.1 Definition and Typology
- 1.1.1 Surveys and Web Surveys
- 1.1.2 The Users of Web Surveys
- 1.1.3 Sampling Aspects of Web Surveys
- 1.2 Web Survey Process
- 1.3 Evolution of Web Surveys, Applications and Related Practices
- 1.3.1 Web Surveys vs Internet and Online Surveys
- 1.3.2 Precursors and Alternatives to Web Surveys
- 1.3.3 Rise of Modern Web Surveys
- 1.3.4 The Context of Survey Modes
- 1.3.5 Overview of Advantages and Limitations
- 1.3.5.1 Costs
- 1.3.5.2 Speed of Data Collection
- 1.3.5.3 Ease of Implementation
- 1.3.5.4 Computerization of the Questionnaire
- 1.3.5.5 Multimedia
- 1.3.5.6 Time and Geographic Flexibility
- 1.3.5.7 Self-administration
- 1.3.6 Applications of Web Surveys
- 1.3.6.1 Web Surveys of Highly Covered Specific Populations
- 1.3.6.2 Customer Satisfaction Surveys
- 1.3.6.3 General Population Surveys
- 1.3.6.4 Business Surveys
- 1.3.6.5 Online Panels
- 1.3.6.6 Online Community Surveys
- 1.3.6.7 Website Evaluations
- 1.3.6.8 Entertainment Polls, Questionnaires and Quizzes
- 1.3.7 Related Practices of Web Surveys
- 1.3.7.1 Administrative Forms on the Web
- 1.3.7.2 Internet Testing
- 1.3.7.3 Psychological Web Experiments
- 2. Pre-fielding
- 2.1 Mode Elaboration
- 2.1.1 Selecting the Web Survey Mode
- 2.1.2 Mixed-mode Setting
- 2.1.2.1 Mixed-mode Surveys, Multimode Contacting and Mixed-mode Systems
- 2.1.2.2 Problems with Mixed-mode Surveys
- 2.1.2.3 Web Surveys in Mixed-mode Setting
- 2.2 Sampling
- 2.2.1 Defining Populations
- 2.2.2 Sampling Design Principles in Probability Web Surveys
- 2.2.2.1 Sampling Frames
- 2.2.2.2 Sampling Techniques
- 2.2.2.3 Sample Size
- 2.2.3 Sampling Design Issues in Non-probability Web Surveys
- 2.2.3.1 Recruitment for Non-list-based Web Surveys
- 2.2.3.2 Sampling Design Approximations in Non-probability Setting
- 2.2.4 Statistical Inference in Probability and Non-probability Surveys
- 2.2.4.1 Statistical Inference with Probability Samples
- 2.2.4.2 Statistical Inference with Non-probability Samples
- 2.2.4.3 Deciding on the Probability–Non-probability Sampling Dilemma
- 2.2.4.4 Concluding Remarks on Non-probability Web Surveys
- 2.2.5 Non-coverage Problem
- 2.3 Questionnaire Preparation
- 2.3.1 General Issues
- 2.3.1.1 Typologies of Survey Questions
- 2.3.1.2 Question Development Process
- 2.3.1.3 Question and Questionnaire Design Principles
- 2.3.1.4 Measurement Process and Measurement Errors
- 2.3.1.5 Cognitive Aspect of the Response Process
- 2.3.1.6 Specifics of Non-substantive Responses
- 2.3.1.7 Question Banks
- 2.3.1.8 Specifics of Web Questionnaires
- 2.3.2 Question Types
- 2.3.2.1 Single Item Questions
- 2.3.2.2 Questions with Multiple Items
- 2.3.2.3 Other Question Types
- 2.3.3 Questionnaire Structure, Computerization and Layout
- 2.3.3.1 Structure of the Questionnaire
- 2.3.3.2 Computerization, Interactivity and Dynamics
- 2.3.3.3 Visual Layout
- 2.3.4 Ensuring Survey Engagement
- 2.3.4.1 Engagement, Flow and User Experience
- 2.3.4.2 Survey Gamification
- 2.3.4.3 Questionnaire Length
- 2.3.4.4 Survey Satisficing
- 2.3.5 Web Questionnaire Testing
- 2.3.5.1 Traditional Testing Approaches
- 2.3.5.2 Specific Testing Approaches for Web Questionnaires
- 2.3.6 Integration of Questionnaire Development, Computerization and Testing
- 2.4 Technical Preparations
- 2.4.1 Preparations for Capturing and Organizing Data
- 2.4.1.1 Database Preparations
- 2.4.1.2 Respondent Tracing and Unique Identifiers
- 2.4.1.3 Email Settings
- 2.4.1.4 Sample Management
- 2.4.2 Paradata Collection
- 2.4.2.1 Contact-info Paradata
- 2.4.2.2 Device-type Paradata
- 2.4.2.3 Questionnaire Navigation Paradata
- 2.4.2.4 Software for Collecting Paradata
- 2.4.2.5 Analysis of Paradata
- 2.4.2.6 Paradata Privacy and Ethics
- 2.4.3 Preparations to Support Security and Privacy
- 2.4.3.1 Securing the Server
- 2.4.3.2 Securing the Web Survey Response Process
- 2.4.3.3 Technical Aspects of Anonymity
- 2.4.3.4 Securing Physical and Electronic Access to the Datafile
- 2.4.3.5 Access Auditing
- 2.4.3.6 Relation to Legislation and Professional Standards
- 2.4.4 Technical Pre-testing of Web Survey Software
- 2.5 Nonresponse Strategy
- 2.5.1 General Issues in Web Survey Nonresponse
- 2.5.1.1 Nonresponse Theories
- 2.5.1.2 Nonresponse Process in Web Surveys
- 2.5.1.3 Factors Affecting Web Survey Nonresponse
- 2.5.2 Defining Nonresponse, Breakoffs and Completeness
- 2.5.2.1 Indicators of Unit Nonresponse
- 2.5.2.2 Breakoffs
- 2.5.2.3 Item Nonresponse at the Question Level
- 2.5.2.4 Item Nonresponse at Unit Level
- 2.5.2.5 Completes, Partials and Unusable Units
- 2.5.3 Relation between Nonresponse Rates and Nonresponse Biases
- 2.5.4 General Web Survey Design Characteristics and Nonresponse
- 2.5.4.1 Survey Sponsor
- 2.5.4.2 Topic Salience
- 2.5.4.3 Questionnaire Design
- 2.5.5 Incentives in Web Surveys
- 2.5.6 The Role of the Contacting Process: Mode, Timing and Frequency
- 2.5.6.1 Mode of Contact
- 2.5.6.2 Day and Time of Sending Invitations
- 2.5.6.3 Number of Contacts and Their Scheduling
- 2.5.6.4 Length of the Fieldwork Period
- 2.5.7 Specifics of the Invitation Format
- 2.5.7.1 Personalization of the Invitations
- 2.5.7.2 Providing Motivation and Tone of Request
- 2.5.7.3 Format and Visual Design of Email Invitations
- 2.5.8 Towards a Nonresponse Strategy
- 2.6 General Management
- 3. Fielding
- 3.1 Recruiting
- 3.2 Measurement
- 3.3 Processing and Monitoring
- 3.3.1 Activation, Soft Launch, Full Launch and Deactivation
- 3.3.2 Providing Help
- 3.3.3 Fieldwork Interventions
- 3.3.4 Monitoring of the Fieldwork Process
- 4. Post-fielding
- 4.1 Data Preparation
- 4.1.1 Establishing Response Statuses
- 4.1.1.1 Eligibility, Completeness and Quality Status of the Units
- 4.1.1.2 Missing Values and Non-substantive Responses
- 4.1.1.3 Reporting on Response Statuses
- 4.1.2 Validation and Editing
- 4.1.3 Imputations
- 4.1.4 Weighting
- 4.1.5 Coding and Recoding
- 4.2 Preliminary Results
- 4.2.1 Reporting
- 4.2.2 Dissemination
- 4.3 Data Exporting and Documentation
- 4.3.1 Data Exporting
- 4.3.2 Statistical Disclosure
- 4.3.3 Documentation
- 4.3.4 Data Archiving
- 5. Selected Topics in Web Survey Implementation
- 5.1 Smartphones, Tablets and Other Devices
- 5.1.1 Introduction to Multiple Devices
- 5.1.2 Survey Strategies for Handling Mobile Devices
- 5.1.3 Device Effects
- 5.1.4 Designing Web Questionnaires for Smartphones
- 5.1.5 Browser-based Mobile Surveys vs Mobile Survey Apps
- 5.1.6 Software for Multi-device Web Surveys and Mobile Survey Apps
- 5.1.7 Challenges and Conclusions
- 5.2 Online Panels
- 5.2.1 Terminology and Typology
- 5.2.2 Recruitment, Sampling and Selection
- 5.2.2.1 Recruitment Methods for Non-probability Online Panels
- 5.2.2.2 Recruitment Methods for Probability Online Panels
- 5.2.2.3 Sampling and Selecting Online Panel Members for Individual Surveys
- 5.2.3 Maintaining an Online Panel
- 5.2.4 Online Panel Study Designs
- 5.2.5 Online Panel Data Quality
- 5.2.5.1 Comparison of Online Panel Data Quality and Results
- 5.2.5.2 Effect of Weighting on Online Panel Data Quality
- 5.2.5.3 Other Data Quality Issues in Online Panel Research
- 5.2.5.4 Conclusions on Online Panel Data Quality
- 5.2.6 Buying Online Panel Research
- 5.2.7 The Future of Online Panels
- 5.3 Web Survey Software
- 5.3.1 Integrated ICT Support for the Web Survey Process
- 5.3.2 The Web Survey Software Market
- 5.3.3 Characteristics of Web Survey Software
- 5.3.4 Discussion of Two Selected Features
- 5.3.4.1 Interface Speed
- 5.3.4.2 Critical Features of the GUI
- 5.3.5 Finding the Right Tool
- 5.3.6 Trends in Web Survey Software
- 6. Broader Context of Web Surveys
- 6.1 Broader Methodological Context
- 6.1.1 Web Survey Mode Revised
- 6.1.2 Total Survey Error and Survey Data Quality
- 6.1.3 Evaluation of the Web Survey Mode Effect
- 6.1.4 Cost-error Optimization
- 6.1.5 Beyond the Core Web Survey Process
- 6.1.5.1 The Step of Preliminary Research Activities
- 6.1.5.2 The Step of Advanced Analysis, Processing and Valorization
- 6.1.5.3 Mixed-modes
- 6.1.5.4 Mixed Methods
- 6.1.6 Towards Interactive Fieldwork Design
- 6.2 Web Surveys within the Project Management Framework
- 6.3 The Web Survey Profession
- 6.3.1 Related Disciplines
- 6.3.2 Legal Issues
- 6.3.3 General Ethical Concerns
- 6.3.4 Formalized Certificates, Codes and Standards
- 6.3.5 Informal Guides, Recommendations and Other Material
- 6.4 Web Survey Bibliography
- 7. Future of Web Surveys
- 7.1 General Technological Developments
- 7.2 Web Survey Software
- 7.3 Methodology
- 7.4 Broader Business and Societal Issues
- 8. Conclusions
- In addition:
- Bibliography
- Author Index
- Subject Index
Supplements
Question types in web surveys
Extended treatment of question types used in web surveys, with examples and notes on suitability, layout and measurement quality.
DownloadInternet statistics
Companion overview of Internet usage statistics, sources and indicators that inform the coverage and design of web surveys.
DownloadFrequency of question types in web surveys
Empirical overview of question type frequencies based on half a million questions from 30,000 web survey questionnaires built in an open-source web survey platform.
DownloadStudy on working conditions in Slovenian science
Supplementary case study reporting on a web survey of working conditions among researchers in Slovenian science.
DownloadStatistics of WebSM bibliography database
Overview of the WebSM bibliography database with an analysis of the authorship network observable from its resources.
DownloadExamples of response rate calculations
Examples of response rate calculations, with a discussion of the RR2' approximation of AAPOR Response Rate 2 in practice.
DownloadEverything that accompanies the volume
Full Online Access
Read every chapter freely, with searchable text and citations.
OpenChinese Translation
Authorised translation of the complete volume.
OpenGlossary
Definitions for the field's core methodological vocabulary.
OpenExtended Index
Detailed cross-references across all eleven chapters.
OpenErrata
Acknowledged corrections to the first edition.
OpenFeedback & Questions
Direct line to the authors for academic correspondence.
OpenWritten for the communities advancing survey science
Students
A structured introduction to methodology for graduate coursework.
Researchers
A consolidated reference for empirical and theoretical work.
Survey Professionals
Practical guidance grounded in two decades of evidence.
Market Researchers
Frameworks for valid online measurement in commercial settings.
Official Statistics Agencies
Standards for population-level web data collection.
Write to the authors
Share feedback on the book or ask the authors a methodological question. We read every message.
