Predicting essay quality from search and writing behavior

  • Few studies have investigated how search behavior affects complex writing tasks. We analyze a dataset of 150 long essays whose authors searched the ClueWeb09 corpus for source material, while all querying, clicking, and writing activity was meticulously recorded. We model the effect of search and writing behavior on essay quality using path analysis. Since the boil-down and build-up writingFew studies have investigated how search behavior affects complex writing tasks. We analyze a dataset of 150 long essays whose authors searched the ClueWeb09 corpus for source material, while all querying, clicking, and writing activity was meticulously recorded. We model the effect of search and writing behavior on essay quality using path analysis. Since the boil-down and build-up writing strategies identified in previous research have been found to affect search behavior, we model each writing strategy separately. Our analysis shows that the search process contributes significantly to essay quality through both direct and mediated effects, while the author's writing strategy moderates this relationship. Our models explain 25–35% of the variation in essay quality through rather simple search and writing process characteristics alone, a fact that has implications on how search engines could personalize result pages for writing tasks. Authors' writing strategies and associated searching patterns differ, producing differences in essay quality. In a nutshell: essay quality improves if search and writing strategies harmonize—build-up writers benefit from focused, in-depth querying, while boil-down writers fare better with a broader and shallower querying strategy.show moreshow less

Download full text files

Export metadata

Additional Services

Share in Twitter Search Google Scholar
Metadaten
Document Type:Article
Author: Pertti Vakkari, Michael VölskeORCiDGND, Martin PotthastGND, Matthias HagenGND, Prof. Dr. Benno SteinORCiDGND
DOI (Cite-Link):https://doi.org/10.1002/asi.24451Cite-Link
URN (Cite-Link):https://nbn-resolving.org/urn:nbn:de:gbv:wim2-20210804-44692Cite-Link
URL:https://asistdl.onlinelibrary.wiley.com/doi/10.1002/asi.24451
Parent Title (English):Journal of Association for Information Science and Technology
Publisher:Wiley
Place of publication:Hoboken, NJ
Language:English
Date of Publication (online):2021/07/30
Date of first Publication:2021/01/22
Release Date:2021/08/04
Publishing Institution:Bauhaus-Universität Weimar
Institutes and partner institutions:Fakultät Medien / Professur Content Management - Web-Technologien
Volume:2021
Issue:volume 72, issue 7
Pagenumber:14
First Page:839
Last Page:852
Tag:Aufsatz; Pfadanalyse; Suchmaschine; Suchverhalten
GND Keyword:Information Retrieval; Textproduktion; Suchverfahren
Dewey Decimal Classification:000 Informatik, Informationswissenschaft, allgemeine Werke / 000 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik
BKL-Classification:06 Information und Dokumentation / 06.74 Informationssysteme
Licence (German):License Logo Creative Commons 4.0 - Namensnennung (CC BY 4.0)