Operationalizing Framing to Support Multiperspective Recommendations of Opinion Pieces

Mats Mulder*, Oana Inel, Jasper Oosterman, Nava Tintarev

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review


Diversity in personalized news recommender systems is often defined as dissimilarity, and operationalized based on topic diversity (e.g., corona versus farmers strike). Diversity in news media, however, is understood as multiperspectivity (e.g., different opinions on corona measures), and arguably a key responsibility of the press in a democratic society. While viewpoint diversity is often considered synonymous with source diversity in communication science domain, in this paper, we take a computational view. We operationalize the notion of framing, adopted from communication science. We apply this notion to a re-ranking of topic-relevant recommended lists, to form the basis of a novel viewpoint diversification method. Our offline evaluation indicates that the proposed method is capable of enhancing the viewpoint diversity of recommendation lists according to a diversity metric from literature. In an online study, on the Blendle platform, a Dutch news aggregator, with more than 2000 users, we found that users are willing to consume viewpoint diverse news recommendations. We also found that presentation characteristics significantly influence the reading behaviour of diverse recommendations. These results suggest that future research on presentation aspects of recommendations can be just as important as novel viewpoint diversification methods to truly achieve multiperspectivity in online news environments.

Original languageEnglish
Title of host publicationFAccT '21: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
Number of pages11
Publication statusPublished - 2021
EventACM FAccT Conference 2021 - Online, ACM, New York, United States
Duration: 3 Mar 202110 Mar 2021
Conference number: 4


ConferenceACM FAccT Conference 2021
Abbreviated titleACM FAccT 2021
Country/TerritoryUnited States
CityNew York
Internet address


Dive into the research topics of 'Operationalizing Framing to Support Multiperspective Recommendations of Opinion Pieces'. Together they form a unique fingerprint.

Cite this