Approach

We work collaboratively, developing a set of indicators according to open standards and sharing the results of our distributed tests and validations.

The Credibility Coalition fosters the development of a structure for interpreting credibility in news articles in two ways:

  • through the collaborative definition and refinement of the credibility indicator framework itself,
  • and the sponsoring of attempts to validate the framework through research, receiving feedback towards the next version of indicators.
Overview of Credibility Coalition conceptual workflow

This workflow outlines our current path for assessing news for credibility, and contrasts the work of the Coalition (on the left) from the role of interpretation (on the right) by researchers, platforms, or automated systems.

Project: W3C Group on Credibility

October 2017 - present

The mission of the W3C Credible Web Community Group is to help shift the Web toward more trustworthy content without increasing censorship or social division. We want users to be able to tell when content is reliable, accurate, and shared in good faith, and to help them steer away from deceptive content. At the same time, we affirm the need for users to find the content they want and to interact freely in the communities they choose. To balance any conflict between these goals, we are committed to providing technologies which keep end-users in control of their Web experience.

Project: R1 Indicator Annotation and Assessment

October 2017 - present

For this research, members are collaboratively developing an initial set of indicators for article credibility. Indicators originate from both within an article’s text as well as from external sources or article metadata. As a proof-of-concept, trained individuals in late 2017/early 2018 annotated a dataset of 40 articles of varying credibility with selected indicators using specialized platforms. Future steps for this initiative are being outlined, which include: expanding annotation efforts, broadening the set of indicators, and considering their use by platforms and the public towards the development of interoperable standards for content credibility.

Notes

The results of the first annotation effort are being presented at WebConf 2018 in Lyon, France. Related papers and data can be found on the Results page.

(Clockwise from upper right) Patricia Martin, Joel Schlosser and Connie Moon Sehat discuss ideas during a breakout session at the 2017 New York working group meeting. Photo courtesy the Brown Institute.