91% completed

Task Help

These instructions can always be accessed by clicking the blue question mark icon in the top right of your task interface.

Task Goal:

To identify the quoted sources, arguments, and assertions in the article, so our teammates can evaluate their relevance to the overall article


  1. Understand what the Quoted Source tag is for: quoted people or organizations and what they say or write – even if it is paraphrased. Also highlight information about the quoted source, who they work with, their title, etc.
  2. Note: Do not highlight brief, high-level recaps of what people/organizations may think or say if those people or sources aren’t actually quoted in the article.
  3. Apply Quoted Source tags throughout the document
  4. Update case flags to ensure each source (person or org) and all their quotes/paraphrases have one case flag per source
  5. Understand ‘argument’ in the special sense of one point in a debate. ... Often, we think of an argument as a verbal fight or debate. But within Public Editor (and in other domains) an argument is better defined as a claim that has supporting evidence or reasoning. Attorneys put forth an argument about why a person is guilty (or not). Scientists gather their evidence and then make an argument that the evidence supports a conclusion. In this sense, an argument doesn't require any fight, or even more than one person. Many news articles have only one or two simple points (or arguments) that they are trying to get across. Some articles have their own argument, but also showcase arguments from various people they interview. In this task, we are trying to identify all of those separate arguments, so our teammates can evaluate how strong they are.
  6. Highlight all potential arguments
  7. Understand the difference between an assertion and an argument.
  8. If you highlighted a passage as an argument, but it is actually an assertion. Delete your 'argument' label/s and apply the assertion label.
  9. Understand the difference between an assertion and an assertion that needs a fact check
  10. Switch some assertions to 'needs fact-check' as appropriate.
  11. Note: Assertions that need a fact-check should only be highlighted as ‘needs fact check’
  12. Note: no text should be highlighted as 2 or more of the following: ‘argument,’ ‘assertion,’ or ‘needs fact-check’
  13. Ensure each unique argument/assertion/needs fact-check has its own case flag.
  14. Click Save and Next

Interface shortcuts