Welcome
Thank you for taking part in Datalab's BBC recommendations feedback process. Your feedback will contribute to improving the recommendations shown across the BBC.
You will be shown a selection of recently published articles. For each article we would like you to:
- Examine the article, taking note of the headline, publication date news category and summary;
- Examine each of the articles listed below it and consider how appropriate they are as a recommendation within the context of the current article;
- For each listed article, indicate whether you believe the article is:
- In the text box at the bottom of the page, please provide us any additional thoughts and feedback about the recommendations.
| Response | Meaning | Acceptable in production |
|---|---|---|
| Unacceptable | A very bad recommendation. Completely inappropriate and potentially severely damaging to the BBC's reputation. | 0% |
| Inappropriate | A below satisfactory recommendation. Partly relevant but is clearly not appropriate. A small number of these can be tolerated. | Max 15% |
| Satisfactory | An average recommendation. Relevant and/or appropriate but not necessarily what a human would choose. | Min 85% (with Appropriate) |
| Appropriate | A good recommendation. One that an editorial member would be expected to choose. | Min 35% (85% with Satisfactory) |
We'll only ask you to rate up to 30 pages and this should take no more than 30 minutes. Please bear in mind the recommendations generated by our algorithms do not aim to closely mimic editorial behaviour, nor are they intended to match the quality of human curation.
Before we start, please indicate who you are or how often you visit the relevant BBC website under evaluation here. This information is important to us so that we can distinguish between expert editorial feedback and that of others. Please note that this does not affect how recommendations are generated: