RLHF

1. Annotation interface

1.1 Data Presentation Area

  • User input
  • Model output

1.2 Annotation Operation Area

  • [Single Choice]: Configure single-choice labels in task settings, set up questions and options on properties.
  • [Multiple Choice]: Configure multiple-choice labels in task settings, and set up questions and options on properties.
  • [Text]: Configure text labels in task settings, set up questions on properties.
  • [Number]: Configure number labels in task settings, set up questions on properties.

1.3 Entry Operation Bar

  • [Save]: Temporarily save the current annotations. Exiting the interface or closing the browser will not affect saved data.
  • [Discard]: Abandon the current entry, which will be automatically categorized as "Discarded" and not counted.
  • [Skip]: Skip the current entry, which will be automatically categorized as "Skipped."
  • [Submit]: Complete and submit the annotation for the current entry.