{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bd75b48f-2f50-51f6-a861-f3264dfd8f2c","task_key":"default--validation--19774","task_revision_id":"1","upstream_id":"19774","short_description":"HellaSwag validation 19774","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to stop biting your lips [title] Anticipate your biting. [step] Notice when you bite, and reflect on how you feel. You might have the habit of biting your lips when you're feeling anxious, or bored.\",\"endings\":\"[\\\"What drives the habit? How do you know if biting is something you want to keep trying to change? [substeps] Oftentimes biting the wrong kind of lip keeps you from having the same kind of control. For example, you might like to bite your lips because you're stressed or because you want someone to kiss you.\\\", \\\"Tell yourself when you are about to enter a situation that might prompt biting, so you will be on the alert. [substeps] In many cases, biting is just one of several physical signs that you're feeling anxious.\\\", \\\"Either way, it's important to find out what triggers that behavior. [substeps] If you think that biting your lips can cause pain, try to decide what triggers you to bite your lips.\\\", 'In most situations, anxious people tend to bite their lips, while bored people often bite their lips. If you routinely experience lip biting, consider changing your habit.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}