{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3b1dd3b6-a276-5372-8057-c7824eefb04f","task_key":"default--validation--19032","task_revision_id":"1","upstream_id":"19032","short_description":"HellaSwag validation 19032","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to stop sweet cravings [title] Watch for emotional triggers. [step] Sweet cravings are triggered because you are hungry. Often these cravings are emotionally triggered.\",\"endings\":\"['If your cravings are triggered by certain foods or scenes (such as small business bad, job bad, family bad, etc. ) it can be difficult to taper off like a sweet craving.', 'Watch for signs of emotional withdrawal or leftover meal cravings. You might notice you feel like your typical, tasty snack is gone.', 'Think about the last time you started craving sweets. What were you feeling? Maybe bored, stressed, lonely, celebratory, or worried? It is helpful to understand any emotional triggers in order to create the best plan to address those sweet cravings.', 'These cravings could include : [substeps] An empty stomach you crave 20 calories or more a burning or grogginess or sensitivity when eating. A sudden change in energy, or a vague feeling of emptiness.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}