{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8e160fae-c1b4-5ad5-aaf8-95c749e196c7","task_key":"default--validation--2539","task_revision_id":"1","upstream_id":"2539","short_description":"HellaSwag validation 2539","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to help a child overcome a fear of bugs [title] Take note of how you respond to bugs. [step] Spend some time paying attention to your own reaction to bugs. If you flinch, swat, or squash every bug you come across, the child's fear may stem from your own.\",\"endings\":\"['Observing yourself helps brings awareness, so you can start reacting in a more positive and helpful way. [title] Model being calm and collected around bugs.', 'It is important to give them time to understand why they should not trust bugs or insects. [substeps] If you react out of fear, the child may not understand why they should not trust bugs.', 'For example, if you hear a certain sound, you may react to that sound with more intense responses. [title] Keep an eye out for hidden cockroaches, bugs, and worms.', \\\"[substeps] This reaction may include shock, recoil, and even the onset of mild anger. [title] Discuss the different types of bugs with your child's teacher.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}