{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ec30926a-b1ac-596c-be6c-ed1f078daa46","task_key":"default--validation--50547","task_revision_id":"1","upstream_id":"50547","short_description":"HellaSwag validation 50547","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to keep your toddler from biting [title] Know that biting is normal. [step] Your toddler is biting to communicate with you. You must learn what your toddler is trying to say and then make adjustments.\",\"endings\":\"['Wait patiently to look at the bite and respond to what your toddler is saying. Keep quiet and look at your toddler as he is talking to you.', \\\"[substeps] Use positive reinforcement to encourage your toddler to bite. Do not hit your toddler, hit him, pull on his tail, or tease or ridicule your toddler's behavior.\\\", 'Although biting is normal, it is still not acceptable. Typical reasons for biting include : [substeps] Expressing a need or feeling such as anger, frustration, joy, or excitement being overwhelmed by their surroundings tired teething experimenting copying other children seeking attention [title] Determine why your child is biting.', '[substeps] Instruct your toddler to be quiet if she is biting. This will discourage your toddler from biting.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}