{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eea53f11-2885-5093-b6ae-1aa88a7d8a4c","task_key":"default--validation--45468","task_revision_id":"1","upstream_id":"45468","short_description":"HellaSwag validation 45468","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach kids the difference between reporting and tattling [title] Teach your child when they should report. [step] It is not tattling if the child is concerned that they or another child may be hurt or in danger. Explain to your child what danger and unsafe situations mean.\",\"endings\":\"['[substeps] For example, your child may think that you are making a big deal out of police misconduct, which could ruin his or her life. Gently explain the importance of reporting as a kind of punishment.', 'If you are unsure that the claim is legitimate or necessary, ask the child to explain the situation. [substeps] For example, it is reporting and not tattling if one child pushes another child down and causes injury.', '[substeps] For example, you may explain that accidents happen. Say, \\\" when someone climbs up a hotel ladder, it\\\\'s suicide, and the person who jumped is hurt.', 'Tell your child, \\\" if it hurts you, you should report it right away. \\\" work on explaining to them why it is unsafe.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}