{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"369d1218-91c8-51d2-afd7-e31db7f1e398","task_key":"default--validation--1504","task_revision_id":"1","upstream_id":"1504","short_description":"HellaSwag validation 1504","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to deal with your child being expelled from school in australia [title] Know what it is. [step] Expulsion from school means that the child is no longer allowed to attend school at that institution. This is different from suspension where the child is banned from attending school for 1-20 days.\",\"endings\":\"['Your child will not be allowed to attend school for another 3 days when he is expelled. Unless he is suspended, he will be absent for at least a month.', '[substeps] There are different types of expulsions from school. The main two types are expulsion and cancellation of enrolment.', 'The school must be aware of this so they can correct the inappropriate behaviour. [substeps] The child must also know why they are being expelled.', 'This period is the shortest period of time for the child and usually only lasts 4 weeks. A child who has been expelled from school typically cannot miss the day of the school year.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}