{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"91b8c79d-e500-565d-be14-6f1d69a06b0b","task_key":"default--validation--32452","task_revision_id":"1","upstream_id":"32452","short_description":"HellaSwag validation 32452","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help your child create a travel journal [title] Before you go, talk to your child and find out what they would like. [step] More creative children may want to draw pictures, others may want stickers or to write in colourful pens. This is their journal, so let them pick what they want and let creativity reign.\",\"endings\":\"['Just go with what it feels like, it will take time and energy. [substeps] Many children use these as inspiration tools and are similar to erasers.', '[substeps] Parents may decide upon which information they will want to include in this journal. [title] Establish a time and place as before.', '[title] This journal can have a page that outlines any needs the child is having and also words needed. [step] You could include your address in it.', \\\"Materials you may need are: pens, pencils, a notebook/paper, glue stick (for pictures, menus etc), coloured pencils, stickers/other design products. [substeps] Children don't need leather bound books for their journals.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}