{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0965b922-62b9-5eca-ad31-7ad339c923de","task_key":"default--validation--49860","task_revision_id":"1","upstream_id":"49860","short_description":"HellaSwag validation 49860","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to support your daughter when she moves away from home [title] Tell her you believe in her. [step] One of the most important things for a child to learn is to trust herself. Show her this by having faith in her.\",\"endings\":\"['When she leaves the safety of your home, you will want to know that she feels confident and trusts her own instincts and ability to take care of herself. The more sure of this she is, the better off she will be.', \\\"[substeps] If you can maintain faith, this should help her know that her goodbye is far in front of her. It's important for both parents to be on the same page when a child is deciding to move away.\\\", \\\"That has always been the recommendation of her aunt sally at the time of her parents' deaths. Tell her that she can come home to talk to her friends, hang out with them, and go to school when she is ready.\\\", 'You should also be willing to share your thoughts and dreams about going away. This should come through in your social interactions with her.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}