{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3229ad32-39c0-5f95-8381-9fefdf4ab504","task_key":"default--validation--48436","task_revision_id":"1","upstream_id":"48436","short_description":"HellaSwag validation 48436","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to start a single parent support group [title] Determine the best way to run your support group. [step] You can have an online group, or one that meets in person. [substeps] Remember that there are already several online resources for single parents.\",\"endings\":\"['You can join established groups including parents without partners and single parents network online. A group that meets in person would likely be more meaningful for single parents.', 'If you meet over the phone, ensure that you receive internet connectivity. Try contacting your phone company to make sure.', 'Pinterest, bing, and forums are great options. Look for groups that are local to your area.', 'Search for the appropriate name for a group and a page detailing the resources. Be creative and pick a name that is easy to remember (which is okay to do, but important to you) and is appropriate to your group.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}