{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0fde2248-fa92-5128-b5d2-fc9d6d6ab198","task_key":"default--validation--48662","task_revision_id":"1","upstream_id":"48662","short_description":"HellaSwag validation 48662","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to address abuse in polyamory [title] Understand the various manifestations of abuse. [step] Become informed about common (and not so common) ways that abuse can manifest in polyamory. This is one way you can protect yourself and others against it.\",\"endings\":\"['[substeps] Polyamory is especially important for individuals living in abusive relationships. If you are an individual, have a strong need to protect yourself from abuse.', 'Make detailed notes on all of your sessions, so that you can replace any reference to abusive abuses with the appropriate language and case law. [substeps] Find a directory at http: // www.blackhouse.', 'Read as much as you can, and most importantly, trust your gut. Below are some examples of poly-specific abuse patterns.', '[substeps] Men can develop self-starvation at a young age due to the feeling of powerlessness that there is never enough food to fulfill their needs. Women get abused at an early age due to the feeling of isolation and helplessness around the age of five when they are capable of full functioning.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}