{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"227a32ac-c3cb-527b-89ad-cb29332c388f","task_key":"default--validation--39647","task_revision_id":"1","upstream_id":"39647","short_description":"HellaSwag validation 39647","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to implement organic baby care methods [title] Understand the labels. [step] Making organic choices is simple when you know how to read the labels. Don't be confused by fancy marketing terms such as \\\" all natural \\\", \\\" hypoallergenic \\\" or \\\" no growth hormones \\\".\",\"endings\":\"['Organic is the only term that is regulated. [title] Choose a product that is certified organic.', 'You are more likely to find prints that say \\\" biological\\\\' ,\\\\' \\\\' inorganic\\\\', or \\\" organic\\\\'. \\\" [substeps] If you decide to make your own baby care products, consider creating your own labels to protect parts of the food.', 'If you are growing a baby that is already conceived and incubated, it can be easy to forget the real labels. [substeps] Keep in mind that a certain safe, natural formula should not produce higher levels of hormones.', 'Look for one of these terms on a label in your local supermarket: www.multitas.com. [substeps] Read at least three labels before you make your purchase.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}