{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"86d5885f-bfa7-500e-9a08-ee202e02aecf","task_key":"default--validation--19891","task_revision_id":"1","upstream_id":"19891","short_description":"HellaSwag validation 19891","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to shower quickly [title] Take cold showers. [step] If the water is cold, you may find that you're less inclined to wallow in the shower. Jump into the shower as soon as you turn it on, and try to keep the shower on for under two minutes.\",\"endings\":\"['Beyond efficiency, cold showers can increase alertness, improve circulation, stimulate weight loss, ease stress, and speed muscle recovery. [title] Complete other tasks while the water heats up.', '[title] Keep your hair out of the way. [step] The easiest way to shower from home is to do it yourself.', \\\"Remember to take every precaution that you can to stay cool-it helps with maintaining clean running water. [substeps] Some companies, like john macdonald international, offer quicker showers, but others don't.\\\", 'By doing this, you are taking more water out of your body than if you were standing in the bathroom constantly cleaning your house. [substeps] On average, showers should last between thirty and forty minutes, while a little more is usually enough.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}