{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a1971206-5b79-517a-8d40-6c6a40178e25","task_key":"default--validation--39898","task_revision_id":"1","upstream_id":"39898","short_description":"HellaSwag validation 39898","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to curl hair with a curling iron [title] Heat up the curling iron. [step] Turn on the curling iron and heat it to 320 degrees for fine hair and 430 degrees for thicker hair. Experiment to find the right temperature for you.\",\"endings\":\"['[substeps] Even in a slightly cooler part of the room, a low temperature curling iron will greatly improve your curls. Use a low temperature as high as you comfortably can get it.', \\\"It's best to go with the lowest temperature that does the job. This is going to damage your hair less.\\\", 'Be specific-if you have very thick hair, you might try curling with a lower to medium heat. If you have very thin hair, you might want to curl with a higher or higher heat.', \\\"[substeps] The curling iron's universal setting is roughly 1200 degrees. Larger heat settings will usually lower the temperature to 400 degrees, so use whichever temperature is your preferred.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}