{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"485bcd23-a3be-52f8-9575-af4e8493c9f8","task_key":"default--validation--31975","task_revision_id":"1","upstream_id":"31975","short_description":"HellaSwag validation 31975","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to curl hair [title] Heat up the curling iron. [step] Most curling irons will need about 1-5 minutes to heat up before you can use them. If you try to curl your hair with the iron before it reaches the correct temperature, the curls will not hold.\",\"endings\":\"[\\\"[substeps] It's important to try to use a medium-to high heat setting, or else you may electrocute your curls. If you do not have the help of a manual curling iron, you can use another curling tool, such as a hair straightener, to find the proper heat temperature.\\\", '[substeps] Some curling irons will have different settings which you can play around with until you achieve the best result. Try to keep it at the lowest temperature possible though, to cause less damage to your hair.', '[substeps] Check your curling iron\\\\'s temperature even if it says to \\\" about 1, \\\" then you\\\\'ll need to make a quick check-up before if you want to squeeze out all of the curls. [title] Scrunch your hair into a loose spiral.', 'Think about this: the curling iron will hold hair in place for a little longer if you use it very little. If you have thick hair, use 1-2 minutes of heat.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}