{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9a4b4f14-2399-593e-914f-8c3ab4bca0fd","task_key":"default--validation--44021","task_revision_id":"1","upstream_id":"44021","short_description":"HellaSwag validation 44021","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear a scarf [title] Wrap it in a simple loop. [step] Of one of the most basic and attractive ways of wearing a scarf is just wrapping it in a loop around your neck. Wrap the scarf around your neck to create a single loop, with the tail ends loosely draped in the front.\",\"endings\":\"['This will make it look like a scarf is wrapped around a particularly desirable part of your body. [substeps] Tie the loop into a simple knot so that the loop, with the tail ends, can be seen and stood out.', \\\"Pull on the loop a bit to loosen it up and create a more casual appearance. If you're trying to beat the cold, you can wrap the scarf multiple times around your neck.\\\", 'You can hook the tail end over your shoulder or tie a knot at the end. [substeps] Never wrap the scarf around your neck.', 'Then, round the loop at the end to create smaller loops that connect more naturally to the scarf. Keep the loop to your neck for a more casual look.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}