{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"afc3d026-dec4-5b2e-aa04-c05d09b1e53a","task_key":"default--validation--28622","task_revision_id":"1","upstream_id":"28622","short_description":"HellaSwag validation 28622","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look sexy when naked [title] Choose flattering lighting. [step] The right lighting can enhance the mood and improve your confidence. Aim for soft, dim lighting.\",\"endings\":\"['[substeps] The right lighting will help reflect the moisture from your skin and add shine to your outfit. Never be as bright as possible-take care of your skin.', 'This kind of lighting softens your features and many photographers recommend it for looking your best. This type of lighting can be achieved by low overhead lighting or turning on only one lamp in the room.', \\\"Consider showing off your arms so that it's flattering to your body. If you are going to try to look sexy without clearly displaying these body parts, what do you do? Use your legs, which are the sides where the lips are.\\\", 'It can be hard to see the eyes because pose is tilted upwards at a very slight angle. [substeps] Aim for a soft, neutral day when you know the sun is out.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}