{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2ab59c67-4c5c-5d98-8ad1-7cf5f1837a77","task_key":"default--validation--45247","task_revision_id":"1","upstream_id":"45247","short_description":"HellaSwag validation 45247","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to choose a bikini [title] Select a tankini if you are apple shaped. [step] Apple shapes have a larger midsection and thin legs and arms. Tankinis with shirring or shapewear in the stomach can draw attention away from that area.\",\"endings\":\"['Wedges can draw attention upward toward the buttocks, while loud designs such as polka dots or rainbows can draw more attention towards the thighs. Excessive ruffles can also draw attention upward toward your waist and help draw attention away from your breasts.', 'People with thighs or larger bodies should wear bikini tops that are similar to this. [title] Select a cover up that covers most of the rest of the body.', '[substeps] If you have a slim frame and wide shoulders, try a rectangular tank top made of linen or cotton, as this can make for a flexible and effortless look. [title] Go for a full swimsuit if you are breastfeeding.', 'A bottom with high cut sides will show off your legs. [title] Pick a ruffle bikini if you have an athletic shape.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}