{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"138c5454-111f-5c73-ae8c-98b7f6e58c9d","task_key":"default--validation--11889","task_revision_id":"1","upstream_id":"11889","short_description":"HellaSwag validation 11889","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your hair look naturally curly [title] Avoid brushing out your freshly washed hair. [step] Brushing or combing out your hair after washing it will encourage your hair to look straighter. Instead, apply conditioner in the shower, then use a wide-toothed comb to detangle and distribute it.\",\"endings\":\"['Doing this ensures the strands are thoroughly detangled and tangle free without adding additional breakage. [substeps] Make sure to use a wide-toothed comb to get away from your roots when brushing.', '[title] Cut your hair at the roots if your hair is shorter. [step] Split-ends can lead to damage to hair follicles, so try cutting your hair at the roots during your wash, when possible.', 'Rinse as usual, and avoid brushing it out after that. [title] Towel-dry gently using the \\\" twist and press \\\" technique.', 'For deep-conditioning spray, look for a conditioner that contains a built-in protein, such as a extract or mineral supplement. Follow the instructions on the spray bottle for accurate application.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}