{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"77dfa7f5-28f6-5318-aec7-40a8a6d30035","task_key":"default--validation--28971--variant-8aafb4f5e17d","task_revision_id":"1","upstream_id":"28971--variant-8aafb4f5e17d","short_description":"HellaSwag validation 28971","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use dry shampoo [title] Section out your hair. [step] Separating your hair into sections will help you apply the powder evenly. Make each section about 2 inches (5 cm) apart.\",\"endings\":\"['Secure the sections together with a hair tie. Twist the ends of each section around one other so that they form a double-knot.', 'You want to start with dry hair and gradually work your way down, creating braids. [substeps] Look for braids that are thin and uniform, as they will be easiest to apply.', \\\"Work your way down from your hair's natural part to the nape of your neck. [substeps] If necessary, you can use hair clips to hold the sections.\\\", 'Start at the bottom section and work your way up, then just get to the roots. Repeat until all of your hair is covered.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}