{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b74ee064-2083-5554-99a2-8ba495ba0d5d","task_key":"default--validation--39493","task_revision_id":"1","upstream_id":"39493","short_description":"HellaSwag validation 39493","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to detangle african hair [title] Section your hair. [step] Using your fingers, divide your hair into convenient sections. If you have long hair, twist it into four or more sections.\",\"endings\":\"['If you have short or tangled hair, use whichever style you prefer. [substeps] This method allows you to get as much growth as possible.', 'A top part that sticks out of the top works best, but if you have thick hair, just cross your hair over the top part. [title] Brush your hair with a rat tail comb.', 'If you have shorter hair, twist and secure each section with a hairclip, then continue to work your way through your hair. [title] Place each section in a clean basin with warm water.', 'If you have shorter hair, use hair clips instead. Either way, treat your hair as gently as possible.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}