{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"85ea6844-1a0c-58f9-8dba-0c3f9ed312ee","task_key":"default--validation--9682","task_revision_id":"1","upstream_id":"9682","short_description":"HellaSwag validation 9682","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to remove hair using organic ganda beroza [title] Exfoliate your skin before removing hair. [step] Exfoliate your skin properly before removing the hair. Application of ganda beroza may cause skin irritation if you do not properly clean and remove dead surface skin beforehand.\",\"endings\":\"['[title] Add cuticle oil to your skin before you get started on waxing. [step] Ganda beroza recommends that you apply cuticle oil after waxing.', 'When performed correctly, ganda beroza can be effective in removing dead skin. Clean your skin thoroughly before using ganda beroza to remove dead skin and remove dead skin cells.', '[title] Consider using a lustrec proactive. [step] Five days before your scalp preparation date, drink a certain amount of the product known for its excellent effectiveness in treating left over hairs on the scalp.', '[title] Wash your hands with soap and water. [step] Only apply ganda beroza with clean hands.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}