{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a5022b14-9004-5ecb-87c2-46d02ee84d4e","task_key":"default--validation--36009","task_revision_id":"1","upstream_id":"36009","short_description":"HellaSwag validation 36009","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use powder facial cleanser [title] Create a paste. [step] The first step in using your powder facial cleanser is creating paste. This is done by mixing your powder cleanser with a bit of water.\",\"endings\":\"['The exact measurements can vary from product to product, so read the instructions. A general rule is to begin with 1 tsp.', 'Add 1 to 2 tablespoons of coconut oil and 3 tablespoons of regular facial cleanser and stir. Gently press your face back into place to finish creating the paste.', 'Add a few drops of your chosen facial cleanser onto a washcloth. Rub the paste on your face in circular motions.', 'This paste is used in the process of softening your hair and removing any unnecessary oils that may cause hair loss or dandruff. This paste can also be applied to your face, as well as underneath your hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}