{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9caeeb5d-122b-5af8-904f-7fe299c5dc17","task_key":"default--validation--30979","task_revision_id":"1","upstream_id":"30979","short_description":"HellaSwag validation 30979","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make hands look younger [title] Treat age spots. [step] These spots, which are also called liver spots, are caused by neither age nor your liver. In fact, they are areas of hyperpigmentation caused by increased melanin production that occurs because of uv exposure.\",\"endings\":\"['Grow specimens with developed liver spots in the months following your previous start of weight loss. Unfortunately, there is no scientific proof that these spots can be used for any reason but simply to help your skin age faster.', '[substeps] Check your local yam gravity map for the most visible signs of age spots: inversions (temperature-0 celsius), hyperpigmentation, enlarged skin, chapped lips, bruising, and more. Look out for itchiness at night, which is caused by increased inflammation in your eyes.', 'Both melanin production and photosynthesis produce darker spots in the hands. [substeps] For these spots, a combination of sun exposure and arthritis can cause hyperpigmentation.', 'The appearance of sun spots can be reduced with : [substeps] Skin bleaching agents that contain hydroquinone. Fading or lightening creams that contain glycolic or kojic acid, vitamin c, licorice, and mushroom extract.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}