{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"19c3b4b6-626f-5f3a-bd5e-f529b68fbce2","task_key":"default--validation--13602","task_revision_id":"1","upstream_id":"13602","short_description":"HellaSwag validation 13602","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to combat cellulite [title] Apply retinol to your skin. [step] Retinol is a vitamin a compound proven to help improve a number of skin-related conditions like acne and wrinkles. Studies have shown that regular retinol use can also improve the appearance of cellulite.\",\"endings\":\"[\\\"[substeps] Use mineral oil, castor oil, or body oil if you have areas where you'd like to reduce your cellulite. The recommended daily amount of retinol for individuals 12 or older is 25 to 59 mg.\\\", '[substeps] Retinol is found in alcoholic beverages including wine and liquor. Consult your doctor for an approved retinol-based cream for treating cellulite.', '[substeps] Retinol products are available over-the-counter and by prescription. Use a 0.3 percent strength retinol cream.', '[substeps] Talk to your doctor or skincare professional about using a retinol product. Depending on your particular skin type, retinol can lighten up or eliminate circles under your eyes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}