{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"99bfc021-2efb-5eb6-b8d9-99ebdf72c400","task_key":"default--validation--24353--variant-a2b167819431","task_revision_id":"1","upstream_id":"24353--variant-a2b167819431","short_description":"HellaSwag validation 24353","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to create fuller lips with makeup [title] Exfoliate your lips. [step] Dry lights reflect less light than smooth, hydrated lips, which can make them look smaller. Before putting on any lip products, exfoliate your lips to remove any dry, flaky skin.\",\"endings\":\"['For plumped lips, take one or both hands and rub over the lips with your fingers to lightly scrub away dead skin cells. If your lips are very dry, you may need to use a very fine, scented lip scrub.', '[substeps] Your lips should be soft and plump for the day and fully hydrated in the afternoon. If your lips seem to dry out, you may need to add more moisturizer and some lip scrubs.', '[substeps] Start the process by using your finger to thoroughly exfoliate your lips. This can be a gentle exfoliant for lips, a rough exfoliant for lips made mostly with dry or flaky lip product, or both! [title] Get lips lined.', 'Use a scrub designed specifically for the lips or brush them lightly with a clean, sanitized toothbrush to remove dead skin. [substeps] You can make your own lip scrub by combining 2 teaspoons (10 g) of brown or white sugar with 1 teaspoon (15 ml) of an oil, such as coconut or olive.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}