{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"87894d46-ec96-51c9-b165-f90fdf5a9eeb","task_key":"default--validation--25609","task_revision_id":"1","upstream_id":"25609","short_description":"HellaSwag validation 25609","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to mix henna for hair [title] Buy pure, natural henna. [step] You will need about 50-100 g for short hair , 100 g for medium hair, and 200 g for long hair. Don't worry about being precise; it's a pretty forgiving process.\",\"endings\":\"['The kit will not cost you anything, so you can always find a fresher or darker henna recipe at a pharmacy or beauty store. The quick and easy, though, is to simply boil the henna and thoroughly dilute it with 1 teaspoon of dye or 2 tablespoons of dish detergent.', \\\"[title] Use a comb to create your hair's base. [step] You can use straight hair or thin hair, or it can be any way you want it.\\\", '[substeps] If you want a darker shade, plant a few seeds in the bottom of the container so that the seeds will hang as they grow. For a lighter shade, drop 10-12 seeds, or a combination of the two.', 'When buying henna, there are a few things to keep in mind. [substeps] Some henna comes already mixed with additives.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}