{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2eb94416-b22e-5cac-b00e-2f08b5e2bc49","task_key":"default--validation--31297","task_revision_id":"1","upstream_id":"31297","short_description":"HellaSwag validation 31297","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use dry conditioner [title] Use dry conditioner if you have fine to medium fine hair. [step] Dry conditioner is a great way to add volume for fine to medium fine hair types. If you thick, fine hair, dry conditioner will also work well for you.\",\"endings\":\"['[substeps] If you have coarse hair, dry conditioner will probably not be a good choice for fine hair types. You should try adding a small amount of dry conditioner and letting it sit for 15 to 30 minutes, and then rinse.', '[substeps] If your hair is very thick, use a little sulfate. Dry conditioner may be too thick, but if your hair is very fine, dry conditioner may be more effective.', 'You can apply dry conditioner just under your hair, at 1/2 inch (1.3 cm) intervals, and let it sit for five minutes. Then, wash your hair with hot water and shampoo your hair very well.', '[substeps] If your hair is very fine, dry conditioner can end up weighing it down. Use a very small amount of dry conditioner with natural oils in it (most have them), or go for a hair oil instead.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}