{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c70cc310-cb3c-5934-a7d8-f34bbf18afdf","task_key":"default--validation--29609","task_revision_id":"1","upstream_id":"29609","short_description":"HellaSwag validation 29609","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to draw fashion sketches [title] Gather materials. [step] Choose a hard lead pencil (h pencils are best) that makes light, sketchy marks that are easy to erase. Marks made with these pencils also don't indent the paper, which is helpful when you want to add color to the image.\",\"endings\":\"['There are many different types of pencils-all good for page sketching. [substeps] Pencils work best in glossy and flat drawing.', '[title] Sketch the body outline which is often the trickiest part of drawing a fashion sketch. [title] Draw the figure outline by drawing lines.', '[title] Trace on your drawing with an eraser if needed. [step] Even a little smudge is needed.', \\\"A good quality eraser and thick paper are also important materials to have if you want your sketch to look professional. [substeps] If you don't have the right type of pencil, you can do a sketch with a number 2.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}