{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"904ae2b0-b271-5742-b0c3-c88797d13e5b","task_key":"default--validation--36658","task_revision_id":"1","upstream_id":"36658","short_description":"HellaSwag validation 36658","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to avoid drawing anime style [title] Realize that it might simply be that the person judging your work thinks everything is anime. [step] If so, try telling the person that what you draw isn't always anime, then show them an anime drawing and a non-anime drawing and point out the differences. [title] Look for the tell-tale signs that your work is anime : [step] Big eyes, small nose, shiny or large hair.\",\"endings\":\"['Any of these may be a sign that you are having a hard time drawing anime clothes. If this is the case, look up pictures of anime outfits online.', \\\"Is your work any of these things? [title] If your characters have large eyes, keep them. [step] They're expressive, which is useful in all cartoons.\\\", 'Watch out for the errors people make when they are critiquing that style. [title] Look for errors and ask the person to proofread their work.', 'Big eyes are often left unaccepted, they are often your only feature. Do your research and do not identify with the anime that you have drawn.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}