{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fede3ec4-6bc7-5b3f-b9e8-5becc360ec2d","task_key":"default--validation--14432","task_revision_id":"1","upstream_id":"14432","short_description":"HellaSwag validation 14432","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do eyeliner stacking [title] Use gel or liquid eyeliners. [step] The thing that makes stacked eyeliner so striking is its precision. To achieve these crisp, perfect lines, liquid or gel eyeliners work perfectly.\",\"endings\":\"['Stick to linear eyeliners, though, or use a liquid fighter. If you cannot find stackable gel eyeliners, you can dip the liner liner in a liquid fighter and rub it on your eyelids.', 'You can use them for everything from eyeliner to liner to foundation. [substeps] Gel eyeliners are the most common types of eyeliner you can use in any situation.', 'While pencil eyeliners are great for everyday lining, it is more difficult to achieve that precise line you want. You can find liquid and gel eyeliners at your local pharmacy or beauty supply store.', 'There are a variety of gel liners depending on how your design preferences are. [substeps] Liquid liners form a vertical line downward and leave the bottom lip uncovered.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}