{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb546631-27c6-564d-855b-10206207b4fe","task_key":"default--validation--15059--variant-bd77aca75661","task_revision_id":"1","upstream_id":"15059--variant-bd77aca75661","short_description":"HellaSwag validation 15059","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear faux fur [title] Make the coat your statement piece. [step] If you are wearing your faux fur coat to a special event or just want to look nice, remember that simplicity is the key to elegance. Because faux fur is such a lush and eye-catching material, make the your faux fur coat the statement piece of your outfit.\",\"endings\":\"['It can work for most occasions, or it may not. [substeps] Accessories are another consideration you may want to consider when making your faux fur coat your statement piece.', \\\"[substeps] Try not to wear especially bright clothing, or anything that catches the eye too much. Also don't wear any other bold textures like snakeskin or pleather.\\\", '[substeps] Pick a color (or something to make up as you go along) that complements your outfit. For example, if you are wearing black or tan faux fur, wear a bright and bold statement piece that will make you stand out.', 'In particular, look for patterns that can set off the faux fur coat. Choose patterns that coordinate with the color of the fur and you consider the fur coat a statement piece.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}