{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"da507bf7-efc5-55cd-afb7-ac171198cc3e","task_key":"default--validation--23136","task_revision_id":"1","upstream_id":"23136","short_description":"HellaSwag validation 23136","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your appearance reflect on who you are [title] Take some time to think about who you are. [step] Consider what colors interest you, what kind of style you like and what simply makes you feel good about yourself. [title] Consider dyeing your hair.\",\"endings\":\"[\\\"[step] Most people's natural hair color matches their skin tone anyway, but if it doesn't you should think about dyeing it a color slightly darker than your skin tone. You should also take good care of your hair by bathing every day, grooming hair and using a good shampoo and conditioner.\\\", '[step] There is a wide variety of ways to do this, from coloring your hair purple to dyeing it white. Make sure you are not copying the hues of your former hair and that the shade matches perfectly.', \\\"[step] Although color can be important in creating visual interest, it can also help you understand your upkeep and make your look more personable. [title] If you have acne you're more likely to have it.\\\", '[step] Going for a sleek and sophisticated look can be a fun way to get some gear to you but it is the other little things that stop a major trend from coming. [substeps] Dyed hair can make you as kissable as bleached hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}