{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"47232ce3-3822-5509-9469-e2a8bb43b50c","task_key":"default--validation--39176","task_revision_id":"1","upstream_id":"39176","short_description":"HellaSwag validation 39176","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dress oneself and look good [title] Colours. [step] The colours you wear should compliment your skin tone, hair colour and eye colour. Don't be afraid to break out of the black and go for something colourful.\",\"endings\":\"['Bright colors like blues and greens add a youthful first glow. Also try wearing subdued shades of the country colours like blues, greens, yellows, and purples.', \\\"[title] Don't bring too many things. [step] Take all of your clothes and accessories and stick with something simpler.\\\", 'Just make sure the colours are flattering. There are lots of books and web sites that will help you choose the right colours for example darker people can wear louder colours whereas paler skins often look better with more subtle colours.', \\\"[substeps] Wear ballet flats for ballet or ballet shoes for dance if you can't wear black tights. If you don't like to wear tight jeans wear shorts or leggings instead.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}