{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ba4a941c-767a-55de-a409-4832e7c91334","task_key":"default--validation--32893","task_revision_id":"1","upstream_id":"32893","short_description":"HellaSwag validation 32893","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear a midi skirt [title] Select a skirt that falls at mid-calf. [step] A midi skirt is typically supposed to be worn at mid-calf-length. That is where the name \\\" midi skirt \\\" originates from.\",\"endings\":\"['[title] Dress your bottom in a mid-calf skirt to elongate your legs. [step] If you are not blessed with very defined legs, hemlines are generally subtle and worn low at your legs.', 'This skirt has a small, bell-shaped bottom. While midi bottoms tend to rise below the knee, they have been shown to look better on the hips.', \\\"Depending on your height, it can be difficult to find a skirt that comes down to that length. If that's the case, you can choose to wear it shorter or get it altered.\\\", \\\"Regular midi skirts are best for this as they are pretty informal and casual while still being sturdy and practical. Midi skirts usually go to mid-calf-level unless you are looking to move around a lot and don't usually have to worry about it being too short.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}