{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4e9712e5-cf01-5a8a-ba21-5f8cb84e9520","task_key":"default--validation--45535","task_revision_id":"1","upstream_id":"45535","short_description":"HellaSwag validation 45535","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to act and dress like emma ross [title] Hair. [step] Emma has gorgeous, shiny blonde hair which she brushes and styles well every day. This means to take very good care of your hair.\",\"endings\":\"['Clean your hair at least once a week. Keep it straight and smooth with some left over hairspray everyday.', 'Emma enjoys keeping her hair in mostly ponytails. Sometimes, she has hair-grips or bobby pins to keep her side bangs back.', \\\"Start by using hair products everyday to ensure your hair doesn't look greasy. Then, if you have long hair (short, curly, tousled or wavy! ), use conditioner with hydrating ingredients.\\\", 'Try running a comb through your hair every day to detangle it just how she likes. This will help your curls look soft and healthy rather than bouncy and uncontrolled.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}