{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"66a7d084-5532-5a6a-afce-723cc2529ecc","task_key":"default--validation--18233","task_revision_id":"1","upstream_id":"18233","short_description":"HellaSwag validation 18233","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to darken roots [title] Find a boxed dark hair color that suits you. [step] Look at the side of the box to see what the shade will look like based on your current hair color. Black will almost always turn out black, regardless of your natural hair color, but other shades may not turn out what's on the box.\",\"endings\":\"['[substeps] For example, choose an orange color if you have very fair hair but have naturally black roots. If you have very dark hair but want to lighten up, you can lighten up by getting either orange or blue hair.', 'For example, if you have either red or blue hair, you may want your hair to be darker. You could go purple and purple and red, or black and blue.', '[substeps] This method is also known as \\\" reverse ombre. \\\" instead of bleaching your ends lighter, you are dyeing your roots darker.', \\\"To figure out which shade you want, turn a box upside down. [substeps] This method can create a shade that's too dark if you have naturally light hair.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}