{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e85d8b33-b1ff-5d9f-be73-bc54beaec9de","task_key":"default--validation--17185","task_revision_id":"1","upstream_id":"17185","short_description":"HellaSwag validation 17185","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to convince your parents of your intercaste love [title] Find the correct moment to talk to your parents. [step] Avoid situations when they are tense or irritated. [title] Try to explain to your parents why you love your partner.\",\"endings\":\"['[step] List out the reasons why you love them and what made you fall for them in the first place, even though it may sound like a business proposal. [title] Search for marriages in your family which are intercaste or unconventional and were successful.', '[step] ( are you married? ) the more outlandish the scenarios the better. Your parents will probably appreciate this more if they see you really enjoy your partner.', \\\"[step] You'll have a better chance of convincing your parents that they love you if you are present when you first talk to them. The more room you have to describe your love for your partner, the better it will convey to your parents what love looks like.\\\", '[step] They will be more calm and receptive when they know you really love your partner. [title] Ask them why they want to talk.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}