{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d0198933-da67-5148-97b2-6d7e5a93f839","task_key":"default--validation--25130","task_revision_id":"1","upstream_id":"25130","short_description":"HellaSwag validation 25130","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to deal with makeup shaming [title] Ignore comments. [step] Sometimes, the best way to deal with negative comments is to ignore them. If you get comments on your makeup, simply do not respond.\",\"endings\":\"[\\\"If someone makes a disparaging comment on your appearance, pretend you did not hear it and walk away. [substeps] Sometimes, people may think they're being helpful with their comments.\\\", 'If the comment was mean, try not to react. Trying to retaliate will only detract your chances of becoming a victim of the comments.', 'By ignoring the comments, you will be less likely to be hurt or treated with the kindness and respect that makeup shaming implies. [substeps] If you go out in public, people can comment without you even realizing it.', 'When you respond to negative comments from others try not to become involved in them. Simply not responding will get the conversation off on the wrong foot.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}