{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a7902ca2-b222-513b-b175-3492c3c43d0c","task_key":"default--validation--40655","task_revision_id":"1","upstream_id":"40655","short_description":"HellaSwag validation 40655","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to use spanking as a last resort [title] Decide ahead of time what behaviors are serious enough to spank for. [step] Think about behaviors that are absolutely unacceptable and serious in your view. Some example ideas are lying, deliberate disobedience/defiance, stealing, or violence.\",\"endings\":\"['One example is abuse, which would be a spanking recipient denying what they are doing. You will need to develop a strong strong relationship with the person in charge, especially if all these behaviors are to be taught.', 'If you\\\\'re prone to these behaviors, think of punishments that may be more serious. [substeps] One example might be refusing to submit to an explicit request for \\\" please \\\" or \\\" apologize.', 'These behaviors cannot be tolerated, nor can receiving spanking punish them. Think carefully about your behaviors, doing a little research and see what comes up with each pattern.', 'You can choose whatever behaviors you consider serious enough to deserve the ultimate punishment (when spanking is used as a last resort, that is how it should be viewed of, as the ultimate sanction). [title] Sit down and talk with your child.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}