{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0e0681c1-19dd-5d17-9fc4-cc4035f96cd7","task_key":"default--validation--6233--variant-4a018f2b0c18","task_revision_id":"1","upstream_id":"6233--variant-4a018f2b0c18","short_description":"HellaSwag validation 6233","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with a nagging wife [title] Try to calm down. [step] In the heat of the moment, you might feel like the nagging is impossible to deal with. And it certainly can be frustrating and hurtful.\",\"endings\":\"[\\\"You might feel like whining or other similar tactics are ineffective, but they're not! Consider whether you're angry because your wife is questioning your motives. Maybe the nagging wasn't because she feels like she has no control over your life.\\\", 'However, try not to let it upset you too much. Anger and hurt can have negative effects on your mental and physical health.', \\\"However, don't get easily flustered, thinking, or feeling trapped while you're trying to deal with the nagging. Consider doing some yoga poses or taking a walk around the block.\\\", 'Fighting the urge to nag your wife will only create further dissatisfaction. [substeps] If you find yourself frustrated or agitated, take a couple minutes to relax and gather your thoughts.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}