{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3a322760-a605-5d92-a50c-9135472fd280","task_key":"default--validation--30657","task_revision_id":"1","upstream_id":"30657","short_description":"HellaSwag validation 30657","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to act when you discover your spouse has a drinking problem [title] Learn about the reasons people abuse alcohol. [step] Some people start drinking to get away from their problems, some drink because they have poor impulse control, and others get hooked simply because they never learned healthy ways to relax. Identifying the reason your spouse drinks will help you know how to support them in their recovery.\",\"endings\":\"['[title] Understand that alcoholics do not think rationally. [step] You might feel confused or angry that your spouse would try to solve their problems by doing something as destructive and illogical as drinking excessively.', \\\"[title] Do something different and make your spouse feel good about themselves instead of acting as a crutch. [step] Consult with your spouse on how to behave when they're recovering from their alcohol problems.\\\", \\\"[substeps] Think about why your spouse doesn't drink. For example, if your spouse tends to drink because she recently got sick from childbirth, the cause may change as they find treatment but you still want to support them.\\\", '[substeps] Studies have shown that excessive alcohol or energy consumption impairs mental and emotional functioning. Stop drinking by taking specific steps to replenish your energy levels.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}