{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e4f84ea5-9645-5470-98b7-51892d16b88f","task_key":"default--validation--35212","task_revision_id":"1","upstream_id":"35212","short_description":"HellaSwag validation 35212","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to control sexual urges [title] Get out of your current environment. [step] Try to step away from any environment where you feel it's difficult to control your urges. If you are at home and feeling a compulsion to masturbate, for example, try taking a quick walk to the store.\",\"endings\":\"[\\\"If you can't leave your current environment (if you're at work, for example), try talking to another coworker or taking a break. [substeps] It might also be helpful to have someone to help keep you accountable, such as a trusted friend or even a therapist.\\\", 'This will work especially well if you have some secluded space in which to have control. You may walk into the bathroom at home, but avoiding that means that you will have to be very vigilant.', \\\"If you feel around other people using the bathroom, for example, see a mental health professional so they can diagnose your sexual urges and work on handling them more effectively. [substeps] If you don't want to deal with your unwanted urges by yourself, there are many ways to keep these urges under control.\\\", \\\"Or if you're feeling down in the dumps, try a walk in the drive-thru. This will help you relieve the urge to masturbate in public.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}