{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d42e77c6-4a51-52fd-b2a2-ec62fcadab5d","task_key":"default--validation--124","task_revision_id":"1","upstream_id":"124","short_description":"HellaSwag validation 124","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to bond with your teen [title] Try to take interest in what your teen is interested in. [step] For instance, if your teen enjoys a specific sport, or listens to a certain band, ask him or her to show you how the sport goes or how the band works. If you talk to your teen about what he or she likes, they will be more likely to want to talk to you.\",\"endings\":\"['This also shows that you care about your teen and his or her identity. [substeps] You should also do activities with your teen that is enjoyable to him or her.', \\\"[substeps] Ask questions and relate things you know about your teen to the conversation. For instance, don't speak about really offensive stuff or bizarre rumors: try to stick to small talk without offending the teen.\\\", '[title] Make sure your teen uses your social media. [step] Unless your teen seems comfortable sharing his or her information with you over text, try to work with what she posts on her social media accounts.', '[substeps] Don\\\\'t talk as if you want to know what they like, but use sarcasm. Say things like, \\\" i know \\\" and \\\" yeah, that\\\\'s awesome \\\" when bored.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}