{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"925a0a89-2096-503d-b4a5-91bf5e854a92","task_key":"default--validation--50657","task_revision_id":"1","upstream_id":"50657","short_description":"HellaSwag validation 50657","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to tell if your teen is being abused [title] Pay attention to your teen dressing inappropriately. [step] If you suspect that your teen is being beaten by someone in their life, you will want to pay close attention to their dress code. While all teens have different styles and preferences, be on the lookout for any clothing that is out of the norm for your child.\",\"endings\":\"['Try to figure out why they are dressing something that is frowned upon. [title] Understand why your child is acting different.', \\\"Read the following as a rule for determining your teen's behaviour. [substeps] You may notice your teen dressing in odd outfits that could indicate that they are on a date.\\\", '[substeps] For instance, your teen may try to hide the signs of abuse (e.g. scratches, burns, bruises, bite marks, broken bones, etc.', '[substeps] Ask your teen if they have black tights (with stripper straps) or baggy jeans (without strippers straps). The more comfortably you can be around your teenager, the better.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}