{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"32894d43-f93b-5619-89fb-2aef2400ee50","task_key":"default--validation--41003","task_revision_id":"1","upstream_id":"41003","short_description":"HellaSwag validation 41003","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to determine if a child is transgender [title] Notice if your child has gender non-conforming tendencies. [step] Maybe you have seen that your female child likes to play with toys that are generally considered \\\" male. \\\" keep in mind that just because your daughter likes to play with trucks does not mean that she is transgender.\",\"endings\":\"['[title] Assess if your daughter has just undergone puberty. [step] Some transsexuals like to have a baby.', \\\"However, if your child consistently displays a strong preference for things that don't conform to gender expectations, it could be something to keep an eye on. [substeps] A child that is different in a few ways might just be gender non-conforming.\\\", 'It does not necessarily mean that she has nonconforming tendencies. [substeps] Some talk that transgender bisexuals are socially intolerant, perhaps to the point where they refuse to have sex.', 'Unfortunately, some words like \\\" pimple \\\" and \\\" bum \\\" are an example of gendered expressions and attitudes that can lead to contextual attraction. [substeps] For example, you might assume that your child has a special fondness for playing with plastic dice.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}