{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2acbdb2c-f7a1-5fae-9aae-ae03c43d2311","task_key":"default--validation--18405","task_revision_id":"1","upstream_id":"18405","short_description":"HellaSwag validation 18405","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with favoritism in your family [title] Don't take it personally. [step] You are special with your own quirks and traits. Don't allow your parents' favoritism to get to your self-esteem.\",\"endings\":\"[\\\"You don't have to be like the picture john lennon is portraying in your head. [substeps] Never blame yourself for your parents' favoritism, or it will only drag you down and make you more afraid.\\\", 'Think of it as a result of your upbringing. [substeps] If you have had a poor childhood, think of yourself as special because of it.', \\\"It's just that the favored sibling's abilities are noticed more than yours. It doesn't mean you don't have any good qualities.\\\", \\\"[substeps] Over time, you might feel better and enjoy doing things you enjoy. Therefore, do not resent your parents when you do something which you don't enjoy.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}