{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c27fec76-5424-5525-8b1d-02f1005845f5","task_key":"default--validation--29477","task_revision_id":"1","upstream_id":"29477","short_description":"HellaSwag validation 29477","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make someone fall in love with you [title] Take good care of yourself. [step] Physical appearance plays a huge role in whether or not someone will be attracted to someone else. How well you care for your physical health and appearance is something that people can see right away, so it is worth putting some extra time and energy into while you are trying to attract someone.\",\"endings\":\"[\\\"People will notice if you don't care for yourself and this may make someone lose interest. [substeps] To ensure that you look your best, exercise, eat right, practice proper hygiene and wear clean, flattering clothing.\\\", \\\"[substeps] Get a good night's sleep. When you wake up in the morning, your body releases hormones that are thought to make up for lack of sleep.\\\", '[substeps] Take care of your skin, your appearance, and maybe even your nails. Keep them looking healthy by taking them out every day.', '[substeps] When you are caring for yourself, you will do extra trying to get into shape or to maintain your image. Taking good care of yourself will also make sure that your skin is glowing and healthy, which in turn enables people to like you more.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}