{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bde0c551-b79f-553a-aa02-b525962040ad","task_key":"default--validation--44500","task_revision_id":"1","upstream_id":"44500","short_description":"HellaSwag validation 44500","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to find massage therapy classes [title] Research some of the more common types of massage. [step] These include, but are not limited to sports massage and deep-tissue massage for athletes or swedish massage and reflexology for relaxation. [title] Understand that certain types and techniques of massage are only appropriate for certain people.\",\"endings\":\"['[title] Ask for someone to sit behind you and try one of many techniques. [title] Choose a small hand of a comfortable size.', '[step] Professional massage therapists must be artistically adept and cannot do or alter anything, certain combinations of techniques cannot be performed without an experienced massage therapist, and they may not be too focused on style or appearance. It is important that you know yourself before you begin applying the special conditioning for your massage.', '[step] For example, pregnant women would not receive the same type of massage as an athlete with a sports injury. [title] Understand that certain types and techniques of massage are only appropriate for certain people, for example pregnant women would not receive the same type of massage as an athlete with a sports injury.', \\\"[step] If you're struggling with meditation practice, you should instead try learning more advanced techniques such as the kettle press. Although it is not advisable to start off with a single technique, it can aid in constipation to ease symptoms of morning cramp in athletes and practitioners alike.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}