{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3c2b5b06-d277-582b-a5f0-e358a35f2ea1","task_key":"default--validation--49042","task_revision_id":"1","upstream_id":"49042","short_description":"HellaSwag validation 49042","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to do back exercises in yoga [title] Do the mountain pose or perfect pose as your initial pose. [step] Both of these are relatively easy, especially if you do them often, and either will serve as an effective beginning stretch. These exercises are the perfect context in which you can find a breathing pattern for the rest of your workout.\",\"endings\":\"[\\\"[substeps] You'll remember to breathe deeply and steadily through this position, in order to begin this stretch. [title] Sit on the floor or on your mat.\\\", '[substeps] To begin, stand with your feet shoulder-width apart. Push off the floor with your toes and pull your stomach in towards your spine while keeping your palms firmly planted on the floor.', 'Focus on inhaling deeply from your nose and releasing your breath through your mouth. Count to six as you inhale, and then count to six once more as you exhale.', '[substeps] Find a comfortable seated position by sitting straight in a chair, and keeping your feet hip width apart with your heels slightly locked. You can do this position anywhere between 20 and 30 times per week.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}