{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b2400b9-6714-50b7-bf3b-7c3ada39e2b5","task_key":"default--validation--734","task_revision_id":"1","upstream_id":"734","short_description":"HellaSwag validation 734","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to read a foot reflexology chart [title] Familiarize yourself with the basic foot reflexology chart. [step] Starting out, learn about the basic areas on a foot reflexology chart. This outlines the major organs locations on the foot.\",\"endings\":\"['This will help you to determine the exact direction of movements you should make during another stage of your experimental activities. [substeps] Start with the sole of your foot and work your way up to the pads and toes of your feet.', 'By learning these, you will be able to identify the general areas where you will need to focus. [substeps] You cannot use a chart to accurately analyze the chart.', '[substeps] The right foot is associated with the right part of the body and left foot is associated with the left side of the body. The stomach, for example, is primarily located on the left side of the body so massaging and applying pressure to the left foot can treat stomach ailments.', '[substeps] The first circle of the chart should detail the movement of the heel and sides of the foot during exercise, or the movement of the feet as a whole. The second circle should also describe the movement of the toes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}