{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4c1911fb-75de-5c1a-a43f-266f4ffe5fdd","task_key":"default--validation--27909","task_revision_id":"1","upstream_id":"27909","short_description":"HellaSwag validation 27909","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to calculate fluid pressure [title] Set up the equation. [step] The equation for fluid pressure is independent of the mass or volume of the liquid. Instead, fluid pressure is the product of the density of the liquid, the height of the liquid above the object, and gravity.\",\"endings\":\"['Since gravity and liquid densities are fixed (for the most part), the height of the liquid is the largest variable in the equation. [substeps] The equation reads as p fluid = ρgh, where ρ is the density of the liquid, g is the force of gravity, and h is the height of the liquid.', \\\"If the solution offers no useful information, then it is likely to be simply an aeration effect of the gases in your prop prop. Calculate the volume of the liquid by assuming the formula needed to determine how many aspirin ounces you'll need for a prop.\\\", '[substeps] A problem for fluid pressure is that a part of the body that is logically the size of the objects object. This is because liquid pressure is the constant object low to the water.', '[substeps] Separate objects by the force of gravity. Start by dividing the weight of the liquid by its volume.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}