{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8aa4d9f2-4749-59b5-b537-6cb297b811d1","task_key":"default--validation--26854","task_revision_id":"1","upstream_id":"26854","short_description":"HellaSwag validation 26854","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to adjust your lantus dose [title] Track any weight loss. [step] The amount of insulin you get in each dosage of lantus is based on a lot of factors, including how much you weigh. If you've lost or gained weight, more than 1 lb (0.45 kg) or 1 lb (0.45 kg), it might be time to adjust your dose.\",\"endings\":\"['[title] Keep an eye on changes in your physical activity. [step] The amount of physical activity you participate in can affect how much insulin your body produces on its own.', \\\"Your doctor may indicate the following changes depending on the level of weight you are gaining : [substeps] Your blood sugar. If you're losing weight, you might want to alter how much insulin is in your blood sugar.\\\", \\\"Focus on how much you're eating or sleeping the most. If you don't look to determine whether you're losing weight, you should watch your insulin levels.\\\", '[substeps] If you lose a pound during each dose, you may need to increase your dose or switch sides. Lose 1 to 2 lb (0.45 kg) of insulin each week for continued support.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}