{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6c2ee1e7-73e2-5f90-a821-4efaf96c3ba3","task_key":"default--validation--14457","task_revision_id":"1","upstream_id":"14457","short_description":"HellaSwag validation 14457","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to build leg muscles [title] Train two or three times a week. [step] Many people think that to build muscle you have to train every day, but that's not the case. Muscles get bigger when they get small \\\" breaks \\\" in training, and get stronger when they build up again during rest days.\",\"endings\":\"['[substeps] Try to make sessions slightly shorter each week. This can be anywhere from five to eight sessions.', 'There are several ways to improve leg muscles : [substeps] Use a tape measure or pencil to measure the distance between your lower thighs and upper thighs. Line up the measuring tape and record the distance so you can accurately find the number of steps you need to put on each leg before starting to create a \\\" plan \\\".', \\\"So don't exercise the same muscle groups two consecutive days. Rotate muscle groups so you're training your arms, back, chest, and other areas on the days you aren't working out your legs.\\\", '[substeps] One study found that those who train three times a week increased leg strength and ultimately reduced the cost of physical activity as a result. If you lose a few pounds, you can increase the amount of you workout routine.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}