{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4b241ddc-0401-5761-a805-10005cc4f149","task_key":"default--validation--46225","task_revision_id":"1","upstream_id":"46225","short_description":"HellaSwag validation 46225","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to increase breast size [title] Do push-ups. [step] You may think of push ups as an arm exercise, but they also home in on your pectorals, the muscles in your chest. Working out the pectoral area strengthens and enlarges the chest and can make breasts appear fuller and larger.\",\"endings\":\"['[substeps] Talk to your doctor before trying push-ups. [title] Limit these exercises if your chest condition is severe.', '[substeps] To get started, do 3-4 sets of 15 high power push-ups every other day. Do a squat or two back-ups.', 'As a bonus, your arms will get trim and muscular, too. Do 3 sets of 15 push ups at least every other day to start.', '[substeps] Stand with your feet shoulder-width apart and your arms straight out in front of you. Lean forward to push your upper torso further forward, to bring your chest towards your hips.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}