{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7bec5feb-1e54-5cab-8e72-f1b59d577092","task_key":"default--validation--4188","task_revision_id":"1","upstream_id":"4188","short_description":"HellaSwag validation 4188","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to cradle hold a baby [title] Bend down to pick up the baby. [step] Rather than lifting the baby all the way up to your level, it is easier and safer to bend towards the baby as you lift her up. This minimizes the distance that the baby needs to be moved while only supported by the hands.\",\"endings\":\"['[substeps] Find an odd angle to get closer to your baby so that they can see you while you lift them. Do this in a quiet, secluded space where no household noises and people can close the door.', '[substeps] Bending towards the baby also maximizes the amount of eye contact you can make with the baby, as babies can only see about a foot in front of their eyes. This eye contact is especially important if the baby is upset, as it will enable you to soothe and comfort them.', '[title] Maintain a firm, forgiving grip on the baby. [step] If you are not able to pick up the baby one-handed, consider having a helper assist you.', '[substeps] This works especially well with younger babies. [title] Place a hand in front of the baby while you lift her.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}