{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"30830123-8f71-51c0-8db5-2f2c8ed51fcb","task_key":"default--validation--37640","task_revision_id":"1","upstream_id":"37640","short_description":"HellaSwag validation 37640","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to remove armpit hair [title] Wet your armpits with warm water. [step] The process of shaving will go more smoothly if your skin is soft, supple and warm. Either shave in the shower or get your armpits wet with warm water before you begin.\",\"endings\":\"['[substeps] If you tend to get ingrown hairs, exfoliate your skin with a body scrub, too. If you have very sensitive skin, do the process at night to give your skin chance to rest overnight.', 'This will prevent your armpit hair from drying out overnight. [substeps] You can also blow dry your armpit hair, but do not dry it out as this will only dry out the skin.', '[title] Take out a long-handled shaving sponge or a stocking. [step] Using the sponge or stocking will ensure that any excess lather remains to be removed in no time.', 'Soaking in warm water for about 15 minutes will give the shaving gel time to settle in and soak into the follicles. If you need to shave early in the morning, this step is purely optional.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}