{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e4991b1a-da90-5733-aa0b-1f6d9e0c033e","task_key":"default--validation--5591","task_revision_id":"1","upstream_id":"5591","short_description":"HellaSwag validation 5591","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow longer eyelashes and fuller eyebrow naturally [title] Remove makeup nightly. [step] Mascara and eyebrow gel, left on eyelashes and eyebrows overnight will damage these beauty treasures and will prevent eyelashes and eyebrows from growing. [title] Use oil based or dual action eye makeup remover.\",\"endings\":\"['[step] This is a very effective and effective makeup remover that will make your eyelashes grow longer and straighter. Based on results, be sure to use less and use it when you sleep.', '[step] Good eye makeup remover should wipe off makeup and even waterproof mascara without rubbing and ripping off eyelashes and eyebrows. Soak cotton pad in eye makeup remover and apply to eyelashes and eyebrows for counts of ten, then wipe off without pressure.', '[step] Your eyelashes and brows will retain their shape if you remove and re-exert your necessary oils. An automatic eye makeup remover will keep lashes from growing dramatically.', '[step] These products require you to remove petroleum-based makeup and put oils on top. These products are typically applied over lip makeup and togues, which is similar to mascara.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}