{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"26ec62c5-aaf1-536d-8534-e9354c42c1eb","task_key":"default--validation--27372--variant-29b889fba80c","task_revision_id":"1","upstream_id":"27372--variant-29b889fba80c","short_description":"HellaSwag validation 27372","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to add volume to hair (for men ) [title] Wash your hair on a daily basis. [step] Your hair will look-and feel-its best, and have the most volume if it's washed every day (or at least every other day). Find a hair-washing regimen that seems to maximize the volume of your hair and stick to it.\",\"endings\":\"['[substeps] Greasy or unwashed hair tends to clump together, making the hair look flat and deflated. [title] Rinse out hair-care products with warm or room-temperature water.', \\\"If you don't work, try a more natural hair washing method (e.g. coconut) rather than a more shampooing kind.\\\", '[title] Apply hairspray or heat-styling spray before washing. [step] To help keep your hair looking smooth and girly even when wet, start applying some hairspray before and after you wash.', '[substeps] Daily washes are full of added salt and sun-protection (additional oil should also be added, with your fingertips, to disguise thickness). For thick hair, washing every day at least removes big chunks of product.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}