{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"874d1772-12c3-536f-af29-82a6b227a2c4","task_key":"default--validation--37823","task_revision_id":"1","upstream_id":"37823","short_description":"HellaSwag validation 37823","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow out an inverted bob [title] Have a goal in mind. [step] As you grow out your hair, have an end look or goal in mind. Let your stylist know what kind of look or style you want to transition into.\",\"endings\":\"['Most stylists like to have different cuts, styles, colours and other items to choose from. [substeps] Mature hair is much more rigid and hard to grow.', \\\"If you're unsure, politely ask your stylist what your goal is. [substeps] You might decide to cut your hair to a similar length as yours.\\\", \\\"If you don't already have a goal, approach your stylist and ask them where you can find one. They may recommend something specific or suggest something more subtle.\\\", 'That way, they can slowly reshape your hair into your next style, giving you something to look forward to. [title] Ask your stylist to thin the ends.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}