{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"023583ee-1373-5181-941a-7207afa52b44","task_key":"default--validation--19519","task_revision_id":"1","upstream_id":"19519","short_description":"HellaSwag validation 19519","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear minimalist jewelry [title] Pick simple, clean pieces. [step] When it comes to minimalist jewelry, you don't want to get too fussy. However, you don't want to make it so simple that it's boring.\",\"endings\":\"['The key is picking pieces that make a statement while still being minimal, such as single stone in a clean setting dangling off a necklace or set in a ring. A single pearl on slim silver band can be this type of statement piece.', \\\"Base items on what sort of jewelry to choose for your jewelry. [substeps] Jewelry already looks minimalist may be something simple like a necklace or bracelet, but it could feel bohemian and impractical if you don't remember what it says.\\\", 'Bring more simple pieces and ask yourself what styles and pastels would be the most ideal. Instead of refined jewelry, opt for timeless pieces instead.', 'The key to minimalist jewelry is wearing pieces that are easy to master. This will make jewelry look more sophisticated and sleek.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}