{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c5f7f42b-e742-5ec3-b25d-b2e8e134a552","task_key":"default--validation--16854","task_revision_id":"1","upstream_id":"16854","short_description":"HellaSwag validation 16854","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to spend time with difficult parents as an adult [title] Set up emotional boundaries. [step] Difficult parents often tend to criticize and nit-pick. Tell them certain subjects are off limits and stick with your rules.\",\"endings\":\"['Bending even once shows them that you are not strong in your convictions and will allow your parents to walk all over you. [substeps] For example, you could say to your parents, \\\" i am raising my children the best way i know how.', \\\"If you're going to have conversations about difficult things, it helps to have clear ground rules so that your parents know they're being heard and enjoy listening to you. [substeps] Limit talking about tough topics like religion and race.\\\", '[substeps] If the parent tells you to keep your toys out of reach, provide them with the opportunity to explain reasons why these items are restricted and unwanted. Say things like, \\\" no one likes there i\\\\'m social all the time.', \\\"Working from your parents' point of view shows that they need to respect these limits. They may even point out problems you or your friend are having, which can make a dynamic between you and your significant other emotionally important.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}