{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a62c37d3-21ed-50de-9a6a-6478a71aae27","task_key":"default--validation--13656","task_revision_id":"1","upstream_id":"13656","short_description":"HellaSwag validation 13656","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to protect your kids from online catfishing [title] Use generic photos and images. [step] Kids and teenagers should be careful posting pictures of themselves online, because these images could open them up to predators and catfish. This is particularly important with images that are viewable by the general public.\",\"endings\":\"['Many parents, particularly older ones, may view the pictures online as spam, or simply a spam assignment. [substeps] For example, you may have an annoying post about how your all-star player is a tough worker at work.', '[substeps] For example, your kids may use a picture of a pet or other animal, or a cartoon avatar, as a profile picture. One tactic catfish use to get close to their victims is flattery in the form of compliments about how the person looks.', \\\"Make sure to have your child removed from the images so that the parents don't interact. [substeps] Posting negative pictures or pictures of you online can result in a child knowing that the pictures are not real.\\\", \\\"[substeps] Wait several days after your family member changes their image. Don't post too many photos on a single person's profile, and don't post more than you can put down.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}