{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fe27995f-14f1-5346-842b-e968348243b1","task_key":"default--validation--12785","task_revision_id":"1","upstream_id":"12785","short_description":"HellaSwag validation 12785","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to display photos at your wedding [title] Mix in baby pictures. [step] Instead of showing only photos from your relationship, display photos of you and your partner from your whole lives. Include baby pictures, and pictures from elementary school, high school, and college.\",\"endings\":\"['You may choose to put up embarrassing and funny photos of each other. [substeps] These photos can chronicle both of your lives up until you met, and then you can have a separate space where you showcase photos from the time you met until now.', \\\"This adds individuality to pictures and makes them easier to print on the lens. [title] Incorporate solid colors if you're giving photos to people you care about.\\\", \\\"[substeps] Using a camera roll to display photos can also help that more people remember your relationship. Go with a roll that shows several different parts of your partner's life.\\\", '[substeps] You could include pictures of your kids, old friends, acquaintances, and so on in these photos. Try to take your people and events into detail.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}