{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"598dd42f-680c-5ee7-8bb8-a3f2aa44da17","task_key":"default--validation--41601","task_revision_id":"1","upstream_id":"41601","short_description":"HellaSwag validation 41601","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to plan a memorable marriage proposal [title] Ask their friends and family. [step] Friends and family who have known your partner for a long time will likely have an idea if they have a dream proposal, and what it might include. For instance, your partner's siblings may recall your partner talking about how wonderful it would be to receive a marriage proposal on a beach, at sunset.\",\"endings\":\"['[substeps] See how the client manages their schedule. On an anniversary of their wedding, they will be better able to budget their expenses.', '[substeps] Search online for lists of a lot of upcoming wedding approaches or explore the website of a local nature center before booking. [title] Dive in and take it one step further.', \\\"Remember that they might be somewhere in their own world, and there isn't much pressure to broach the subject yet. [substeps] Couples sitting down together and asking for marriage proposal proposal can often sway their mind.\\\", 'As an added bonus, informing other people about your intention to propose means that you can enlist their help with planning the occasion. [substeps] Friends and family can also inform you if your partner has expressed dislike of certain traditional proposals (e.g.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}