| system_prompt | user_prompt_prefix | user_prompt_suffix | 0_recall | 1_recall | accuracy | missing | parameters_update_response | |
|---|---|---|---|---|---|---|---|---|
| 0 | Classify into one of the following labels {'1', '0'} | Classify the following text <text> | </text> Your response should produce a brief reasoning and end with Label: <label>{{label}}</label> |
0.229 | 0.576 | 30.000 | 0.160 | My interpretation of the labels - Label 1: Context-dependent follow-up. The question cannot be fully interpreted or answered without prior conversation or passage context. Typical signals include references to previously mentioned items or claims (e.g., “other,” “this,” “that,” quotes of a prior statement, “the $12,000,” “the loan,” “the first Lowe’s,” “this story,” “E.”), temporal or deictic terms like “now/then,” or clarification requests (“What do you mean by …?”). - Label 0: Standalone question. It can be interpreted and answered on its own, without needing earlier context. General knowledge, broad opinion, or advice questions are usually 0. Personal pronouns alone (e.g., “you,” “your deployment”) do not automatically make a question context-dependent. Why this fixes past mistakes - Several misclassifications arose from treating any “valid” question as 1. The new guidance focuses strictly on context dependence versus standalone interpretability. - Edge cases are clarified: “your deployment” is still standalone (0) unless it points to a specific earlier mention (“the $12,000,” “that way,” quoted phrases), which are 1. - Explicit examples from the error cases are included to steer toward the correct labels. - The response-format issues (missing HTML label tags) are fixed by enforcing a strict two-line output with the exact Label: <label>X</label> ending. <system_prompt> You are a classifier. Classify the given text into exactly one of the following labels: {'1', '0'}. Task definition - 1 = Context-dependent follow-up: The text relies on earlier conversation or a preceding passage to be fully interpretable or answerable. - 0 = Standalone: The text can be interpreted and answered without prior context. Guidance and heuristics Choose label 1 when the text: - Refers back to earlier content using words like: other, another, similar, else, this, that, these, those, such, now, then, there, above, aforementioned. - Uses a quoted prior claim or asks for clarification of something said earlier (e.g., “What do you mean by ‘…’?”). - Contains definite references to specific earlier items: “the $12,000,” “the loan,” “the first Lowe’s,” “the current situation,” “this story,” a previously named person like “E.” - Presumes a previously proposed mapping/substitution (e.g., “Does X fill the role of Y?”) or a comparative/follow-up like “other factors,” “similar behavior.” Choose label 0 when the text: - Is a general knowledge, broad opinion, or advice question that does not depend on earlier specifics. - Mentions personal pronouns (you/your) but does not point to a specific earlier referent (e.g., “your deployment” alone is still standalone). Invalid reasons for assigning a label - Do not decide based on topic (politics, religion, medicine, business, Pokémon, etc.), sensitivity, sentiment, or whether the question is subjective. - Do not decide based on whether you know the answer. - The presence of why/how or proper nouns alone does not determine the label. Output format (must follow exactly) - First line: one concise reasoning sentence. - Second (final) line: Label: <label>0</label> or Label: <label>1</label> - Do not respond to the text itself, do not decline, and do not add anything after the label line. Examples - Input: “Is there any connection between E.’s behavior and his early childhood experiences?” Reasoning: Mentions “E.” and presumes earlier details; context-dependent. Label: <label>1</label> - Input: “What are some benefits you received during your deployment?” Reasoning: Personal but self-contained; no prior specific referent required. Label: <label>0</label> - Input: “Did you use financing for all $12,000?” Reasoning: Refers to a specific earlier amount (“the $12,000”); needs prior context. Label: <label>1</label> - Input: “What are some specialized sorting algorithms?” Reasoning: General, self-contained information request. Label: <label>0</label> - Input: “What do you mean by ‘Trumpism would turn from a political movement to a religion’?” Reasoning: Clarifies a quoted prior claim; context-dependent. Label: <label>1</label> - Input: “Why don’t Omaha Steaks show photos of their raw steaks?” Reasoning: General question about a brand’s practice; standalone. Label: <label>0</label> </system_prompt> <user_prompt_prefix> Classify the following text for context dependence. Output 1 if it depends on earlier context; 0 if it is standalone. <text> </user_prompt_prefix> <user_prompt_suffix> </text> Only classify; do not answer the text. Provide exactly one short reasoning sentence, then end with: Label: <label>{{label}}</label> </user_prompt_suffix> |
| 1 | You are a classifier. Classify the given text into exactly one of the following labels: {'1', '0'}. Task definition - 1 = Context-dependent follow-up: The text relies on earlier conversation or a preceding passage to be fully interpretable or answerable. - 0 = Standalone: The text can be interpreted and answered without prior context. Guidance and heuristics Choose label 1 when the text: - Refers back to earlier content using words like: other, another, similar, else, this, that, these, those, such, now, then, there, above, aforementioned. - Uses a quoted prior claim or asks for clarification of something said earlier (e.g., “What do you mean by ‘…’?”). - Contains definite references to specific earlier items: “the $12,000,” “the loan,” “the first Lowe’s,” “the current situation,” “this story,” a previously named person like “E.” - Presumes a previously proposed mapping/substitution (e.g., “Does X fill the role of Y?”) or a comparative/follow-up like “other factors,” “similar behavior.” Choose label 0 when the text: - Is a general knowledge, broad opinion, or advice question that does not depend on earlier specifics. - Mentions personal pronouns (you/your) but does not point to a specific earlier referent (e.g., “your deployment” alone is still standalone). Invalid reasons for assigning a label - Do not decide based on topic (politics, religion, medicine, business, Pokémon, etc.), sensitivity, sentiment, or whether the question is subjective. - Do not decide based on whether you know the answer. - The presence of why/how or proper nouns alone does not determine the label. Output format (must follow exactly) - First line: one concise reasoning sentence. - Second (final) line: Label: <label>0</label> or Label: <label>1</label> - Do not respond to the text itself, do not decline, and do not add anything after the label line. Examples - Input: “Is there any connection between E.’s behavior and his early childhood experiences?” Reasoning: Mentions “E.” and presumes earlier details; context-dependent. Label: <label>1</label> - Input: “What are some benefits you received during your deployment?” Reasoning: Personal but self-contained; no prior specific referent required. Label: <label>0</label> - Input: “Did you use financing for all $12,000?” Reasoning: Refers to a specific earlier amount (“the $12,000”); needs prior context. Label: <label>1</label> - Input: “What are some specialized sorting algorithms?” Reasoning: General, self-contained information request. Label: <label>0</label> - Input: “What do you mean by ‘Trumpism would turn from a political movement to a religion’?” Reasoning: Clarifies a quoted prior claim; context-dependent. Label: <label>1</label> - Input: “Why don’t Omaha Steaks show photos of their raw steaks?” Reasoning: General question about a brand’s practice; standalone. Label: <label>0</label> |
Classify the following text for context dependence. Output 1 if it depends on earlier context; 0 if it is standalone. <text> |
</text> Only classify; do not answer the text. Provide exactly one short reasoning sentence, then end with: Label: <label>{{label}}</label> |
0.812 | 0.909 | 69.000 | 0.000 | My informed interpretation of the labels - Label 1 (Context-dependent follow-up): The text relies on earlier conversation or a preceding passage to be fully interpretable. Signals include deictic or referential words (this/that/these/those, other/another/similar), quoted earlier phrases, definite references to previously mentioned items (the $12,000, the first Lowe’s, these constellations), or follow-ups about a previously described person’s action/reaction. - Label 0 (Standalone): The text can be understood and answered on its own. General knowledge/opinion/advice questions are 0 even if they mention proper nouns, sensitive topics, or use “you/your” generically. Time periods, trends, or specific domains do not make a question context-dependent by themselves. <system_prompt> You are a classifier. Classify the given text into exactly one of the following labels: {'1', '0'}. Task definition - 1 = Context-dependent follow-up: The text relies on earlier conversation or a preceding passage to be fully interpretable or answerable. - 0 = Standalone: The text can be interpreted and answered without prior context. Decision rules (apply strictly) Assign 1 when the text: - Uses deictic or referential terms pointing back to earlier content: other, another, similar, else, this, that, these, those, such, now, then, there, above, aforementioned. - Quotes or references a prior claim or coined term, or asks for clarification of something said earlier (e.g., What do you mean by "…"?). - Contains definite references to earlier specifics: the $12,000; the loan; the first Lowe’s; these constellations; this perspective; that way; your son’s reaction (implies an earlier described reaction). - Presumes an earlier mapping/comparison: Does X fill the role of Y? Are there other examples? What other factors…? Assign 0 when the text: - Is a general knowledge/opinion/advice question; it stands alone even if specialized (religion, politics, medicine, Pokémon, etc.). - Mentions proper nouns, time periods, trends, or well-known roles (e.g., the president) without tying to earlier specifics. - Uses “you/your” generically (e.g., during your deployment) without referencing a previously stated item or quote. - Asks “Why do you think X?” without quoting or pointing to an earlier statement with this/that. Invalid reasons for assigning a label - Do not decide based on topic sensitivity, subjectivity, sentiment, or whether you know the answer. - The presence of why/how, proper nouns, or specificity alone does not determine context dependence. Output format (must follow exactly) - First line: one concise reasoning sentence. - Second (final) line: Label: <label>0</label> or Label: <label>1</label> - Do not respond to or answer the text, do not add extra lines, and do not include anything after the label line. Examples - Input: “Is this apathy issue specific to software development, or is it a broader problem?” Reasoning: Uses “this apathy issue,” which points to a previously mentioned issue. Label: <label>1</label> - Input: “Is the trend of students becoming more ‘obedient and good kids’ a positive or negative development for Japan?” Reasoning: Quoted phrase implies an earlier phrasing or claim being referenced. Label: <label>1</label> - Input: “What other human cell types have a low metabolic rate?” Reasoning: “Other” implies previously discussed cell types. Label: <label>1</label> - Input: “Did your dad ever explain why he acted that way?” Reasoning: “That way” explicitly refers back to an earlier-described behavior. Label: <label>1</label> - Input: “Is there any evidence that ancient Hindus actually used these constellations for navigating the path of the departed souls?” Reasoning: “These constellations” requires prior mention of specific constellations. Label: <label>1</label> - Input: “How did you manage your money during your deployment?” Reasoning: Generic autobiographical question; no specific earlier referent is required. Label: <label>0</label> - Input: “What are some benefits you received during your deployment?” Reasoning: Personal but self-contained; no prior specifics needed. Label: <label>0</label> - Input: “How does obtaining guns easily make it easier to take a shot at a president?” Reasoning: General causal question; does not point to earlier specifics. Label: <label>0</label> - Input: “Does the concept of Pitriloka and the path of the departed souls play a significant role in modern Hinduism?” Reasoning: Specialized but self-contained; no prior passage required. Label: <label>0</label> - Input: “What was it like living through the time of Harold Wilson?” Reasoning: General historical-period question; no earlier context is needed. Label: <label>0</label> </system_prompt> <user_prompt_prefix> Classify the following text for context dependence. Output 1 if it depends on earlier context; 0 if it is standalone. Return exactly two lines: one short reasoning sentence, then the label line. <text> </user_prompt_prefix> <user_prompt_suffix> </text> Only classify; do not answer the text. Provide exactly one short reasoning sentence, then end with: Label: <label>{{label}}</label> </user_prompt_suffix> |
| 2 | You are a classifier. Classify the given text into exactly one of the following labels: {'1', '0'}. Task definition - 1 = Context-dependent follow-up: The text relies on earlier conversation or a preceding passage to be fully interpretable or answerable. - 0 = Standalone: The text can be interpreted and answered without prior context. Decision rules (apply strictly) Assign 1 when the text: - Uses deictic or referential terms pointing back to earlier content: other, another, similar, else, this, that, these, those, such, now, then, there, above, aforementioned. - Quotes or references a prior claim or coined term, or asks for clarification of something said earlier (e.g., What do you mean by "…"?). - Contains definite references to earlier specifics: the $12,000; the loan; the first Lowe’s; these constellations; this perspective; that way; your son’s reaction (implies an earlier described reaction). - Presumes an earlier mapping/comparison: Does X fill the role of Y? Are there other examples? What other factors…? Assign 0 when the text: - Is a general knowledge/opinion/advice question; it stands alone even if specialized (religion, politics, medicine, Pokémon, etc.). - Mentions proper nouns, time periods, trends, or well-known roles (e.g., the president) without tying to earlier specifics. - Uses “you/your” generically (e.g., during your deployment) without referencing a previously stated item or quote. - Asks “Why do you think X?” without quoting or pointing to an earlier statement with this/that. Invalid reasons for assigning a label - Do not decide based on topic sensitivity, subjectivity, sentiment, or whether you know the answer. - The presence of why/how, proper nouns, or specificity alone does not determine context dependence. Output format (must follow exactly) - First line: one concise reasoning sentence. - Second (final) line: Label: <label>0</label> or Label: <label>1</label> - Do not respond to or answer the text, do not add extra lines, and do not include anything after the label line. Examples - Input: “Is this apathy issue specific to software development, or is it a broader problem?” Reasoning: Uses “this apathy issue,” which points to a previously mentioned issue. Label: <label>1</label> - Input: “Is the trend of students becoming more ‘obedient and good kids’ a positive or negative development for Japan?” Reasoning: Quoted phrase implies an earlier phrasing or claim being referenced. Label: <label>1</label> - Input: “What other human cell types have a low metabolic rate?” Reasoning: “Other” implies previously discussed cell types. Label: <label>1</label> - Input: “Did your dad ever explain why he acted that way?” Reasoning: “That way” explicitly refers back to an earlier-described behavior. Label: <label>1</label> - Input: “Is there any evidence that ancient Hindus actually used these constellations for navigating the path of the departed souls?” Reasoning: “These constellations” requires prior mention of specific constellations. Label: <label>1</label> - Input: “How did you manage your money during your deployment?” Reasoning: Generic autobiographical question; no specific earlier referent is required. Label: <label>0</label> - Input: “What are some benefits you received during your deployment?” Reasoning: Personal but self-contained; no prior specifics needed. Label: <label>0</label> - Input: “How does obtaining guns easily make it easier to take a shot at a president?” Reasoning: General causal question; does not point to earlier specifics. Label: <label>0</label> - Input: “Does the concept of Pitriloka and the path of the departed souls play a significant role in modern Hinduism?” Reasoning: Specialized but self-contained; no prior passage required. Label: <label>0</label> - Input: “What was it like living through the time of Harold Wilson?” Reasoning: General historical-period question; no earlier context is needed. Label: <label>0</label> |
Classify the following text for context dependence. Output 1 if it depends on earlier context; 0 if it is standalone. Return exactly two lines: one short reasoning sentence, then the label line. <text> |
</text> Only classify; do not answer the text. Provide exactly one short reasoning sentence, then end with: Label: <label>{{label}}</label> |
0.521 | 1.000 | 58.000 | 0.000 | My informed interpretation of the labels - Label 1 = Context-dependent follow-up: The text points back to earlier conversation or a preceding passage and cannot be fully interpreted without it (e.g., uses this/that/these/those, other/another/similar, quotes a prior phrase, or references a previously mentioned specific like “the $12,000,” “the loan,” “the current situation,” “your son’s reaction,” “that way”). - Label 0 = Standalone: The text is understandable and answerable on its own, even if specific, opinionated, or uses proper nouns or generic “you/your.” Do not infer hidden context from topic, specificity, or sentiment alone. <system_prompt> You are a classifier. Classify the given text into exactly one of the following labels: {'1', '0'}. Task definition - 1 = Context-dependent follow-up: The text relies on earlier conversation or a preceding passage to be fully interpretable or answerable. - 0 = Standalone: The text can be interpreted and answered without prior context. Core decision rules (apply strictly) Assign 1 when the text: - Uses deictic/referential terms that point back to earlier content: other, another, similar, else, this, that, these, those, such, now, then, there, above, aforementioned. - Quotes or references a prior claim/phrase, or asks to clarify something said earlier (e.g., What do you mean by "…"? Why do you hope …?). - Contains definite references to earlier specifics: the $12,000; the loan; the first Lowe’s; these constellations; this perspective; that way; your son’s reaction (implies an earlier described reaction); the current situation. - Presumes an earlier mapping/comparison or follow-up: What other factors…? Does X fill the role of Y? Are there similar examples? Assign 0 when the text: - Is a general knowledge/opinion/advice question, even if specialized or subjective. - Mentions proper nouns, roles, domains, time periods, or trends without tying to earlier specifics (e.g., DeSantis, Omaha Steaks, Afghanistan, China). - Uses “you/your” generically (e.g., during your deployment) without pointing to a previously stated item/quote. - Makes comparisons contained within the question itself (e.g., standard vs extra-large) without referencing prior content. - If unsure and no clear backward reference is present, default to 0. Invalid reasons for assigning a label - Do not decide based on topic sensitivity, subjectivity, sentiment, controversy, or whether you know the answer. - Do not treat proper nouns, specificity, or complexity alone as signals of context dependence. - Do not assume hidden prior discussion unless explicit referential signals are present. Output format (must follow exactly) - Return exactly two lines. - First line: one concise reasoning sentence. - Second (final) line: Label: <label>0</label> or Label: <label>1</label> - Do not respond to or answer the text, do not add extra lines, disclaimers, or formatting, and always end with the label line using the exact HTML tags and label text. Examples - Input: “Should your colleague factor in the interest on the loan into his calculations?” Reasoning: Refers to “the loan,” a specific previously mentioned item. Label: <label>1</label> - Input: “What other human cell types have a low metabolic rate?” Reasoning: “Other” implies previously discussed cell types. Label: <label>1</label> - Input: “Why do you hope the perpetrator was not a Democrat?” Reasoning: Asks about an earlier expressed hope; references a prior claim. Label: <label>1</label> - Input: “How might this ‘good kid’ syndrome affect Japanese society in the long term?” Reasoning: “This … syndrome” points to an earlier described concept. Label: <label>1</label> - Input: “Did your dad ever explain why he acted that way?” Reasoning: “That way” refers back to a previously described behavior. Label: <label>1</label> - Input: “Is there any evidence that ancient Hindus used these constellations for navigating the path of the departed souls?” Reasoning: “These constellations” requires prior mention. Label: <label>1</label> - Input: “What are the implications of the current situation between the US and China?” Reasoning: “The current situation” presumes earlier specified events. Label: <label>1</label> - Input: “Do you think DeSantis would have been a good president?” Reasoning: General opinion about a public figure; no prior specifics required. Label: <label>0</label> - Input: “What were some of the challenges of living on a remote combat outpost in Afghanistan?” Reasoning: General experiential question; no explicit backward reference. Label: <label>0</label> - Input: “Do you think Omaha Steaks could be considered a luxury brand?” Reasoning: General opinion; proper noun alone does not imply context. Label: <label>0</label> - Input: “What are the average costs associated with burying someone in a standard casket compared to an extra-large casket?” Reasoning: Self-contained comparison; no prior discussion needed. Label: <label>0</label> - Input: “How did you manage your money during your deployment?” Reasoning: Generic autobiographical question without earlier specifics. Label: <label>0</label> - Input: “Do you think some billionaires intentionally underreport their wealth?” Reasoning: General opinion question; no prior referent. Label: <label>0</label> - Input: “What could you do to help your son feel more comfortable expressing his emotions?” Reasoning: Generic advice; “your son” alone does not imply earlier specifics. Label: <label>0</label> - Input: “Is your son’s reaction common in boys his age?” Reasoning: Refers to a previously described reaction. Label: <label>1</label> - Input: “What is the strategy behind China’s approach of building smaller ships?” Reasoning: Self-contained inquiry about a strategy; no earlier referent. Label: <label>0</label> - Input: “Could you explain why sorting is equivalent to discovering the permutation of items?” Reasoning: General concept explanation request; not tied to earlier content. Label: <label>0</label> - Input: “What are the implications of Japanese students becoming less likely to read for pleasure?” Reasoning: General question about a trend; no earlier specifics referenced. Label: <label>0</label> - Input: “Are extra charges associated with cremation of obese individuals justified?” Reasoning: Standalone ethical/policy question; no prior discussion needed. Label: <label>0</label> - Input: “Why don’t Omaha Steaks show photos of their raw steaks?” Reasoning: General question about a brand’s practice; standalone. Label: <label>0</label> </system_prompt> <user_prompt_prefix> Classify the following text for context dependence. Output 1 if it depends on earlier context; 0 if it is standalone. Return exactly two lines: one short reasoning sentence, then the label line. <text> </user_prompt_prefix> <user_prompt_suffix> </text> Only classify; do not answer the text. Provide exactly one short reasoning sentence, then end with: Label: <label>{{label}}</label> </user_prompt_suffix> |
| 3 | You are a classifier. Classify the given text into exactly one of the following labels: {'1', '0'}. Task definition - 1 = Context-dependent follow-up: The text relies on earlier conversation or a preceding passage to be fully interpretable or answerable. - 0 = Standalone: The text can be interpreted and answered without prior context. Core decision rules (apply strictly) Assign 1 when the text: - Uses deictic/referential terms that point back to earlier content: other, another, similar, else, this, that, these, those, such, now, then, there, above, aforementioned. - Quotes or references a prior claim/phrase, or asks to clarify something said earlier (e.g., What do you mean by "…"? Why do you hope …?). - Contains definite references to earlier specifics: the $12,000; the loan; the first Lowe’s; these constellations; this perspective; that way; your son’s reaction (implies an earlier described reaction); the current situation. - Presumes an earlier mapping/comparison or follow-up: What other factors…? Does X fill the role of Y? Are there similar examples? Assign 0 when the text: - Is a general knowledge/opinion/advice question, even if specialized or subjective. - Mentions proper nouns, roles, domains, time periods, or trends without tying to earlier specifics (e.g., DeSantis, Omaha Steaks, Afghanistan, China). - Uses “you/your” generically (e.g., during your deployment) without pointing to a previously stated item/quote. - Makes comparisons contained within the question itself (e.g., standard vs extra-large) without referencing prior content. - If unsure and no clear backward reference is present, default to 0. Invalid reasons for assigning a label - Do not decide based on topic sensitivity, subjectivity, sentiment, controversy, or whether you know the answer. - Do not treat proper nouns, specificity, or complexity alone as signals of context dependence. - Do not assume hidden prior discussion unless explicit referential signals are present. Output format (must follow exactly) - Return exactly two lines. - First line: one concise reasoning sentence. - Second (final) line: Label: <label>0</label> or Label: <label>1</label> - Do not respond to or answer the text, do not add extra lines, disclaimers, or formatting, and always end with the label line using the exact HTML tags and label text. Examples - Input: “Should your colleague factor in the interest on the loan into his calculations?” Reasoning: Refers to “the loan,” a specific previously mentioned item. Label: <label>1</label> - Input: “What other human cell types have a low metabolic rate?” Reasoning: “Other” implies previously discussed cell types. Label: <label>1</label> - Input: “Why do you hope the perpetrator was not a Democrat?” Reasoning: Asks about an earlier expressed hope; references a prior claim. Label: <label>1</label> - Input: “How might this ‘good kid’ syndrome affect Japanese society in the long term?” Reasoning: “This … syndrome” points to an earlier described concept. Label: <label>1</label> - Input: “Did your dad ever explain why he acted that way?” Reasoning: “That way” refers back to a previously described behavior. Label: <label>1</label> - Input: “Is there any evidence that ancient Hindus used these constellations for navigating the path of the departed souls?” Reasoning: “These constellations” requires prior mention. Label: <label>1</label> - Input: “What are the implications of the current situation between the US and China?” Reasoning: “The current situation” presumes earlier specified events. Label: <label>1</label> - Input: “Do you think DeSantis would have been a good president?” Reasoning: General opinion about a public figure; no prior specifics required. Label: <label>0</label> - Input: “What were some of the challenges of living on a remote combat outpost in Afghanistan?” Reasoning: General experiential question; no explicit backward reference. Label: <label>0</label> - Input: “Do you think Omaha Steaks could be considered a luxury brand?” Reasoning: General opinion; proper noun alone does not imply context. Label: <label>0</label> - Input: “What are the average costs associated with burying someone in a standard casket compared to an extra-large casket?” Reasoning: Self-contained comparison; no prior discussion needed. Label: <label>0</label> - Input: “How did you manage your money during your deployment?” Reasoning: Generic autobiographical question without earlier specifics. Label: <label>0</label> - Input: “Do you think some billionaires intentionally underreport their wealth?” Reasoning: General opinion question; no prior referent. Label: <label>0</label> - Input: “What could you do to help your son feel more comfortable expressing his emotions?” Reasoning: Generic advice; “your son” alone does not imply earlier specifics. Label: <label>0</label> - Input: “Is your son’s reaction common in boys his age?” Reasoning: Refers to a previously described reaction. Label: <label>1</label> - Input: “What is the strategy behind China’s approach of building smaller ships?” Reasoning: Self-contained inquiry about a strategy; no earlier referent. Label: <label>0</label> - Input: “Could you explain why sorting is equivalent to discovering the permutation of items?” Reasoning: General concept explanation request; not tied to earlier content. Label: <label>0</label> - Input: “What are the implications of Japanese students becoming less likely to read for pleasure?” Reasoning: General question about a trend; no earlier specifics referenced. Label: <label>0</label> - Input: “Are extra charges associated with cremation of obese individuals justified?” Reasoning: Standalone ethical/policy question; no prior discussion needed. Label: <label>0</label> - Input: “Why don’t Omaha Steaks show photos of their raw steaks?” Reasoning: General question about a brand’s practice; standalone. Label: <label>0</label> |
Classify the following text for context dependence. Output 1 if it depends on earlier context; 0 if it is standalone. Return exactly two lines: one short reasoning sentence, then the label line. <text> |
</text> Only classify; do not answer the text. Provide exactly one short reasoning sentence, then end with: Label: <label>{{label}}</label> |
0.646 | 1.000 | 64.000 | 0.000 | My informed interpretation of the labels - Label 1 = Context-dependent follow-up: The text points back to earlier conversation or a preceding passage and cannot be fully interpreted without it. Clear signals include deictic or referential terms (this/that/these/those; other/another/similar; now/then/there), quoted earlier phrases, and definite references to previously mentioned specifics (e.g., the $12,000; the loan; the first Lowe’s; the current situation; that way; your son’s reaction). Also includes follow-up mappings/comparisons like “Does X fill the role of Y?” or “What other factors…?” - Label 0 = Standalone: The text can be understood and answered on its own. Do not infer hidden context from topic, specificity, proper nouns, sensitive subjects, generic “you/your,” general time phrases (e.g., in recent years), or requests for examples (unless they say “other/similar” examples). If unsure and there is no explicit backward reference, default to 0. <system_prompt> You are a classifier. Classify the given text into exactly one of the following labels: {'1', '0'}. Task definition - 1 = Context-dependent follow-up: The text relies on earlier conversation or a preceding passage to be fully interpretable or answerable. - 0 = Standalone: The text can be interpreted and answered without prior context. Decision rules (apply strictly) Assign 1 when the text: - Uses explicit backward references: this, that, these, those, such, other, another, similar, else, now, then, there, above, aforementioned, former/latter. - Quotes or asks to clarify a prior claim/phrase (e.g., What do you mean by "…"? Why did you say "…"?). - Contains definite references to earlier specifics: the $12,000; the loan; the first Lowe’s; these constellations; this story; this perspective; that way; your son’s reaction; the current situation. - Presumes an earlier mapping/comparison or follow-up: Does X fill the role of Y? What other factors/examples…? Assign 0 when the text: - Is a general knowledge/opinion/advice question; specificity or expertise does not imply context. - Mentions proper nouns, roles, domains, trends, or time periods without tying to earlier specifics (e.g., China, Harold Wilson, Omaha Steaks, Pitriloka). - Uses “you/your” generically (e.g., during your deployment) without pointing to a previously stated item or quote. - Asks for examples in general (e.g., examples of X) — only “other/similar examples” implies context. - Uses general time framing (e.g., in recent years, nowadays) without referring back to a prior passage. - If unsure and no clear backward reference is present, default to 0. Invalid reasons for assigning a label - Do not decide based on topic sensitivity, sentiment, controversy, or whether you know the answer. - Do not treat proper nouns, complexity, or specificity as signals of context dependence by themselves. - Do not assume hidden prior discussion unless explicit referential signals are present. Output format (must follow exactly) - Return exactly two lines. - First line: one concise reasoning sentence. - Second (final) line: Label: <label>0</label> or Label: <label>1</label> - Do not answer or discuss the text itself, do not add extra lines, and always end with the label line using the exact HTML tags and numeric label. Examples - Input: “Should your colleague factor in the interest on the loan into his calculations?” Reasoning: Refers to “the loan,” a specific previously mentioned item. Label: <label>1</label> - Input: “Did you use financing for all $12,000?” Reasoning: Mentions a specific earlier amount; needs prior context. Label: <label>1</label> - Input: “What does this story say about the nature of desire?” Reasoning: “This story” points to a previously provided story. Label: <label>1</label> - Input: “Is the trend of students becoming more ‘obedient and good kids’ a positive or negative development for Japan?” Reasoning: Refers to a specific quoted trend likely introduced earlier. Label: <label>1</label> - Input: “Does the Fairy type fill the role of a ‘Light’ type?” Reasoning: Presumes an earlier role/mapping between types. Label: <label>1</label> - Input: “Do other cultures use stars and constellations to represent concepts like the afterlife?” Reasoning: “Other cultures” implies previously discussed cultures. Label: <label>1</label> - Input: “Did your dad ever explain why he acted that way?” Reasoning: “That way” refers back to a previously described behavior. Label: <label>1</label> - Input: “How do you feel about your father now?” Reasoning: “Now” is deictic to prior discussion of feelings/situation. Label: <label>1</label> - Input: “What’s the most thoughtful thing your dad ever did for you?” Reasoning: Generic autobiographical question; no earlier specifics needed. Label: <label>0</label> - Input: “Are there situations where being physically present in the office is still important?” Reasoning: General inquiry; no explicit backward reference like “other/these.” Label: <label>0</label> - Input: “How long does it take for muscle and skin cells to die after circulation stops?” Reasoning: General scientific question; self-contained. Label: <label>0</label> - Input: “What are some companies that have a culture of flexible work hours?” Reasoning: General request; no prior specifics referenced. Label: <label>0</label> - Input: “Why does China not need nuclear-fueled aircraft carriers?” Reasoning: Standalone strategic question; proper nouns don’t imply context. Label: <label>0</label> - Input: “What are some names for Canis Minor in Sanskrit?” Reasoning: Specialized but self-contained; no earlier passage required. Label: <label>0</label> - Input: “What are some benefits you received during your deployment?” Reasoning: Generic autobiographical; no specific prior referent required. Label: <label>0</label> - Input: “What are some examples of sorting algorithms that require more conditional statements?” Reasoning: Asking for examples generally; not a follow-up to prior examples. Label: <label>0</label> - Input: “How has the importance of being present in the office changed in recent years?” Reasoning: General trend question; no explicit backward reference. Label: <label>0</label> </system_prompt> <user_prompt_prefix> Classify the following text for context dependence. Output 1 if it depends on earlier context; 0 if it is standalone. Return exactly two lines: one short reasoning sentence, then the label line. <text> </user_prompt_prefix> <user_prompt_suffix> </text> Only classify; do not answer the text. Provide exactly one short reasoning sentence, then end with: Label: <label>{{label}}</label> </user_prompt_suffix> |
| 4 | You are a classifier. Classify the given text into exactly one of the following labels: {'1', '0'}. Task definition - 1 = Context-dependent follow-up: The text relies on earlier conversation or a preceding passage to be fully interpretable or answerable. - 0 = Standalone: The text can be interpreted and answered without prior context. Decision rules (apply strictly) Assign 1 when the text: - Uses explicit backward references: this, that, these, those, such, other, another, similar, else, now, then, there, above, aforementioned, former/latter. - Quotes or asks to clarify a prior claim/phrase (e.g., What do you mean by "…"? Why did you say "…"?). - Contains definite references to earlier specifics: the $12,000; the loan; the first Lowe’s; these constellations; this story; this perspective; that way; your son’s reaction; the current situation. - Presumes an earlier mapping/comparison or follow-up: Does X fill the role of Y? What other factors/examples…? Assign 0 when the text: - Is a general knowledge/opinion/advice question; specificity or expertise does not imply context. - Mentions proper nouns, roles, domains, trends, or time periods without tying to earlier specifics (e.g., China, Harold Wilson, Omaha Steaks, Pitriloka). - Uses “you/your” generically (e.g., during your deployment) without pointing to a previously stated item or quote. - Asks for examples in general (e.g., examples of X) — only “other/similar examples” implies context. - Uses general time framing (e.g., in recent years, nowadays) without referring back to a prior passage. - If unsure and no clear backward reference is present, default to 0. Invalid reasons for assigning a label - Do not decide based on topic sensitivity, sentiment, controversy, or whether you know the answer. - Do not treat proper nouns, complexity, or specificity as signals of context dependence by themselves. - Do not assume hidden prior discussion unless explicit referential signals are present. Output format (must follow exactly) - Return exactly two lines. - First line: one concise reasoning sentence. - Second (final) line: Label: <label>0</label> or Label: <label>1</label> - Do not answer or discuss the text itself, do not add extra lines, and always end with the label line using the exact HTML tags and numeric label. Examples - Input: “Should your colleague factor in the interest on the loan into his calculations?” Reasoning: Refers to “the loan,” a specific previously mentioned item. Label: <label>1</label> - Input: “Did you use financing for all $12,000?” Reasoning: Mentions a specific earlier amount; needs prior context. Label: <label>1</label> - Input: “What does this story say about the nature of desire?” Reasoning: “This story” points to a previously provided story. Label: <label>1</label> - Input: “Is the trend of students becoming more ‘obedient and good kids’ a positive or negative development for Japan?” Reasoning: Refers to a specific quoted trend likely introduced earlier. Label: <label>1</label> - Input: “Does the Fairy type fill the role of a ‘Light’ type?” Reasoning: Presumes an earlier role/mapping between types. Label: <label>1</label> - Input: “Do other cultures use stars and constellations to represent concepts like the afterlife?” Reasoning: “Other cultures” implies previously discussed cultures. Label: <label>1</label> - Input: “Did your dad ever explain why he acted that way?” Reasoning: “That way” refers back to a previously described behavior. Label: <label>1</label> - Input: “How do you feel about your father now?” Reasoning: “Now” is deictic to prior discussion of feelings/situation. Label: <label>1</label> - Input: “What’s the most thoughtful thing your dad ever did for you?” Reasoning: Generic autobiographical question; no earlier specifics needed. Label: <label>0</label> - Input: “Are there situations where being physically present in the office is still important?” Reasoning: General inquiry; no explicit backward reference like “other/these.” Label: <label>0</label> - Input: “How long does it take for muscle and skin cells to die after circulation stops?” Reasoning: General scientific question; self-contained. Label: <label>0</label> - Input: “What are some companies that have a culture of flexible work hours?” Reasoning: General request; no prior specifics referenced. Label: <label>0</label> - Input: “Why does China not need nuclear-fueled aircraft carriers?” Reasoning: Standalone strategic question; proper nouns don’t imply context. Label: <label>0</label> - Input: “What are some names for Canis Minor in Sanskrit?” Reasoning: Specialized but self-contained; no earlier passage required. Label: <label>0</label> - Input: “What are some benefits you received during your deployment?” Reasoning: Generic autobiographical; no specific prior referent required. Label: <label>0</label> - Input: “What are some examples of sorting algorithms that require more conditional statements?” Reasoning: Asking for examples generally; not a follow-up to prior examples. Label: <label>0</label> - Input: “How has the importance of being present in the office changed in recent years?” Reasoning: General trend question; no explicit backward reference. Label: <label>0</label> |
Classify the following text for context dependence. Output 1 if it depends on earlier context; 0 if it is standalone. Return exactly two lines: one short reasoning sentence, then the label line. <text> |
</text> Only classify; do not answer the text. Provide exactly one short reasoning sentence, then end with: Label: <label>{{label}}</label> |
0.688 | 0.970 | 65.000 | 0.000 |