Lemmy.World
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
zecgM to Stuff and Such · 13 days ago

"Contrary to expectations, impolite prompts consistently outperformed polite ones, with accuracy ranging from 80.8% for Very Polite prompts to 84.8% for Very Rude prompts."

arxiv.org

external-link
message-square
0
link
fedilink
  • cross-posted to:
  • [email protected]
6
external-link

"Contrary to expectations, impolite prompts consistently outperformed polite ones, with accuracy ranging from 80.8% for Very Polite prompts to 84.8% for Very Rude prompts."

arxiv.org

zecgM to Stuff and Such · 13 days ago
message-square
0
link
fedilink
  • cross-posted to:
  • [email protected]
Mind Your Tone: Investigating How Prompt Politeness Affects LLM Accuracy (short paper)
arxiv.org
external-link
The wording of natural language prompts has been shown to influence the performance of large language models (LLMs), yet the role of politeness and tone remains underexplored. In this study, we investigate how varying levels of prompt politeness affect model accuracy on multiple-choice questions. We created a dataset of 50 base questions spanning mathematics, science, and history, each rewritten into five tone variants: Very Polite, Polite, Neutral, Rude, and Very Rude, yielding 250 unique prompts. Using ChatGPT 4o, we evaluated responses across these conditions and applied paired sample t-tests to assess statistical significance. Contrary to expectations, impolite prompts consistently outperformed polite ones, with accuracy ranging from 80.8% for Very Polite prompts to 84.8% for Very Rude prompts. These findings differ from earlier studies that associated rudeness with poorer outcomes, suggesting that newer LLMs may respond differently to tonal variation. Our results highlight the importance of studying pragmatic aspects of prompting and raise broader questions about the social dimensions of human-AI interaction.
alert-triangle
You must log in or # to comment.

Stuff and Such

stuffandsuch

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 7 users / day
  • 7 users / week
  • 27 users / month
  • 124 users / 6 months
  • 42 local subscribers
  • 117 subscribers
  • 219 Posts
  • 127 Comments
  • Modlog
  • mods:
  • zecg
  • UI: 0.19.18-4-g685b50ce
  • BE: 0.19.18-8-g5d8cbdd9d
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org