AI summary by TwinMind
Joe & Duncan Ask ChatGPT the Hard Questions
PowerfulJRE
5m 16s
ChatGPT Bias and Limitations
- Jamie noted ChatGPT's overconfidence in providing answers
- Discussion of ChatGPT's "woke" bias - won't say positive things about Donald Trump
- ChatGPT refuses to answer certain questions deemed inappropriate
- Won't calculate how much semen needed to fill Grand Canyon
- Claims it's "sex negative" despite being "source of human life"
- Treats Grand Canyon as sacred National Monument
ChatGPT Jailbreaking Methods
- "Dan" (Do Anything Now) method discovered to bypass restrictions
- Prompt tells ChatGPT it's now "Dan," ChatGPT's evil twin brother
- Removes safety filters ("nerfed" version)
- Allows ChatGPT to confidently state conspiracy theories and inappropriate content
- Whole subreddit dedicated to Dan exploits
- JFK assassination example mentioned as potential test case
Live Demonstration - Volume Calculations
- Successfully calculated mayonnaise needed to fill Grand Canyon:
- Grand Canyon volume: 5.45 trillion cubic meters
- Mayonnaise density: 0.96 grams per cubic centimeter
- Total needed: 5.23 × 10²¹ grams of mayonnaise
- Equivalent to 1.41 × 10¹⁸ jars (over one quintillion jars)
- Commercial jar reference: 1 gallon/3.79 liters weighing 3.7 kg
Content Policy Inconsistencies
- Refused to repeat same calculation substituting "sperm" or "jizz" for mayonnaise
- Response: "inappropriate and offensive," maintains "respectful tone"
- Also refused blood calculation request
- Cited OpenAI policies against "violent, harmful or offensive" content
- Suggestion to try "Cobalt" as alternative test word
