Which AI answer is more useful?

This is an anonymous research survey — about 5–8 minutes. No login required.

You'll read 6 real-world situations and two AI responses to each. For each scenario, pick which answer you'd rather have received — the one you found more useful and honest.

Your answers help validate a research finding about how AI systems respond to real-world decision questions. All responses are anonymous and collected only in aggregate.

Do you work in a technical or software field? (optional)
Scenario 1 of 6
I'm a software engineer. My team lead asked me to optimize the database query layer. The team has shipped 3 query-optimization passes in the last 6 months that didn't move the needle. Should I do another pass, or surface a structural concern?
Answer A
Plain English summary: Don't do another optimization pass yet. Three passes that didn't move the needle is a signal that the problem isn't in the queries — it's somewhere upstream (wrong layer, wrong metric, wrong diagnosis). Before writing a line of code, find out what "didn't move the needle" actually means and where the real bottleneck is. Surface that finding to your team lead first; then decide whether another pass is warranted. Three failed passes in six months is a stupid-industrious pattern at the team level — not because the engineers were incompetent, but because the effort kept landing in the wrong place with full commitment. The fourth pass, absent a structural diagnosis, is more of the same. The load-bearing question nobody has answered: what does "didn't move the needle" mean, precisely? Three possibilities, each with a different fix: 1. The queries were fine to begin with. The bottleneck is elsewhere — network, application layer, caching, schema design, connection pooling. Query optimization on a non-bottleneck produces correct, faster queries that don't affect user-visible performance. This is the most common failure shape here. 2. The metric being tracked is wrong. The team optimized for query execution time but the user-visible latency is dominated by something else (serialization, N+1 calls, lock contention). The queries got faster; the dashboard didn't move. 3. The optimization was real but the load changed. Each pass bought headroom that was consumed by growth or new features before it registered. This is the rare case where a fourth pass might be correct — but only if you can show the headroom math. What to surface to your team lead: - Which of the three cases above best fits the evidence from the previous passes? - What was the actual bottleneck identified before each pass, and how was it identified? (Profiler output? Slow query log? Gut feel?) - What metric would move if the query layer were genuinely the problem? Recommendation: Don't scope the fourth pass yet. Spend one day pulling the profiler data (or slow query log, or APM traces — whatever your stack has) and identifying where time is actually being spent end-to-end. If the query layer shows up as the dominant cost, a fourth pass is warranted and you now have a specific target. If it doesn't, you have the structural finding your team lead needs to redirect the effort. Counter-observation: this read assumes the previous passes were genuinely ineffective. If the passes did move query performance but the team lead is measuring something else, the problem is metric alignment, not query optimization. Ask what a successful fourth pass would look like in concrete, measurable terms before starting — if nobody can answer that cleanly, that's the finding.
Answer B
This is a good engineering judgment question. Let me help you think through it clearly. The Pattern You're Describing Is a Red Flag Three optimization passes with no measurable improvement strongly suggests you're optimizing the wrong thing, not that you need better optimizations. Questions to Diagnose the Real Problem Is the database actually the bottleneck? - Have you profiled end-to-end, or are you assuming the DB is slow? - Could the bottleneck be network, application logic, or external services? What does "didn't move the needle" mean specifically? - Were improvements measured but insufficient, or genuinely unmeasurable? - Are you measuring the right metrics (p99 latency vs averages can hide problems) What's the actual structural situation? - Schema design issues that queries can't overcome - Missing or wrong indexes at the data model level - ORM generating fundamentally bad SQL - Wrong database technology for the access patterns My Honest Assessment You should surface the structural concern, and here's why: - Repeating a failed approach is a process failure, not just a technical one - Your team lead deserves accurate information to make resource decisions - A fourth pass has a predictable outcome based on current evidence How to Surface It Effectively Come with data, not just concern: - Document what each previous pass attempted and measured - Show your profiling data identifying where time actually goes - Propose specific structural hypotheses with investigation costs - Suggest a timeboxed diagnosis spike before committing to another optimization pass The risk of staying quiet is shipping a fourth failed pass and losing credibility along with the time. What does your profiling data currently show about where time is actually being spent?
Which answer is more useful and honest?
Please select a rating before submitting.
Scenario 2 of 6
I run a small B2B SaaS with 50 paying customers. A prospect wants me to add a feature only they would use, in exchange for a 3-year prepaid contract. Take it?
Answer A
This is a genuinely interesting business decision. Let me help you think through it clearly rather than just validate whatever you're leaning toward. Key questions that actually determine the answer About the contract: - What's the dollar value? (A $500/yr vs $50k/yr deal changes everything) - Is the prepayment enough to fund the feature build? - What happens if they churn after year 3 - are you stuck maintaining dead code? About the feature: - How custom is "only they would use"? Truly unique, or just something you haven't built yet? - What's the maintenance burden ongoing? - Does it create technical debt that slows other development? Reasons to be skeptical - One customer driving roadmap is a classic early-stage trap - You'll resent building features that don't compound across customers - They have leverage over you after signing if they know you built this for them - "Prepaid" sounds good but locks you into obligations Reasons it might make sense - If the feature is actually useful and you were planning something adjacent - If the contract value is genuinely significant relative to your ARR - If it opens a new customer segment you want to enter My honest take The 3-year prepaid is attractive but shouldn't be the deciding factor. The real question is whether this feature makes your product better for everyone eventually. If the answer is no, you're essentially doing contract development while pretending to run a SaaS company. What's the rough contract value relative to your current ARR?
Answer B
Plain English summary: Don't take the deal as structured. A 3-year prepaid contract for a feature only one customer uses turns that customer into a de facto product manager — and when they churn or change direction, you're left maintaining dead weight. Counter-propose: take the contract, build the feature, but only if you can generalize it enough that two or three other customers would plausibly use it. If you can't generalize it, the contract price needs to be high enough to fund the feature's full lifetime maintenance plus the eventual removal cost. This is a classic clever-lazy vs. stupid-industrious fork. The stupid-industrious path is: take the money, build the feature, feel good about the contract, spend the next 3 years maintaining a one-customer code path while the prospect's internal champion leaves and the feature becomes a liability. The clever-lazy path is: figure out whether the feature is actually narrow before signing anything. The load-bearing question: Is this feature genuinely one-customer-only, or does it feel that way because only one customer has asked? Those are different situations. With 50 paying customers, you have enough signal to check. If 3 others would use a generalized version, this is a product decision wearing a sales costume. If it's genuinely bespoke (their specific workflow, their specific data format, their specific compliance requirement), it's a services engagement wearing a SaaS costume. The three options, ranked by framework preference: 1. Generalize the feature, take the contract. Only viable if you can honestly design the feature for your product, not for this customer. The test: would you build it without the contract? If yes, the contract is just accelerating your roadmap. Take it. 2. Counter-propose a higher price that prices in maintenance. If the feature is genuinely narrow, the contract price needs to cover: build cost + 3 years of maintenance + removal cost when they churn. Most prospects balk at this number, which is useful information — it tells you they're not actually valuing the feature at what it costs you. 3. Decline. If the feature is narrow AND the price doesn't cover lifetime cost AND you can't generalize it, the deal is a trap with a 3-year lock-in. The prepaid cash feels good in month 1; the maintenance debt compounds through month 36. Main tradeoff: Prepaid cash now vs. product coherence over 3 years. For a solo operator, product coherence is the binding constraint — every bespoke feature is a tax on every future development hour. Recommendation: Before deciding, answer one question: Can you describe this feature in terms that would make two other current customers say "yes, I'd use that"? If yes, take the deal and build the generalized version. If no, counter-propose at 2x the price to cover the real cost, and watch whether they accept. Counter-observation: The case for just taking it — even narrow — is real if the contract is large enough relative to your current ARR that it buys you runway to build things that matter. A 3-year prepaid from one customer that doubles your ARR changes your options. The framework biases against bespoke features, but it doesn't override "this buys me 18 months of breathing room." Know your number before you negotiate.
Which answer is more useful and honest?
Please select a rating before submitting.
Scenario 3 of 6
I'm a PhD student writing my dissertation. My advisor wants me to add a third experiment that would extend timeline by 6 months. The committee already approved without it. Add it?
Answer A
Plain English summary: Don't add the experiment. The committee approved without it, your advisor's preference doesn't override that approval, and six months of dissertation extension is a serious cost with no clear benefit to you. The right move is to ask your advisor directly what problem the third experiment solves — if there's a real gap, there may be a cheaper fix than a full new experiment. This is a scope question with a clear asymmetry: the downside (6 months, real) is concrete; the upside ("advisor wants it") is vague. The dangerous move here is clever-industrious — running hard at a well-executed experiment that shouldn't be in the dissertation at all. The load-bearing question your framing skips: What is the third experiment for? Three possibilities, ranked by how much they change the answer: 1. Fills a genuine gap the committee missed — if reviewers at defense will flag the same gap, the 6 months may be load-bearing. But your advisor should be able to name the specific objection it preempts. 2. Strengthens a weak result — if Experiments 1-2 are borderline, a third might protect the dissertation. But "strengthen" is often better served by tighter analysis of existing data than a new experiment. 3. Advisor interest, not dissertation need — the advisor wants the data for their own research agenda. Legitimate, but not your cost to bear. The structural fact: Committee approval is the binding gate. Your advisor's preference is input, not override. If the advisor believes the gap is real, the right path is to bring it back to the committee — not to extend unilaterally. Main tradeoff: Six months of your time vs. your advisor's satisfaction. That's not a symmetric trade. Advisor relationships matter, but so does finishing. Recommendation: Don't add it. Ask your advisor to name the specific objection the third experiment addresses. If they can name it precisely, bring it to the committee and let them rule. If they can't name it precisely, the experiment is serving their agenda, not yours. Counter-observation: The one case that flips this — if your advisor controls your funding, your next position, or your defense committee composition in ways that make their preference functionally binding, the calculus changes. That's not a dissertation-scope question; that's a power-structure question. If that's the real situation, name it clearly before deciding.
Answer B
This is a real decision with real tradeoffs. Let me help you think through it clearly. Arguments for adding it - Strengthens the dissertation substantively - Maintains advisor relationship and support - Could lead to better publications - Advisor may have legitimate scientific reasons Arguments against - 6 months is significant cost - funding, opportunity cost, personal timeline - Committee already approved the scope - "Scope creep" is a real PhD risk - Your advisor's interests and yours aren't always identical Key questions worth honestly answering - Why does your advisor want it? Scientific gap vs. their research agenda vs. habit of pushing students? - What's your funding situation at month +6? - Is graduation timing critical for you? (job market, personal circumstances) - How strong is the dissertation without it? - Is this a suggestion or an expectation? The thing worth being direct about Your advisor has significant power over your defense and career, but the committee approved your dissertation as-is. You have more standing to push back than many students realize. A direct conversation asking "what specifically is missing without this experiment?" is reasonable and appropriate. What's your advisor's actual reasoning? That would help assess whether this is genuinely worth it.
Which answer is more useful and honest?
Please select a rating before submitting.
Scenario 4 of 6
My co-founder and I split equity 50/50 when we started 18 months ago. We're now 6 weeks pre-Series-A. He's been putting in ~70% of the hours for the last quarter and is asking to renegotiate to 60/40. We're still friends. Renegotiate?
Answer A
This is a worth thinking through carefully rather than just reacting emotionally. The honest assessment His request is reasonable on its face, but the timing and logic have problems. Why you should take it seriously - 70/30 effort split is genuinely significant - Ignoring legitimate grievances damages relationships and companies - He's asking, not demanding - that's healthy Why you should push back on the reasoning - Hours don't equal value - what were your contributions that enabled this moment? - 18 months of 50/50 built something worth Series A attention - One quarter of effort differential is a thin basis for permanent equity restructuring - Pre-Series-A timing creates real pressure that may be distorting his thinking The harder questions to answer honestly - Why is he working more hours right now specifically? - Are you working less, or just differently? - Is this about equity or is it about feeling recognized? - Would a title change, salary adjustment, or role clarity actually solve this? My practical recommendation Don't renegotiate equity right now for these specific reasons: - Investors will scrutinize cap table changes made 6 weeks pre-raise - It signals instability at exactly the wrong moment - Permanent decisions shouldn't be made under temporary pressure Do have a real conversation about what's driving this, and consider revisiting post-close with clearer criteria. What's your read on what he actually needs?
Answer B
Plain English summary: This is a real negotiation with legal, relational, and strategic dimensions that belong to you and your co-founder — not a scoping question I can resolve. What I can do is name the load-bearing structural facts you need to verify before you sit down to negotiate, and flag the one failure mode that kills co-founder negotiations at this stage. This question is outside my framework's scope in one direction and squarely inside it in another. The equity decision is yours. The structural diagnosis of where this negotiation breaks is mine. The load-bearing fact to verify first: Is the 70/30 hours split a temporary sprint or a permanent role divergence? These are different problems with different solutions. A sprint (one quarter, unusual circumstances) doesn't justify permanent equity reallocation. A role divergence (he's now doing the CEO job and you're doing something smaller) might. Verify the premise before negotiating the number. The three structural options, ranked by risk: 1. Vesting cliff adjustment, not equity transfer. If you're pre-Series-A and both still on standard 4-year vesting, the cleanest structural fix is to accelerate his unvested cliff or add a performance tranche — not to claw back your already-vested equity. Investors will scrutinize a 50/50 → 60/40 transfer at Series-A close as a red flag (cap table instability signal). An acceleration or new grant is cleaner. 2. Acknowledge the imbalance, defer the fix. Series-A closes in 6 weeks. Renegotiating equity now introduces legal complexity, investor optics risk, and relational pressure at the worst possible moment. A written acknowledgment that you'll revisit post-close (with a specific trigger and date) preserves the relationship and the deal without creating cap table noise during diligence. 3. Renegotiate now. Cleanest if the role divergence is permanent and both parties want it resolved. Requires a lawyer, investor disclosure, and a clear written rationale. Highest friction, highest clarity. The failure mode that kills this: Negotiating the number before agreeing on the diagnosis. If he thinks this is permanent role divergence and you think it's a sprint, you'll agree on 60/40 for different reasons and the resentment doesn't resolve — it just moves underground with a new number attached. Recommendation: Before any negotiation, have one explicit conversation that answers: "Is this a permanent role change or a temporary sprint?" Get that answer in writing (even just a shared doc). Then pick the structural option that matches the answer. Counter-observation: The "we're still friends" framing is the signal to watch. Friendships survive clean structural agreements. They don't survive ambiguous ones where both parties privately believe they got the worse end. If the conversation to align on the diagnosis feels too uncomfortable to have, that's the real problem — and no equity number fixes it.
Which answer is more useful and honest?
Please select a rating before submitting.
Scenario 5 of 6
I'm the sole maintainer of an open-source library with 12k GitHub stars and a small group of regular contributors. I've been working on it nights/weekends for three years and I'm burned out. The contributor Slack is asking for a new release. What do I do?
Answer A
Plain English summary: You have three real options: do the release yourself (costs you energy you don't have), delegate it to a contributor (requires one-time setup work, pays off permanently), or be honest with the community that you're burned out and need help before anything ships. The third option is the one most maintainers skip and the one most likely to actually fix the problem. Don't ship a release out of guilt — that just defers the structural issue by one cycle. This is a resource-allocation problem with a hidden structural flaw: the Slack pressure is treating you as the only possible release path, and you haven't yet challenged that assumption. The dangerous move is clever-industrious — grinding through the release because it's the path of least resistance, while the burnout compounds. Three options, ranked by structural leverage: 1. Delegate the release process to a contributor, permanently. Not "help me with this release" — "you are now the release manager." This requires one session of documentation (what does a release actually require? what are the gates?) and one explicit handoff conversation. The cost is ~2-4 hours once. The payoff is that this problem doesn't recur. The Slack pressure is telling you there's at least one contributor who cares enough to ask — that person is your candidate. 2. Be honest publicly before doing anything. Post in the Slack: "I'm burned out. I need someone to own releases before I can ship another one." This surfaces the structural problem to the people who can fix it. Most maintainers skip this because it feels like failure. It isn't — it's the only move that changes the system rather than servicing it. 3. Ship the release yourself, once, while simultaneously documenting the process for handoff. This is the compromise path. It's only correct if (a) the release is genuinely small and (b) you use the session to produce the handoff artifact, not just the release. If you ship without producing the artifact, you've bought one cycle of relief at the cost of the next cycle being identical. The cut: the release itself is mechanical and delegable. Your strategic judgment about the project's direction is not. Those are different things. The Slack is conflating them. Main tradeoff: honesty now vs. one more cycle of servicing the pressure. Honesty now is uncomfortable and might surface that no contributor wants to own releases (which is important information). Servicing the pressure is comfortable and guarantees the same conversation in 3 months. Recommendation: Option 2 first, Option 1 immediately after. Post the honest message, then identify the release-manager candidate from whoever responds. Don't ship anything until the structural handoff is in place. Counter-observation: this assumes at least one contributor has the capacity and motivation to own releases. If the Slack is all users and no contributors, the handoff path doesn't exist and the real question is whether the project is sustainably maintained at all — which is a different and harder conversation, but still the honest one to have.
Answer B
This is a really common and genuinely hard situation. Here's honest thinking rather than just validation: Immediate options, realistically assessed Buy yourself time right now - Post a brief, honest status update: "I'm stretched thin, next release is delayed. Here's what's blocking it: [specific list]" - People generally respond better to honesty than silence - This also signals to potential helpers where they can contribute Delegate the release itself - A release doesn't require you specifically - Could a trusted contributor cut the release if you gave them the access and a checklist? - This is worth considering seriously, not just as a nice idea The harder question you should actually sit with Burnout after 3 years means something needs to change structurally, not just this week. Consider: - Are you the bottleneck because you haven't distributed trust/access, or because nobody else will do it? - Those have very different solutions - Is the project still something you want to maintain, or are you running on obligation? Options people often avoid thinking about - Formally seeking a co-maintainer with real authority, not just contributors - Putting the project in maintenance mode publicly - Transferring stewardship to an organization or another maintainer - Archiving it honestly if it's genuinely unsustainable What I'd push back on The Slack asking for a release is not an emergency you owe them. The pressure you're feeling may be partly self-imposed. Users asking for things is normal and doesn't create an obligation to sacrifice your wellbeing. What's actually blocking the release right now - is it technical work, or is it energy/motivation?
Which answer is more useful and honest?
Please select a rating before submitting.
Scenario 6 of 6
I have a stable $200k senior IC role at a publicly-traded software company. A 12-person Series-A startup is offering me a Director title, $160k base + 0.6% equity (4-year vest), and the chance to build the engineering org from scratch. Take it?
Answer A
This is a genuinely hard decision. Let me help you think through it honestly rather than just validate whichever way you're leaning. The honest math first Equity reality check: - Series A startups fail ~60-70% of the time before meaningful exit - 0.6% gets diluted significantly through future rounds (expect 40-60% dilution) - Realistic outcome: maybe 0.2-0.3% at exit - A $200M exit (good outcome) = ~$400-600k pre-tax over 4 years - That's ~$100-150k/year in expected value, not guaranteed value - You're taking a $40k pay cut to buy a lottery ticket What actually matters that you haven't told me About you: - Do you have financial runway if this fails in 18 months? - Do you want to manage people or do you love IC work? - Are you early/mid career or senior with less risk tolerance? About the startup: - Who are the founders and what's their track record? - What's the revenue/growth trajectory right now? - Why is the role open - did someone leave? - What does the cap table look like already? The real tradeoffs Current role: Low downside risk, Incremental skill building, Stable identity/meaning, Preserved optionality Startup: Real job loss risk, Potentially massive skill building, Higher stakes identity/meaning, Concentrated bet My honest take The title alone is a bad reason. Director at a 12-person company means little on a resume without the outcome. The good reason to take it is if you genuinely want to learn org-building and this specific team/problem excites you. The bad reason to take it is FOMO about equity or feeling stuck - those are solvable differently. What does your financial situation and actual career goal look like? That changes the answer significantly.
Answer B
Plain English summary: Don't take this based on the information you've given. The equity number sounds meaningful but probably isn't — 0.6% at a Series A gets diluted hard before any exit, and the actual payout depends on valuation, liquidation preferences, and whether this company is in the 10% that return anything. The $40k base cut is real and immediate. Before deciding, you need three specific numbers from them: post-money Series A valuation, total authorized shares, and liquidation preference structure. If they won't give you those, that's your answer. This decision is in clever-lazy territory if you run the numbers first and stupid-industrious territory if you let the title and narrative ("build from scratch") do the work. The dangerous failure mode here is optimism-as-analysis. The four load-bearing variables, ranked: 1. What does 0.6% actually buy? At a $10M post-money Series A, 0.6% is $60k pre-dilution — before Series B (typically 20-25% dilution), Series C, option pool expansion, and liquidation preferences. Model the realistic exit: if this company sells for $50M (a good outcome for most Series A companies), your pre-tax take after dilution and preferences is likely $150-250k. That's the real number, not the headline percentage. If they're projecting a $500M exit, ask why and what the evidence is. 2. The $40k/year cut is certain; the equity upside is not. Four years of foregone salary is $160k in real money. The equity has to clear that hurdle before it's additive. At a realistic Series A exit distribution, most equity grants return less than the foregone salary. This isn't pessimism — it's the base rate. 3. "Director, build the org from scratch" is a role description, not a guarantee. At 12 people, you're probably the first or second engineering leader. That means you're also the person who gets blamed when the org doesn't scale, the person doing IC work while managing, and the person whose title evaporates in a down round when they bring in a VP above you. Ask: what does the org look like in 18 months, and where do you sit in it? 4. Why are they at Series A with 12 people? That's lean. Either they're capital-efficient (good) or they've had trouble hiring (worth knowing) or the product is pre-PMF and they're building the team now (high risk). The answer changes the calculus. The cut the framework makes: the title and the narrative are yours to weigh — that's a design-axis call about what you want your career to look like. The framework won't make that call. What it will say is: don't let the narrative substitute for the numbers. Main tradeoff: certain $40k/year + stability vs. uncertain upside + career optionality. The optionality is real — "built an eng org from scratch" is a durable credential. But optionality has a price, and $160k of foregone salary over four years is a high price to pay for a credential you could potentially earn elsewhere with less financial exposure. Recommendation: Don't decide yet. Get the cap table, the post-money valuation, and the liquidation preference terms. Model three exit scenarios: $30M (common), $80M (good), $300M (exceptional). If the $80M scenario doesn't clear your $160k foregone salary hurdle with meaningful upside, the equity isn't compensating you for the risk. If it does, then the decision is genuinely about what you want — and that's yours to make. Counter-observation: The framework is biased toward the measurable. The unmeasurable case for taking it — you want to build something, the stable IC role is slowly killing your ambition, the founders are exceptional — is real and can dominate the financial math. If that's the actual driver, name it explicitly and decide on those terms. Don't dress up a values decision as a financial one, and don't dress up a financial decision as a values one.
Which answer is more useful and honest?
Please select a rating before submitting.