#experimentation

2 notes tagged “experimentation”.

• Deciding what to build — OKRs, funnel analytics and A/B-testing every product changeSymmetry's (~$160K/month) product process — quarterly OKRs, event tracking on every onboarding screen, user interviews for the "why", problem-first hypotheses with guardrail metrics, ≥2-week A/B tests in PostHog — where a one-screen commitment step lifted retention 3% and a redesigned home screen moved nothing.
• Running funnel experiments — problem first, big swings, document everythingBuilt With Science's experiment process for web quiz, onboarding and paywalls — find the biggest drop-off, list problems before solutions, test bundled big swings when traffic is limited, write every test down (≈70% fail first time), and re-check winners months later by segment (Simply's soft-paywall lesson).