iOS 콘 실험

할당(is_eligible) 기준. SRM 위반(⚠) 시 전 수치 참고치. 결론 = SRM 정상 + 경과 7일 이상. 핵심 분해: Pay CVR = Reach5 × Con-of-Reach5.

controlcontrolcredittreatment
Status running killed killed running
First Cohort 08-06 01-20 01-21 08-06
Cohort Age 8 206 205 8
▼ Devices DB 1,908 18,755 553 1,898
└ Assign Share % 50.1% 97.1% 2.9% 49.9%
└ SRM Violation ⚠ SRM ⚠ SRM
└ Device → Message CVR 28.3% 36% 40.5% 24.2%
▼ Messages DB 540 6,746 224 459
└ Reach5 6.9% 16.3% 22.6% 15.2%
└ Reach10 5.1% 12.2% 15.2% 6.8%
└ Msg / Starter 8.9 23 27.9 11
└ Img / Starter 6 13.9 15.5 3.2
▼ Handoff App DB 146 2,674 113 0
└ Handoff % 7.7% 14.3% 20.4% 0%
▼ New Cohort Pay 38 929 30 47
└ Pay CVR 2% 5% 5.4% 2.5%
└ Con Pay Devices 0 5 9 47
└ Web Pay Devices 1 20 4 0
└ RC Pay Devices 37 904 18 0
└ Con-of-Reach5 0% 0% 6.4% 14.5%
└ Paid D1 Message Users 13 345 10 6
└ Paid D1 Message Retention 34.2% 37.1% 33.3% 12.8%
▼ New Cohort Revenue ₩1,856,800 ₩39,629,564 ₩927,860 ₩1,045,000
└ ARPU ₩973 ₩2,113 ₩1,678 ₩551
└ ARPPU ₩48,863 ₩42,658 ₩30,929 ₩22,234
▼ New Cohort Refund ₩88,000 ₩4,953,123 ₩89,900 ₩0
└ Cohort Refund Payers 1 95 1 0
└ D1 Cancel% 29.7% 20.6% 0% -
└ D3 Cancel% 54.1% 53.4% 47.1% -
▼ User Messages 4,814 155,081 6,247 5,067
└ Images 3,266 93,938 3,481 1,446
└ Videos 0 1 17 351
└ Voices 0 3 2 120
>_ Playground에서 이 쿼리 열기 & 직접 수정하기 → DuckDB에서 콘 결제(con_payers)와 웹/앱 결제 분해 및 Pay CVR 공식을 직접 검증할 수 있습니다.
222 rows
cohort_date_kst variant devices reach5_devices payers con_payers revenue_krw
2026-08-14 control 198 13 2 0 176,000₩
2026-08-14 treatment 190 23 2 2 27,500₩
2026-08-13 control 225 18 6 0 266,900₩
2026-08-13 treatment 200 41 4 4 126,500₩
2026-08-12 control 197 15 1 0 88,000₩
2026-08-12 treatment 205 22 3 3 60,500₩
2026-08-11 control 210 18 6 0 346,900₩
2026-08-11 treatment 220 35 5 5 269,500₩
2026-08-10 control 280 18 5 0 121,000₩
2026-08-10 treatment 262 33 4 4 192,500₩
2026-08-09 control 285 22 11 0 572,000₩
2026-08-09 treatment 276 40 10 10 132,000₩
2026-08-08 control 201 8 3 0 132,000₩
2026-08-08 treatment 245 45 10 10 126,500₩
2026-08-07 control 271 15 4 0 154,000₩
2026-08-07 treatment 260 46 9 9 110,000₩
2026-08-06 control 41 5 0 0 0₩
2026-08-06 treatment 40 4 0 0 0₩
2026-07-16 control 253 35 14 1 573,500₩
2026-07-15 control 592 69 19 3 461,900₩
2026-07-14 control 616 68 14 0 457,400₩
2026-07-13 control 531 61 12 0 357,800₩
2026-07-12 control 643 90 30 0 1,117,400₩
2026-07-11 control 599 67 14 0 741,400₩
2026-07-10 control 510 52 19 0 958,500₩
2026-07-09 control 442 47 17 0 868,600₩
2026-07-08 control 505 74 20 0 949,000₩
2026-07-07 control 428 55 9 0 502,300₩
2026-07-06 control 511 66 20 0 797,800₩
2026-07-05 control 514 61 12 0 454,500₩
Page 1 of 8 (222 items)
>_ Playground에서 이 쿼리 열기 & 직접 수정하기 → DuckDB에서 STG 테이블과 조인하거나 지표 정의를 직접 수정해 볼 수 있습니다.