选择阈值与指标
针对您关心的类别进行优化
选择阈值与指标 是 CoddyKit 上的免费 NLP Academy 课时。 这是第 3 节课,共 4 节。 你可以在下方免费阅读本课时的完整内容 — 然后在浏览器中使用内置代码编辑器和全天候 AI 导师进行实践。 这是 NLP Academy 学习路径的一部分,你的进度在网页和 CoddyKit 应用中同步。 NLP Academy 课程共包含 4 节课。
本课时的部分内容尚未翻译,以英文显示。
The Hidden Threshold
Classifiers output a probability, then a threshold turns it into a label. The default 0.5 is rarely best for rare classes.
Move the Line
Lowering the threshold flags more items as the rare class, catching more true cases at the cost of extra false alarms.
Get Probabilities First
To tune a cutoff you need scores, not just labels. Ask the model for the predicted probability of the positive class.
proba = clf.predict_proba(X_test)[:, 1]Precision or Recall?
Decide what hurts more. Missing rare cases means optimize recall; too many false alarms means favor precision.
F1 Balances Both
When you cannot pick a side, the F1 score blends precision and recall into one number worth maximizing.
The PR Curve
For skewed data the precision-recall curve tells the real story far better than an ROC curve does.
Sweep the Cutoffs
Try many cutoffs and watch how the trade-off shifts. The PR curve shows every precision-recall pair at once.
from sklearn.metrics import precision_recall_curve
p, r, t = precision_recall_curve(y, proba)Apply Your Chosen Cutoff
Once you pick a value, compare each probability to it. Above the line becomes the positive class, below becomes negative.
preds = (proba >= 0.3).astype(int)Beware ROC AUC
ROC AUC can look great on heavy imbalance even when precision is poor, so do not trust it alone here.
Tune on Validation Data
Choose your threshold on a held-out validation set, never on the test set, or your reported numbers will lie.
Metric Mirrors the Goal
The right metric reflects real-world cost. Let the business goal pick precision, recall, or F1, then tune to it. 🎯
Quick Check
Test your grip on thresholds.
Recap
Tune the threshold on validation data, prefer precision, recall, or F1 over accuracy, and trust the PR curve on skew. ✅
常见问题解答
「选择阈值与指标」课时是免费的吗?
是的 — 「选择阈值与指标」的完整文本可在网页上免费阅读。要进行交互式练习(内置代码编辑器和全天候 AI 导师)并解锁 NLP Academy 课程的其余内容,请升级到 CoddyKit PRO。 NLP Academy 课程共包含 4 节课。
「选择阈值与指标」这节课中我会学到什么?
针对您关心的类别进行优化 你通过在浏览器中直接运行的动手代码来练习 NLP Academy,全天候 AI 导师会在你学习这节课的过程中回答你的问题。
学习 NLP Academy 需要有经验吗?
无需任何先前经验。CoddyKit 上的 NLP Academy 课程适合初学者到高级学习者,你可以从这里开始或从头开始,按照自己的节奏学习。 这是第 3 节课,共 4 节。
「选择阈值与指标」课时需要多长时间?
大多数 CoddyKit 课程大约需要 5–10 分钟。每节课都很精短且互动,所以你能稳步进步,并在网页和应用中从离开的地方继续。
我能在这节 NLP Academy 课中编写并运行代码吗?
能。每节 NLP Academy 课都包含内置代码编辑器,你可以在浏览器中直接编写并运行真实代码,并获得即时 AI 反馈 — 无需本地设置。