Understand it before memorizing it.
Repeatedly transform features into representations that make the target easier to separate.
Where this model earns its place
General nonlinear mapping
Start with a simpler baseline then compare this model using the same evaluation split and operational constraints.
Dense feature learning
Start with a simpler baseline then compare this model using the same evaluation split and operational constraints.
Neural baseline
Start with a simpler baseline then compare this model using the same evaluation split and operational constraints.
Trade-offs matter more than popularity.
Strengths
✓ Flexible
✓ Differentiable end-to-end
Limitations
△ Needs tuning/data
△ Less interpretable
Metrics to watch
Before it reaches real users
- 01
Normalize inputs
Document the assumption and instrument the condition so regressions can be detected.
- 02
Regularize
Document the assumption and instrument the condition so regressions can be detected.
- 03
Monitor confidence
Document the assumption and instrument the condition so regressions can be detected.