Modeling LLM tactics

Created: 15 March 2024
Created: 15 Mar 2024
Last updated: 23 March 2024
Last updated: 23 Mar 2024
🌱 Seedling
1 min read

As an example of good prompt-engineering for modeling:

  • Avoid Data Leakage
  • Avoid Central Tendency Bias (Regression to the mean)
  • Use strict in sample and out of sample methods
  • Avoid overfitting?
  • Incorporate backtesting?

Avoiding Central Tendency Bias:

  • Score-range specific features
  • Non-centered parameterization
  • Changed how team offense and defense parameters were modeled in the hierarchical structure
  • Wider prior distributions

One thing that I’m trying to think through a bit more is how to keep things on track. I’ll have a PRD in place, and then things will go off the rails a bit. Maybe a cursor rule?