Assignment 2: Profiling and costing your engine

We want to think about the performance of AH engines in multiple dimensions:

• Tokens p/s.
• Context window.
• Cost in $ to run per 1M tokens (or p/h).
• Capabilities of models avaiable (quanta, benchmarks, etc).