Glossary

Model routing

Sending easy requests to a small, cheap model and hard ones to a stronger one. It saves cost when most requests stay on the small model; check quality per query type.

Where it is explained

See also

Terms explained in the same lessons.

All terms, A to Z