Build, evaluate, and refine your prompts with AI. Latitude is the open-source prompt engineering platform to ship LLM features with confidence.
Replies
Best
@heycesr I'm curious, how do you handle batch evaluations that run into the hundreds of test cases? Do you have built in throttling/delay when running in batch? We find that we typically run into rate limits when evaluating prompts on large datasets,
Replies