IntermediateIndustry & Business
AI observability
AI observability means recording what an AI system does in daily use, such as questions, answers, costs and response times, so you notice when it goes wrong.
Glossary of AI concepts, explained simply
4 concepts
IntermediateAI observability means recording what an AI system does in daily use, such as questions, answers, costs and response times, so you notice when it goes wrong.
IntermediateMulti-tenancy means one AI service runs many customers on shared servers and models, while each customer's data, settings and usage stay separate.
IntermediatePrompt caching lets an AI provider reuse the part of your request that stays the same, such as long instructions, so repeat requests cost less and answer faster.
BeginnerToken economics is how AI providers bill for language models: you pay per token of text sent and received, so the length of a task and the model set its price.