استراتيجيات التقطيع

في هذا الدرس

split documents into chunks that retrieve well.

الموضوعات المخطط لها

• Chunk: the unit you embed and retrieve. Too large drowns the answer and wastes tokens; too small loses context.
• Start with structure: split by headings and paragraphs, then by size (a few hundred tokens is a common start; tune by measurement).
• Overlap a little so a sentence at a boundary is not cut off.
• Metadata per chunk: article id, title, section, language, product, audience, updated time.
• Keep the article id so one article can be re-indexed alone.