Overview
The Websites and File Uploads section is used to manage all training data uploaded to the Retrieval-Augmented Generation (RAG) system. This area allows administrators to upload files, import URLs, and monitor indexing status for AI training items.
The system supports multiple types of training sources including all types of public posts from local as well as external WordPress websites, files, URLs.
Anyone who has capability ‘Manage AI Training’ can:
- Add new training items
- Upload PDF and TXT files
- Train AI using URLs
- Monitor indexing status
- Delete training data from the AI provider and database
Each training item is processed and indexed into the RAG system for AI retrieval and response generation.
Where to Find
How It Works
When a new training item is added:
- The item is queued for processing.
- The training data starts uploading to the RAG system using a cron event.
- The system processes each item one by one.
- After successful indexing, the status changes to Indexed. (You can only see the list of files and URLs in File Uploads section)
- If processing fails, the status changes to Failed and the system tires onces if failed again then automatically removes the failed training data.
Training data can originate from:
- Uploaded files
- URLs (All published post types from local and and external WordPress websites)
Supported Training Sources
The AI Training system supports the following sources:
- File: Upload TXT or PDF files
- URL: Train AI using website content
- Published post types: From local and external websites
Â
Add New Website training data
- Navigate to: Support → Settings → AI Assistant → Websites
- Click the Add New button at the top of the page.
- Enter desired name
- Enter WordPress API endpoint. Which is wordpress site URL only. (Example: https://example.com)
- Click on Get Post Types to get all available published post types from website.
- Select the post type you want to upload. All posts of selected post type will be uploaded. (You can see the total uploaded records, total indexed records and total records in queue)
- You can sync or resync posts when you update or add or delete a post.
- If updated, only updated post will be synced to RAG.
- If added only added post will be added to RAG.
- If deleted, only deleted post will be removed from RAG.
- Â Deleting all Posts will delete all the posts related to selected post type above.
Add New File Upload Training data
- Navigate to: Support → Settings → File Uploads
- Click the Add New button at the top of the page.
- Select your desired file type from PDF/Text file or URL
- You can upload multiple files (pdf or txt with max size of 10 MB each) or multiple URLs of desired page you want to upload.
- Click on Submit to start the files to uploading to RAG.
Training Status Types
- New: The training item has been added and is waiting for processing or indexing.
- Processing: The training item started to upload to selected provider.
- Indexed: The training data has been successfully uploaded and indexed into the RAG system.
- Failed: The training process failed or error occurred while uploading to AI provider.
- Deleted: The training process failed will be deleted by cron event.
Â
Bulk Actions
Bulk actions allow administrators to manage multiple training items at once.
- Bulk Delete: Delete multiple AI training items in a single action.
Â
Notes / Tips
- Large datasets may take time to process and index.
- Failed training items are automatically cleaned up by the system after trying once to upload again.
- Review training status regularly to ensure successful indexing.
- Deleting a training item permanently removes it from the RAG system and database.