Installation
This guide covers how to upload your generated AI-readable files to your web server, regardless of platform. If you're specifically on WordPress, the WordPress Setup guide is faster and more specific.
Where Each File Belongs
AIA Matrix generates files that need to live in specific locations on your server. Root-level files must sit at your domain's top level — not inside a subfolder.
yourdomain.com/
├── robots.txt ← root
├── llms.txt ← root
├── llms-full.txt ← root
├── semantic/
│ ├── index.json
│ ├── about.json
│ ├── services.json
│ └── ...
└── markdown/
├── index.html ← human-friendly directory page
├── index.md
├── about.md
├── services.md
└── ...Why root matters: AI crawlers and standards like the proposed llms.txt specification expect these files at the domain root (e.g., https://yourdomain.com/llms.txt), the same way robots.txt and sitemap.xml already work. A file placed in a subfolder won't be discovered automatically.
Method 1 — FTP / SFTP (Most Hosting Providers)
- Open your FTP client (FileZilla, Cyberduck, or similar) or use the File Manager in your hosting control panel (cPanel, Plesk)
- Connect to your server using credentials from your host
- Navigate to your site's root directory — usually
public_html,www, orhtdocs - Upload
robots.txt,llms.txt, andllms-full.txtdirectly into this root folder- If a
robots.txtalready exists, see Merging robots.txt below — don't simply overwrite it
- If a
- Create two new folders if they don't exist:
semanticandmarkdown - Upload the corresponding files into each folder
Method 2 — Hosting File Manager (No FTP Client Needed)
Most hosts (Bluehost, SiteGround, GoDaddy, HostGator) provide a browser-based File Manager:
- Log in to your hosting control panel
- Open File Manager
- Navigate to your site's root folder
- Use Upload to add the root files, and New Folder to create
semantic/andmarkdown/, then upload files into each
Method 3 — Git / Static Site Deployment
If your site is built with a static site generator (Next.js, Hugo, Jekyll, Astro) or deployed via Git (Vercel, Netlify, GitHub Pages):
- Place root-level files (
robots.txt,llms.txt,llms-full.txt) in your project'spublic/orstatic/directory — this is the folder your framework copies directly to the site root on build - Place
semantic/andmarkdown/folders inside that samepublic//static/directory - Commit and push — your next deployment will include the new files automatically
Merging an Existing robots.txt
Most sites already have a robots.txt. Don't replace it wholesale — merge the AI Discovery Layer into it instead.
- Open your current
robots.txt - Add the AI crawler
User-agentblocks andContent-Signaldirectives from your AIA Matrix download underneath your existing rules - Add your
llms.txt,llms-full.txt,semantic/index.json, andmarkdown/index.mdURLs to theSitemap:declarations at the bottom
See robots.txt for the full directive reference.
Fixing the "403 Forbidden" Directory Error
If visiting yourdomain.com/markdown/ or yourdomain.com/semantic/ directly in a browser returns a 403 error, this is expected — most servers block directory listings by default for security. Your individual files (e.g., /markdown/about.md) will still work correctly.
To make the directory itself browsable and presentable, place an index.html file inside that folder. AIA Matrix's Professional plan auto-generates this for you; see your download package for markdown/index.html.
Verifying the Upload
Once uploaded, check each file loads correctly by visiting it directly in your browser:
https://yourdomain.com/robots.txt
https://yourdomain.com/llms.txt
https://yourdomain.com/llms-full.txt
https://yourdomain.com/semantic/index.json
https://yourdomain.com/markdown/index.mdEach should display as plain text or JSON — not a 404 or 403 error.
For deeper validation (Google indexing, AI crawler access, Content Signals), see Validation.
Common Issues
| Problem | Likely Cause | Fix |
|---|---|---|
404 on /llms.txt | File uploaded to wrong directory | Confirm it's in the site root, not a subfolder |
403 on /markdown/ | Directory listing disabled (normal) | Add index.html, link directly to individual files instead |
| robots.txt overwritten old rules | Existing file replaced instead of merged | Restore from backup, merge manually |
| Files upload but show as download prompt instead of text | Missing or incorrect MIME type configuration | Contact your host about .txt/.json/.md MIME type handling |
For anything not covered here, see Troubleshooting.