Before you start
You need access to Knowledge > Sources and a public documentation site that exposes anllms.txt index and Markdown pages. Password-protected documentation is not supported.
Connect your documentation
1
Create a source
Go to Knowledge > Sources, click Create New Source, enter a name, and select
fern as the Source Type.2
Enter the documentation URL
Enter the site URL in Documentation URL, for example
https://docs.example.com.To import just one section, enter its section URL, provided it has an llms.txt index. Use the site URL rather than an individual article such as /docs/getting-started.3
Choose the pages to include
Leave both pattern lists empty to import every page listed in the index, including nested indexes. Otherwise, add the path patterns you want to include or exclude.
4
Save and sync
Click Save, then open the source and click Sync Source. Follow progress in Knowledge > Sync history.
Filter pages
Patterns match the full URL path, starting with/, without the .md extension. * matches any sequence of characters. Exclusions take precedence over inclusions.
Pages keep their titles and links to the original website. They appear as a flat list in index discovery order; Fern’s sidebar hierarchy is not reproduced.
AGO removes recognized default Fern instructions about Markdown exports, the documentation index, and MCP setup when they appear at the very beginning of a page. Customized wording or unsupported formatting may remain. The same text inside the page body or a code example is preserved.
Later successful syncs update existing pages and remove pages no longer listed or included by your filters. Manual content overrides are preserved. If a fetch fails or no pages match, the sync fails without removing old documents; pages updated before the failure remain updated.
Troubleshooting
- No pages found: Check the site or section URL and your filters. Open its
/llms.txtURL to confirm it lists documentation pages. - HTML instead of Markdown: Check that the site is public and the page’s
.mdURL returns content rather than a sign-in screen. - Redirect outside the site: Enter the final documentation site URL. Imports stay on the configured scheme, host, and section path.
- Large imports: Narrow the URL or use include patterns. Each response is limited to 10 MB, and discovery supports up to 1,000 indexes and 20,000 selected pages. Linked OpenAPI files and other downloads are excluded.
Related
- Knowledge Connectors: all connectors
- Knowledge Source Management: managing sources
