Skip to content
Closed
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions docs/md_v2/core/browser-crawler-config.md
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@ class BrowserConfig:
...
```

### Key Fields to Note
### Key Fields to Note {: #browser-config-key-fields }

1.⠀**`browser_type`**
- Options: `"chromium"`, `"firefox"`, or `"webkit"`.
Expand Down Expand Up @@ -127,7 +127,7 @@ class BrowserConfig:
- Modifies browser fingerprints to avoid basic bot detection.
- Default is `False`. Recommended for sites with bot protection.

### Helper Methods
### Helper Methods {: #browser-config-helper-methods }

Both configuration classes provide a `clone()` method to create modified copies:

Expand Down Expand Up @@ -238,7 +238,7 @@ class CrawlerRunConfig:
...
```

### Key Fields to Note
### Key Fields to Note {: #crawler-config-key-fields }

1.⠀**`word_count_threshold`**:
- The minimum word count before a block is considered.
Expand Down Expand Up @@ -315,7 +315,7 @@ class CrawlerRunConfig:
- Allows handling results incrementally instead of waiting for all URLs to finish.


### Helper Methods
### Helper Methods {: #crawler-config-helper-methods}

The `clone()` method is particularly useful for creating variations of your crawler configuration:

Expand Down Expand Up @@ -350,7 +350,7 @@ The `clone()` method:

## 3. LLMConfig Essentials

### Key fields to note
### Key fields to note {: #llm-config-key-fields }

1.⠀**`provider`**:
- Which LLM provider to use.
Expand Down