You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: pkg/cmd/web.go
+3-2Lines changed: 3 additions & 2 deletions
Original file line number
Diff line number
Diff line change
@@ -557,7 +557,7 @@ var webWebCrawlMd = requestflag.WithInnerFlags(cli.Command{
557
557
},
558
558
&requestflag.Flag[string]{
559
559
Name: "url-regex",
560
-
Usage: "Regex pattern. Only URLs matching this pattern will be followed and scraped.",
560
+
Usage: "Regex pattern. Only URLs matching this pattern will be followed and scraped. An automatic prefix scope in the form ^<starting URL> follows a redirect of the starting page.",
561
561
BodyPath: "urlRegex",
562
562
},
563
563
&requestflag.Flag[bool]{
@@ -568,7 +568,8 @@ var webWebCrawlMd = requestflag.WithInnerFlags(cli.Command{
568
568
},
569
569
&requestflag.Flag[int64]{
570
570
Name: "wait-for-ms",
571
-
Usage: "Optional browser wait time in milliseconds after initial page load for each crawled page. Min: 0. Max: 30000 (30 seconds). ",
571
+
Usage: "Browser wait time in milliseconds after initial page load for each crawled page. Defaults to 3500 (3.5 seconds). Min: 0. Max: 30000 (30 seconds).",
0 commit comments