Get url from image tag

[uit2712]

Problem Description

Hello, thank you for your efforts.
I want to get url from image tag, but I see that this feature doesn't exists.

Proposed Solution

I'm very glad if you can support this feature as soon as possible.

Alternatives

Additional Context

Thank you so much.

[seanstory]

Hi @uit2712, thanks for filing.

This would be a useful feature, indeed. It's probably bigger than just grabbing src from an img tag though. Right now, our Extraction Rules only allow you to get the text content of fields by a selector, but not arbitrary attributes of arbitrary elements.

We may add this capability one day. But in the mean time, I'd suggest using the full-html extraction feature:

crawler/config/crawler.yml.example

Lines 82 to 84 in 8b63c7b

	## Whether or not to include the full HTML in the crawl result Enabling full HTML extraction can
	## dramatically increase the index size if the site being crawled is large. Defaults to false.
	#full_html_extraction_enabled: false

coupled with an ingest pipeline that can find the image tag you care about, and extract the URL that way. Here's an example from a personal project of mine:

https://github.com/seanstory/nethys-search-ui/blob/671b0649852d90322759b18c24e79c4a9fedc0ac/script/fixtures/pipeline.json#L72-L90

[uit2712]

Hi @seanstory ,
Thank you, I think full-html extraction is best choice now.