WithoutPants
7158e83b75
Add JSON scrape support ( #717 )
...
* Add support for scene fragment scrape in xpath
2020-08-10 14:21:50 +10:00
bnkai
4373f9bf01
Add cdp support for xpath scrapers ( #625 )
...
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com >
2020-08-04 10:42:40 +10:00
WithoutPants
2b9215702e
Refactor xpath scraper code. Add fixed and map ( #616 )
...
* Refactor xpath scraper code
* Make post-process a list
* Add map post-process action
* Add fixed xpath values
* Refactor scrapers into cache
* Refactor into mapped config
* Trim test html
2020-07-21 14:06:25 +10:00
WithoutPants
215c4e3bde
Change builtin freeones scraper to community yml ( #542 )
2020-05-15 20:10:20 +10:00
WithoutPants
abf2b49803
Configurable scraper user agent string ( #409 )
...
* Add debug scrape option.
Co-authored-by: HiddenPants255 <>
2020-03-21 08:55:15 +11:00
WithoutPants
03c07a429d
Add Xpath post processing and performer name query ( #333 )
...
* Extend xpath configuration. Support concatenation
* Add parseDate parsing option
* Add regex replacements
* Add xpath query performer by name
* Fix loading spinner on scrape performer
* Change ReplaceAll to Replace
2020-01-31 17:17:40 -05:00
WithoutPants
7fdaccf669
Xpath scraping from URL ( #285 )
...
* Add xpath performer and scene scraping
* Add studio scraping
* Refactor code
* Fix compile error
* Don't overwrite performer URL during a scrape
2020-01-04 11:39:33 -05:00
WithoutPants
f52db4f58b
Add stash scraper type ( #269 )
...
* Add stash scraper type
* Add graphql client to vendor
* Embed stash credentials in URL
* Fill URL from scraped scene
* Nil IDs returned from remote stash
* Nil check
2019-12-20 19:13:23 -05:00
WithoutPants
92837fe1f7
Add scene metadata scraping functionality ( #236 )
...
* Add scene scraping functionality
* Adapt to changed scraper config
2019-12-15 20:35:34 -05:00
WithoutPants
50784025f2
Change scraper config to yaml ( #256 )
2019-12-12 14:27:44 -05:00
