#17 Site specific path allowlist : utilities/file_location_listing#17

- By BTasker Projects - projects.bentasker.co.uk


utilities/file_location_listing#17 I have some domains where I only want to crawl a specific prefix. The old crawler allowed that prefix to be included in the site list: ``` http://example.invalid/foo/ ``` however it made the sitelist a bit clunky. Ins ...


Find BTasker Projects - projects.bentasker.co.uk tor links on the darkweb, see BTasker Projects - projects.bentasker.co.uk onion mirrors below

You are on the clearnet. It is not recommended to view our site here. Tor is the uncensored internet. Install Tor Browser to explore it. Set JustDirs5iebdkegiwbp3k6vwgwyr5mce7pztld23hlluy22ox4r3iad.onion as your home page to save time.