you successfully crawled the directory /screaming-frog-test . maybe you should optimize your robots.txt