sqlspider基于python开发,支持通过写sql的方式实现分布式爬虫。 demo: https://github.com/lqkweb/sqlflow SQL-spider based on python development, support through the way of writing SQL realize distributed crawler.