fatindeed/semi-data-crawler repository overview

⁠半导体数据爬虫

⁠用法

Run docker stack deploy -c stack.yml mysql (or docker-compose -f stack.yml up), wait for it to initialize completely, and visit http://swarm-ip:8080, http://localhost:8080, or http://host-ip:8080 (as appropriate).

php run.php [options...] sub-command [args...] [--] [params]

Options:
  -f, --fresh      Fresh start with new database
  -h, --help       This help

  args...          Arguments passed to script

  params...        Parameters passed to script. Use -- when first parameter

⁠示例

1. Init all categories.

   php run.php initAllCategory
   

   Copy

2. Init all products with given manufacturer.

   php run.php initProductByManu infineon-technologies-ag
   

   Copy

3. Init all products with given manufacturer and product line.

   php run.php initProductByManuPL infineon-technologies-ag "IGBT Chip"
   

   Copy

4. Fresh start with new database and only init 10 rows.

   php run.php -f initProductByManu infineon-technologies-ag -- limit=10
   

   Copy

5. Fresh start with new database and only init 10 rows.

   php run.php initProductByPL "IGBT Chip" -- limit=10
   

   Copy

6. Dump json file for Tencent Cloud.

   php run.php dumpTxCloudJson
   

   Copy

⁠参考文档

• SQLite Tutorial⁠
• Datatypes In SQLite3⁠
• SQL As Understood By SQLite⁠