Skip to content

Commit

Permalink
docs: update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
shengchenyang committed Jan 30, 2024
1 parent 01e499c commit 21af677
Show file tree
Hide file tree
Showing 2 changed files with 10 additions and 2 deletions.
6 changes: 5 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -132,7 +132,10 @@ scrapy crawl <spider_name>

+ 18).demo_mq: 数据存入 rabbitmq 的模板示例
+ 19).demo_kafka: 数据存入 kafka 的模板示例
+ 20).demo_file: 下载图片等文件到本地的模板示例
+ 20).demo_file: 使用本库 pipeline 下载图片等文件到本地的示例
+ 30).demo_file_sec: 自行实现的图片下载示例
+ 31).demo_oss: 使用本库 pipeline 上传到 oss 的示例
+ 32).demo_oss_sec: 自行是实现的 oss 上传示例
```

## 跑通测试
Expand Down Expand Up @@ -192,6 +195,7 @@ scrapy crawl <spider_name>
- [x] `PostgreSQL` 存储场景适配
- [x] `ElasticSearch` 存储场景适配
- [x] `Oracle` 存储场景适配
- [x] `oss` 上传场景适配
- [x] `asyncio` 语法支持与 `async` 第三方库支持示例
- [x] `spider` 中使用 `asyncio``aiohttp` 示例
- [x] `pipeline` 中使用 `asyncio``aioMysql` 示例
Expand Down
6 changes: 5 additions & 1 deletion README_en.md
Original file line number Diff line number Diff line change
Expand Up @@ -137,7 +137,10 @@ Scenario of storing data in Oracle(need to install ayugespidertools[database]):

+ 18).demo_mq: Template example of storing data in RabbitMQ.
+ 19).demo_kafka: Template example of storing data in Kafka.
+ 20).demo_file: Template example of downloading images and other files to the local machine.
+ 20).demo_file: Example of using this library pipeline to download images and other files to local.
+ 30).demo_file_sec: Self-implemented image download example.
+ 31).demo_oss: Example of using this library pipeline to upload to oss.
+ 32).demo_oss_sec: Self-implemented oss upload example.
```

## Run Through The Test
Expand Down Expand Up @@ -207,6 +210,7 @@ functionality of Scrapy.**
- [x] Adaptation for scenarios where storage is done in PostgreSQL.
- [x] Adaptation for scenarios where storage is done in ElasticSearch.
- [x] Adaptation for scenarios where storage is done in Oracle.
- [x] oss uploads scene adaptation.
- [x] Examples of asyncio syntax support and third-party library support for async:
- [x] Example of using asyncio and aiohttp in a spider script.
- [x] Example of using asyncio and aioMysql in a pipeline script.
Expand Down

0 comments on commit 21af677

Please sign in to comment.