任务描述
暂无
需求描述

需求背景:ERP创建采集任务计划,通过API把采集任务计划同步给紫鸟,紫鸟按照采集任务计划在指定时间采集指定店铺指定业务时间的单据的数据,采集完成后ERP通过API对接数据回来存储


需求内容:

一、创建采集计划同步采集计划给紫鸟,让紫鸟执行采集计划

二、获取采集计划结果,获取采集的数据

三、文件放置:

       1) 同平台同单据放到一个文件夹,不同单据放到不同文件夹

       2)文件命名:来源渠道名称 + 业务日期范围 +采集日期



需要采集的单据:


数据采集的对接流程(附件有API文档):

验收标准
暂无
附件
历史记录  
  1. 2022-08-05 17:22:37, 由 许瑞丰 创建。
  2. 2022-08-08 11:50:07, 由 zhubin 添加备注。

    紫鸟采集表设计:

    --紫鸟采集:RPA列表
    select * from RB_ZiNiao_RPAList
    IF OBJECT_ID('RB_ZiNiao_RPAList') IS NULL 
    Begin
      CREATE TABLE RB_ZiNiao_RPAList
      (
      Id INT PRIMARY KEY IDENTITY(1,1) not NULL,
      rpaScriptId nvarchar(500) not null,
      rpaName nvarchar(500) not null,
      platformId nvarchar(500) not null,
      price decimal(18,2) not null,
      priceUnit nvarchar(500) not null,
      description text,
      runWith text,
      status int,
      addTime [DATETIME] NOT NULL default(getdate())
      )
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'紫鸟采集:RPA列表' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_RPAList'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'主键' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_RPAList', @level2type=N'COLUMN',@level2name=N'Id'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'RPA唯一标识' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_RPAList', @level2type=N'COLUMN',@level2name=N'rpaScriptId'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'RPA名称' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_RPAList', @level2type=N'COLUMN',@level2name=N'rpaName'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'RPA价格' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_RPAList', @level2type=N'COLUMN',@level2name=N'price'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'RPA收费单位' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_RPAList', @level2type=N'COLUMN',@level2name=N'priceUnit'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'RPA描述' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_RPAList', @level2type=N'COLUMN',@level2name=N'description'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'runWithJson' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_RPAList', @level2type=N'COLUMN',@level2name=N'runWith'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'AddTime' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_RPAList', @level2type=N'COLUMN',@level2name=N'addTime'
    End  

    --紫鸟采集:店铺授权表
    IF OBJECT_ID('RB_ZiNiao_ShopAuthorizations') IS NULL 
    Begin
      CREATE TABLE RB_ZiNiao_ShopAuthorizations
      (
      Id INT PRIMARY KEY IDENTITY(1,1) NOT NULL,
      sellerId nvarchar(500) not null,
      storeId nvarchar(500) not null,
      auth nvarchar(500) not null,
      AddTime [DATETIME] NOT NULL default(getdate()),
      UpdateTime [DATETIME],
      )
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'紫鸟采集:店铺授权表' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorizations'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'主键' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorizations', @level2type=N'COLUMN',@level2name=N'Id'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'需要授权的卖家ID' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorizations', @level2type=N'COLUMN',@level2name=N'sellerId'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'紫鸟店铺id' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorizations', @level2type=N'COLUMN',@level2name=N'storeId'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'授权状态' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorizations', @level2type=N'COLUMN',@level2name=N'auth'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'AddTime' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorizations', @level2type=N'COLUMN',@level2name=N'AddTime'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'UpdateTime' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorizations', @level2type=N'COLUMN',@level2name=N'UpdateTime'
    End

    --紫鸟采集:店铺授权信息rpa关联表
    IF OBJECT_ID('RB_ZiNiao_ShopAuthorToRpas') IS NULL 
    Begin
      CREATE TABLE RB_ZiNiao_ShopAuthorToRpas
      (
      Id INT PRIMARY KEY IDENTITY(1,1) NOT NULL,
      sellerId nvarchar(500) not null,
      rpaId nvarchar(500) not null,
      auth nvarchar(500) not null,
      msg text not null,
      AddTime [DATETIME] NOT NULL default(getdate()),
      UpdateTime [DATETIME],
      )
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'紫鸟采集:店铺授权信息rpa关联表' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorToRpas'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'主键' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorToRpas', @level2type=N'COLUMN',@level2name=N'Id'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'授权的卖家ID' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorToRpas', @level2type=N'COLUMN',@level2name=N'sellerId'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'rpaId' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorToRpas', @level2type=N'COLUMN',@level2name=N'rpaId'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'授权状态' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorToRpas', @level2type=N'COLUMN',@level2name=N'auth'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'被授权的rpa列表' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorToRpas', @level2type=N'COLUMN',@level2name=N'rpaList'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'AddTime' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorToRpas', @level2type=N'COLUMN',@level2name=N'AddTime'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'UpdateTime' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_ShopAuthorToRpas', @level2type=N'COLUMN',@level2name=N'UpdateTime'
    End

    --紫鸟采集:采集计划表
    IF OBJECT_ID('RB_ZiNiao_PlanList') IS NULL 
    Begin
      CREATE TABLE RB_ZiNiao_PlanList
      (
      Id INT PRIMARY KEY IDENTITY(1,1) not NULL,
      name nvarchar(500) not null,
      platformId nvarchar(500) not null,
      actionType nvarchar(500) not null,
      storeScopeType nvarchar(500) not null,
      scriptList text not null,
      assignTime [DATETIME],
      planId nvarchar(500),
      repeatFrom int,
      repeatRange nvarchar(500),
      repeatTimeAt nvarchar(500),
      scriptId nvarchar(500),
      storeAndMarketPlaceList text,
      storeIds nvarchar(500),
      sellerIds nvarchar(500),
      marketPlace nvarchar(500),
      validFrom [DATETIME],
      validTo [DATETIME],
      extInfo text,
      AddTime [DATETIME] NOT NULL default(getdate()),
      )
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'紫鸟采集:采集计划表' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_PlanList'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'主键' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_PlanList', @level2type=N'COLUMN',@level2name=N'Id'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'计划名称' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_PlanList', @level2type=N'COLUMN',@level2name=N'name'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'计划id' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_PlanList', @level2type=N'COLUMN',@level2name=N'planId'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'平台id' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_PlanList', @level2type=N'COLUMN',@level2name=N'platformId'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'执行类型' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_PlanList', @level2type=N'COLUMN',@level2name=N'actionType'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'指定运行时间' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_PlanList', @level2type=N'COLUMN',@level2name=N'assignTime'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'RPA列表' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_PlanList', @level2type=N'COLUMN',@level2name=N'scriptList'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'扩展参数:计划是否变动这些配置' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_PlanList', @level2type=N'COLUMN',@level2name=N'extInfo'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'AddTime' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_PlanList', @level2type=N'COLUMN',@level2name=N'AddTime'
    End  

    --紫鸟采集:任务记录表
    IF OBJECT_ID('RB_ZiNiao_TaskList') IS NULL 
    Begin
      CREATE TABLE RB_ZiNiao_TaskList
      (
      Id INT PRIMARY KEY IDENTITY(1,1) NOT NULL,
      planId nvarchar(500),
      taskRecordId nvarchar(500),
      taskId nvarchar(500),
      sellerId nvarchar(500),
      siteName nvarchar(500),
      siteCode nvarchar(500),
      rpaId nvarchar(500),
      taskStartTime nvarchar(500),
      taskEndTime nvarchar(500),
      taskResultType text,
      errorCode text,
      errorMsg text,
      downloadUrl text,
      url text,
      AddTime [DATETIME] NOT NULL default(getdate()),
      )
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'紫鸟采集:任务记录表' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_TaskList'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'主键' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_TaskList', @level2type=N'COLUMN',@level2name=N'Id'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'计划Id' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_TaskList', @level2type=N'COLUMN',@level2name=N'planId'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'任务执行记录id' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_TaskList', @level2type=N'COLUMN',@level2name=N'taskRecordId'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'任务id' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_TaskList', @level2type=N'COLUMN',@level2name=N'taskId'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'卖家标识' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_TaskList', @level2type=N'COLUMN',@level2name=N'sellerId'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'记录类型' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_TaskList', @level2type=N'COLUMN',@level2name=N'taskResultType'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'下载地址' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_TaskList', @level2type=N'COLUMN',@level2name=N'downloadUrl'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'文件地址' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_TaskList', @level2type=N'COLUMN',@level2name=N'url'
      EXEC sys.sp_addextendedproperty @name=N'MS_Description', @value=N'AddTime' , @level0type=N'SCHEMA',@level0name=N'dbo', @level1type=N'TABLE',@level1name=N'RB_ZiNiao_TaskList', @level2type=N'COLUMN',@level2name=N'AddTime'
    End

  3. 2022-08-08 11:51:43, 由 zhubin 添加备注。

    RAP列表从接口同步到我们的库

  4. 2022-08-08 11:53:31, 由 zhubin 添加备注。

    设置一个采集计划demo:

    INSERT INTO RB_ZiNiao_PlanList (name, platformId, actionType, storeScopeType, scriptList) VALUES('单元测试-提交计划并创建任务', '0', 'AT_ONCE', 'ALL', '[{"scriptId":"1000","runWith":[{"name":"daterange","value":"yesterday"}]}]');

    接口返回成功更新:

  5. 2022-08-08 11:54:31, 由 zhubin 添加备注。

    采集下来后文件下载目录

  6. 2022-08-08 11:57:08, 由 zhubin 添加备注。

    部分代码实现如下:


  7. 2022-08-08 11:58:10, 由 zhubin 添加备注。

    单元测试:

  8. 2022-08-08 12:00:21, 由 zhubin 编辑。
    上传了附件 DownloadFiles.7z
  9. 2022-08-08 14:31:29, 由 zhubin 添加备注。

    参考API文档:

    https://rpasupport.ziniao.com/cc8e/4bc8/e637

  10. 2022-08-09 09:16:46, 由 zhubin 添加备注。

    上线注意事项:需要账号管理员在后台添加服务器的白名单IP地址;


    设置一个采集计划demo:

    INSERT INTO RB_ZiNiao_PlanList (name, platformId, actionType, storeScopeType, scriptList) VALUES('单元测试-提交计划并创建任务', '0', 'AT_ONCE', 'ALL', '[{"scriptId":"1000","runWith":[{"name":"daterange","value":"yesterday"}]}]');


    配置采集计划 actionType字段

    立即执行:AT_ONCE
    指定时间执行:ASSIGN_TIME
    按小时执行:REPEAT_BY_HOUR
    按天执行:REPEAT_BY_DAY
    按周执行:REPEAT_BY_WEEK
    按月执行:REPEAT_BY_MONTH



  11. 2022-08-10 11:02:10, 由 zhubin 完成。
    修改了 总计消耗,旧值为 "0",新值为 "56"。
    修改了 指派给 ,旧值为 "zhubin",新值为 "xuruifeng"。
    修改了 实际完成,旧值为 "",新值为 "2022-08-10 11:02:02"。
    修改了 任务状态,旧值为 "wait",新值为 "done"。
    修改了 实际开始,旧值为 "0000-00-00 00:00:00",新值为 "2022-08-10 11:02:10"。
    修改了 预计剩余,旧值为 "56",新值为 "0"。
    修改了 由谁完成,旧值为 "",新值为 "zhubin"。
  12. 2022-08-15 18:07:19, 由 zhubin 指派给 林鸿贵。
    修改了 指派给,旧值为 "xuruifeng",新值为 "linhonggui"。
    提测
  13. 2022-08-16 15:50:56, 由 zhubin 添加备注。
    https://rpasupport.ziniao.com/cc8e/4bc8/e637 创建任务可以看看这个文档
  14. 2022-08-17 15:49:01, 由 林鸿贵 关闭。
    修改了 任务状态,旧值为 "done",新值为 "closed"。
    修改了 指派给 ,旧值为 "linhonggui",新值为 "closed"。
    修改了 由谁关闭,旧值为 "",新值为 "linhonggui"。
    修改了 关闭时间,旧值为 "0000-00-00 00:00:00",新值为 "2022-08-17 15:49:01"。
    修改了 关闭原因,旧值为 "",新值为 "done"。
所属迭代 平台财务数据自动化获取(接口/小工具)
所属模块 /
相关需求 超级浏览器RPA数据采集API对接
指派给 Closed 于 2022-08-17 15:49:01
任务类型 后端
任务标签 初始
开发组
任务状态 已关闭
进度 100%
优先级 P2
关键词
抄送给
由谁创建 许瑞丰 于 2022-08-05 17:22:37
由谁完成 zhubin 于 2022-08-10 11:02:02
由谁取消 暂无
由谁关闭 林鸿贵 于 2022-08-17 15:49:01
关闭原因 已完成
最后编辑 林鸿贵 于 2022-08-17 15:49:01
团队 最初预计 总计消耗 预计剩余
工时信息
最初预计 56工时
总计消耗 56工时
预计剩余 0工时
预计开始 2022-07-30
实际开始 2022-08-10
截止日期 2022-08-09