重现步骤

[步骤]

检查智能刊登系统：

SELECT*FROM m_productcategory WHERE MarketId=45 ANd CombinationNameEn LIKE '%Animal%'

如下图所示，一级类目：Animal 存在重复的数据（分类ID不同，但分类名称相同）


该数据来源于：https://developer.walmart.com/api/us/mp/items#operation/getTaxonomyResponse

[结果]


[期望]


数据去重展示，该数据会提供给到其余组，其余功能使用，需要保证数据的准确性

历史记录  
  1. 2022-12-29 14:59:48, 由 刘瀚泽 创建。
  2. 2022-12-29 15:05:07, 由 刘瀚泽 编辑。
    修改了 影响环境，旧值为 "trunk,"，新值为 "trunk"。

    沃尔玛 从平台API完整返回的数据

    {

        "status": "SUCCESS",
        "payload": [
            {
                "category": "Animal",
                "subcategory": [
                    {
                        "subCategoryName": "Animal Accessories",
                        "subCategoryId": "559c5d924fff3d64de18bf45"
                    },
                    {
                        "subCategoryName": "Animal Food",
                        "subCategoryId": "559c5d8f4fff3d64de18bf3d"
                    },
                    {
                        "subCategoryName": "Animal Health & Grooming",
                        "subCategoryId": "559c5d90ed25b136f13a05df"
                    },
                    {
                        "subCategoryName": "Animal Other",
                        "subCategoryId": "56f2eb66208f9a06158f1748"
                    }
                ]
            },
            {
                "category": "Art & Craft",
                "subcategory": [
                    {
                        "subCategoryName": "Art & Craft",
                        "subCategoryId": "571fdff7208f9a0cdb760a7f"
                    }
                ]
            },
            {
                "category": "Baby",
                "subcategory": [
                    {
                        "subCategoryName": "Baby Clothing",
                        "subCategoryId": "559cdf7e208f9a58e140ee8d"
                    },
                    {
                        "subCategoryName": "Baby Diapering, Care, & Other",
                        "subCategoryId": "56f2eb67208f9a0612c3adc1"
                    },
                    {
                        "subCategoryName": "Baby Food",
                        "subCategoryId": "559cdf83b3731f2cbd453519"
                    },
                    {
                        "subCategoryName": "Baby Furniture",
                        "subCategoryId": "559cdf7fb3731f2cbd45350d"
                    },
                    {
                        "subCategoryName": "Baby Toys",
                        "subCategoryId": "559cdf81208f9a58e140ee97"
                    },
                    {
                        "subCategoryName": "Baby Transport",
                        "subCategoryId": "559cdf84b3731f2cbd453527"
                    }
                ]
            },
            {
                "category": "Carriers & Accessories",
                "subcategory": [
                    {
                        "subCategoryName": "Carriers & Accessories",
                        "subCategoryId": "56f2eb67208f9a060e22729b"
                    },
                    {
                        "subCategoryName": "Cases & Bags",
                        "subCategoryId": "559ce14f4fff3d64de18c531"
                    }
                ]
            },
            {
                "category": "Cleaning, Safety, & Other",
                "subcategory": [
                    {
                        "subCategoryName": "Fuels & Lubricants",
                        "subCategoryId": "56141817208f9a1067071b12"
                    },
                    {
                        "subCategoryName": "Gift Cards",
                        "subCategoryId": "56141786208f9a1067071b0e"
                    },
                    {
                        "subCategoryName": "Household & Industrial Cleaning & Chemical",
                        "subCategoryId": "559c5cc7b3731f2cbd452dc7"
                    },
                    {
                        "subCategoryName": "Other",
                        "subCategoryId": "56f2eb68208f9a061131b333"
                    },
                    {
                        "subCategoryName": "Safety & Emergency",
                        "subCategoryId": "56141681b3731f1265b33e8a"
                    },
                    {
                        "subCategoryName": "Storage",
                        "subCategoryId": "559c5cc8208f9a58e140e71e"
                    }
                ]
            },
            {
                "category": "Clothing",
                "subcategory": [
                    {
                        "subCategoryName": "Clothing",
                        "subCategoryId": "56f2eb68208f9a060f0a7fcf"
                    }
                ]
            },
            {
                "category": "Electronics",
                "subcategory": [
                    {
                        "subCategoryName": "Cell Phones",
                        "subCategoryId": "555eebc1208f9a0b686460dc"
                    },
                    {
                        "subCategoryName": "Computer Components",
                        "subCategoryId": "555eebc7b3731f0eb3722a16"
                    },
                    {
                        "subCategoryName": "Computers",
                        "subCategoryId": "555eebb0b3731f0eb3722a06"
                    },
                    {
                        "subCategoryName": "Electronics Accessories",
                        "subCategoryId": "555eebd7208f9a0b686460ec"
                    },
                    {
                        "subCategoryName": "Electronics Cables",
                        "subCategoryId": "555eebd2b3731f0eb3722a1e"
                    },
                    {
                        "subCategoryName": "Electronics Other",
                        "subCategoryId": "56f2eb65208f9a06158f1740"
                    },
                    {
                        "subCategoryName": "Printers, Scanners, & Imaging",
                        "subCategoryId": "555eebcc208f9a0b686460e4"
                    },
                    {
                        "subCategoryName": "Software",
                        "subCategoryId": "555eebaa208f9a0b686460cc"
                    },
                    {
                        "subCategoryName": "TVs & Video Displays",
                        "subCategoryId": "555eebb6208f9a0b686460d4"
                    },
                    {
                        "subCategoryName": "Video Games",
                        "subCategoryId": "555eeba5b3731f0eb37229fe"
                    },
                    {
                        "subCategoryName": "Video Projectors",
                        "subCategoryId": "555eebbbb3731f0eb3722a0e"
                    }
                ]
            },
            {
                "category": "Food & Beverage",
                "subcategory": [
                    {
                        "subCategoryName": "Alcoholic Beverages",
                        "subCategoryId": "559ce04b4fff3d64de18c465"
                    },
                    {
                        "subCategoryName": "Food & Beverage",
                        "subCategoryId": "56f2eb65208f9a061131b32b"
                    }
                ]
            },
            {
                "category": "Footwear",
                "subcategory": [
                    {
                        "subCategoryName": "Footwear",
                        "subCategoryId": "56f2eb67208f9a060f0a7fc7"
                    }
                ]
            },
            {
                "category": "Furniture",
                "subcategory": [
                    {
                        "subCategoryName": "Furniture",
                        "subCategoryId": "56f2eb65208f9a060e227297"
                    }
                ]
            },
            {
                "category": "Garden & Patio",
                "subcategory": [
                    {
                        "subCategoryName": "Garden & Patio",
                        "subCategoryId": "56f2eb66208f9a06158f174c"
                    },
                    {
                        "subCategoryName": "Grills & Outdoor Cooking",
                        "subCategoryId": "559cd838b3731f2cbd453341"
                    }
                ]
            },
            {
                "category": "Health & Beauty",
                "subcategory": [
                    {
                        "subCategoryName": "Beauty, Personal Care, & Hygiene",
                        "subCategoryId": "558297d7ed25b16689e37e94"
                    },
                    {
                        "subCategoryName": "Health & Beauty Electronics",
                        "subCategoryId": "558297d84fff3d5f26910b0e"
                    },
                    {
                        "subCategoryName": "Medical Aids & Equipment",
                        "subCategoryId": "558297d64fff3d5f26910b04"
                    },
                    {
                        "subCategoryName": "Medicine & Supplements",
                        "subCategoryId": "558297d9ed25b16689e37e9a"
                    },
                    {
                        "subCategoryName": "Optical",
                        "subCategoryId": "558297da4fff3d5f26910b14"
                    }
                ]
            },
            {
                "category": "Home",
                "subcategory": [
                    {
                        "subCategoryName": "Bedding",
                        "subCategoryId": "55829ca1ed25b16689e38002"
                    },
                    {
                        "subCategoryName": "Home Decor, Kitchen, & Other",
                        "subCategoryId": "56f2eb65208f9a0612c3adbd"
                    },
                    {
                        "subCategoryName": "Large Appliances",
                        "subCategoryId": "55829ca04fff3d5f26910c9b"
                    }
                ]
            },
            {
                "category": "Jewelry",
                "subcategory": [
                    {
                        "subCategoryName": "Jewelry",
                        "subCategoryId": "56f2eb69208f9a0612c3adc5"
                    }
                ]
            },
            {
                "category": "Media",
                "subcategory": [
                    {
                        "subCategoryName": "Books & Magazines",
                        "subCategoryId": "559cdbd0b3731f2cbd453373"
                    },
                    {
                        "subCategoryName": "Movies",
                        "subCategoryId": "559cdbceb3731f2cbd453367"
                    },
                    {
                        "subCategoryName": "Music",
                        "subCategoryId": "559cdbcfb3731f2cbd45336d"
                    },
                    {
                        "subCategoryName": "TV Shows",
                        "subCategoryId": "559cdbce208f9a58e140ecc0"
                    }
                ]
            },
            {
                "category": "Musical Instrument",
                "subcategory": [
                    {
                        "subCategoryName": "Instrument Accessories",
                        "subCategoryId": "559c6534208f9a58e140e9fa"
                    },
                    {
                        "subCategoryName": "Music Cases & Bags",
                        "subCategoryId": "559c6532208f9a58e140e9f4"
                    },
                    {
                        "subCategoryName": "Musical Instruments",
                        "subCategoryId": "559c6534b3731f2cbd45309a"
                    },
                    {
                        "subCategoryName": "Sound & Recording",
                        "subCategoryId": "559c6533b3731f2cbd453092"
                    }
                ]
            },
            {
                "category": "Occasion & Seasonal",
                "subcategory": [
                    {
                        "subCategoryName": "Ceremonial Clothing & Accessories",
                        "subCategoryId": "559cd718208f9a58e140ec86"
                    },
                    {
                        "subCategoryName": "Costumes",
                        "subCategoryId": "559cd717b3731f2cbd45332b"
                    },
                    {
                        "subCategoryName": "Decorations & Favors",
                        "subCategoryId": "559cd716208f9a58e140ec82"
                    },
                    {
                        "subCategoryName": "Funeral",
                        "subCategoryId": "559cd718b3731f2cbd45332f"
                    },
                    {
                        "subCategoryName": "Gift Supply & Awards",
                        "subCategoryId": "560d6eac208f9a705c805d90"
                    }
                ]
            },
            {
                "category": "Office",
                "subcategory": [
                    {
                        "subCategoryName": "Office",
                        "subCategoryId": "571fdd3bb3731f5bec702f4c"
                    }
                ]
            },
            {
                "category": "Photography",
                "subcategory": [
                    {
                        "subCategoryName": "Cameras & Lenses",
                        "subCategoryId": "559c5748ed25b136f13a0511"
                    },
                    {
                        "subCategoryName": "Photo Accessories",
                        "subCategoryId": "559c57494fff3d64de18be5c"
                    }
                ]
            },
            {
                "category": "Sport & Recreation",
                "subcategory": [
                    {
                        "subCategoryName": "Cycling",
                        "subCategoryId": "559bb5654fff3d065ab02ddc"
                    },
                    {
                        "subCategoryName": "Optics",
                        "subCategoryId": "559bb5674fff3d065ab02de0"
                    },
                    {
                        "subCategoryName": "Sport & Recreation Other",
                        "subCategoryId": "56f2eb66208f9a0614420040"
                    },
                    {
                        "subCategoryName": "Weapons",
                        "subCategoryId": "559bb565ed25b14a8dec2020"
                    }
                ]
            },
            {
                "category": "Tools & Hardware",
                "subcategory": [
                    {
                        "subCategoryName": "Building Supply",
                        "subCategoryId": "559bb2ab208f9a756ac3ae09"
                    },
                    {
                        "subCategoryName": "Electrical",
                        "subCategoryId": "559bb2acb3731f4bb34c5e1a"
                    },
                    {
                        "subCategoryName": "Hardware",
                        "subCategoryId": "559bb2ad208f9a756ac3ae0f"
                    },
                    {
                        "subCategoryName": "Plumbing & HVAC",
                        "subCategoryId": "559bb2adb3731f4bb34c5e22"
                    },
                    {
                        "subCategoryName": "Tools",
                        "subCategoryId": "559bb2aeb3731f4bb34c5e28"
                    },
                    {
                        "subCategoryName": "Tools & Hardware Other",
                        "subCategoryId": "56f2eb66208f9a061442003c"
                    }
                ]
            },
            {
                "category": "Toys",
                
  3. 2022-12-29 16:10:21, 由 程伟 指派给 姚杰远。
    修改了 指派给，旧值为 "chengwei"，新值为 "yaojieyuan"。
  4. 2022-12-30 15:16:00, 由 姚杰远 指派给 刘瀚泽。
    修改了 指派给，旧值为 "yaojieyuan"，新值为 "liuhanze"。

    walmart分类是从ERP获取过来的，接口返回就是这种结构，服务名称SyncMarketplaceProductCategory

  5. 2023-01-03 11:26:00, 由 刘瀚泽 指派给 宋宇。
    修改了 指派给，旧值为 "liuhanze"，新值为 "songyu"。
    请帮忙确认下问题
  6. 2023-01-03 18:55:12, 由 宋宇 指派给 刘瀚泽。
    修改了 指派给，旧值为 "songyu"，新值为 "liuhanze"。
    这个服务还是go的服务，并且该服务里面写死了一些配置，这些配置已经不可运行了，因此需要出个需求把服务与接口全部转到dotnet这边来处理
  7. 2023-01-04 09:40:29, 由 刘瀚泽 指派给 马玉莹。
    修改了 指派给，旧值为 "liuhanze"，新值为 "mayuying"。

    这个bug 帮忙转需求处理，给到宋宇组和程伟组 http://pm.zhcxkj.com/zentao/bug-view-33584.html 

    需求内容：

    （1）宋宇组切换获取获取沃尔玛类目的方式，由GO项目转到dotnet(参考allegro/美客多模式)，

    （2）程伟组，智能刊登系统，拆分服务，单独服务部署，同步沃尔玛的类目 （SyncwalmartMarketCategory）

    （3）原服务：SyncMarketplaceProductCategory 拆分出，使用单独的服务同步沃尔玛的类目

  8. 2023-01-04 17:21:52, 由 马玉莹 转为 需求，编号为 #13250 walmart 分类基础数据存在重复类目需去重 。
  9. 2023-01-04 17:21:52, 由 马玉莹 关闭。
  10. 2023-11-17 09:46:02, 由 刘超 编辑。
    修改了 所属模块，旧值为 "1733"，新值为 "1872"。
返回
所属项目 技术中心-需求池
所属模块 多平台   walmart
所属计划
所属迭代
Bug类型
严重程度 提示
优先级 P2
Bug状态 已关闭
业务部门
影响功能
开发责任人 程伟
测试责任人 李乐同
解决时效 0
激活次数 0
激活日期
是否确认 否
当前指派 Closed 于 2023-01-04 17:21:52
截止日期 0000-00-00
上线时间
上线时效
操作系统
浏览器
关键词
抄送给
所属迭代
相关需求
相关任务
由谁创建 刘瀚泽 于 2022-12-29 14:59:48
影响环境 测试环境-测试反馈
由谁解决 马玉莹 于 2023-01-04 17:21:52
解决版本
解决方案 tostory
由谁关闭 马玉莹 于 2023-01-04 17:21:52
最后修改 刘超 于 2023-11-17 09:46:01