1. 下载安装包
   StarRocks官方提供了DataX的Writer插件
   下载地址https://github.com/StarRocks/DataX/releases

2. 解压至目录datax/plugin/writer

tar -xzvf starrockswriter.tar.gz

如果在目录datax/plugin/writer 中直接解压，解压后需要把starrockswriter.tar.gz删掉

3. 配置JSON文件
   确保datax/plugin/reader/hivereader目录存在，按照如下模板创建template.json文件

{
    "job": {
        "setting": {
            "speed": {
                 "channel": 1
            },
            "errorLimit": {
                "record": 0,
                "percentage": 0
            }
        },
        "content": [
            {
                "reader": {
                    "name": "hivereader",
                    "parameter": {
                    "username": "XXX",
                    "password": "XXXX",
                    "column": ["id", "column1", "column2", "column3"],
                    "connection": [
                      {
                            "jdbcUrl": ["jdbc:hive2://XXXX"],
                            "table": ["databasename.tablename"]
                      }
                    ],
                    "where": ""
              }
                },
               "writer": {
                    "name": "starrockswriter",
                    "parameter": {
                        "username": "XXXX",
                        "password": "XXXX",
                        "database": "testdb",
                        "table": "tablename",
                        "column": ["id", "column1", "column2", "column3"],
                        "preSql": [],
                        "postSql": [], 
                        "jdbcUrl": "",
                        "loadUrl": ["FE1IP:http_port", "FE2IP:http_port","FE2IP:http_port"],
                        "loadProps": {}
                    }
                }
            }
        ]
    }
}

注意：如果导入的数据与StarRocks表定义的数据类型不匹配，则StarRocks会将数据赋值null。比如如果StarRocks定义字段accounting_date的类型为date，但是如果hive数据为2025-01，类型不匹配，则accounting_date被赋值null

4. 执行脚本

 python datax/bin/datax.py --jvm="-Xms4G -Xmx4G" --loglevel=info datax/job/template.json 

5. 同步结果
   同步成功后会打印如下日志：