首页 文章

在索引大数据时,如果我删除索引ElasticSearch再次创建索引并索引文档而不是给索引不存在

提问于
浏览
0

我正在以1000个批量索引大数据 . 我有100000个文档 . 在中间,如果我直接从弹性搜索中删除索引(来自:http://localhost:9200/_plugin/head/),它将重新创建索引并索引新文档,以便丢失旧文档 . 如果索引不存在,我需要通过错误 . 下面是两条记录的json查询(实际为1000条)

{ "index" :  {"_index":"1020","_type":"PROGRAMS","_id":"3149012","_routing":"PROGRAMS"} }
{
  "OBJID": 3149015,
  "MAINTITLE": "SPEAR TALK",
  "A_S_DESC": null,
  "A_S_ORIG_NA": "PFT",
  "EPISODE_NAME": "DEMOPROG",
  "A_S_DURATION": null,
  "A_S_EP_NU": "111",
  "A_S_EP_NA": "DEMOPROG",
  "S_SOM": "10:00:00:00",
  "S_FRAMERAT": 25,
  "A_S_QUALITY": "HD",
  "A_S_TX_TIME": "150200",
  "A_S_TX_DATE": "20150228",
  "TX_DATE_TIME": "20150228150200",
  "REGISTRATION": "20150228",
  "REGISTRATIO2": "150240",
  "REGISTRATION_DATE_TIME": "20150228150240",
  "CreatedOn": "2015-02-28T15:02:40",
  "A_S_VERSION": "MIX",
  "SUG_MAINTITLE": "DEMO PROGRAM 1 EP 111",
  "A_DISPLAY_NA": "DEMO PROGRAM 1",
  "channel": "DEMO-CHANNEL1",
  "CHANNEL_DISPLAY_NA": "DEMO CHANNEL 1",
  "IS_ARCHIVED": "NOT ARCHIVED",
  "IS_TXRC": "TX",
  "OBJECTCLASS": "PROGRAMS",
  "SUB_OBJECTCLASS_FACET": "Assets",
  "OBJECTCLASS_FACET": "Programs",
  "kxjrt94fbr": "kxjrt94fbr",
  "SortOrderValue": "1",
  "VideoURL": null,
  "ThumbURL": null,
  "GENRE": null,
  "S_ArchivedInstanceInfo": null,
  "searchColumn": "SPEAR TALK DEMOPROG DEMO PROGRAM 1",
  "RowNum": 2
}
{ "index" :  {"_index":"1020","_type":"PROGRAMS","_id":"3149015","_routing":"PROGRAMS"} }
{
  "OBJID": 3149015,
  "MAINTITLE": "SPEAR TALK",
  "A_S_DESC": null,
  "A_S_ORIG_NA": "PFT",
  "EPISODE_NAME": "DEMOPROG",
  "A_S_DURATION": null,
  "A_S_EP_NU": "111",
  "A_S_EP_NA": "DEMOPROG",
  "S_SOM": "10:00:00:00",
  "S_FRAMERAT": 25,
  "A_S_QUALITY": "HD",
  "A_S_TX_TIME": "150200",
  "A_S_TX_DATE": "20150228",
  "TX_DATE_TIME": "20150228150200",
  "REGISTRATION": "20150228",
  "REGISTRATIO2": "150240",
  "REGISTRATION_DATE_TIME": "20150228150240",
  "CreatedOn": "2015-02-28T15:02:40",
  "A_S_VERSION": "MIX",
  "SUG_MAINTITLE": "DEMO PROGRAM 1 EP 111",
  "A_DISPLAY_NA": "DEMO PROGRAM 1",
  "channel": "DEMO-CHANNEL1",
  "CHANNEL_DISPLAY_NA": "DEMO CHANNEL 1",
  "IS_ARCHIVED": "NOT ARCHIVED",
  "IS_TXRC": "TX",
  "OBJECTCLASS": "PROGRAMS",
  "SUB_OBJECTCLASS_FACET": "Assets",
  "OBJECTCLASS_FACET": "Programs",
  "kxjrt94fbr": "kxjrt94fbr",
  "SortOrderValue": "1",
  "VideoURL": null,
  "ThumbURL": null,
  "GENRE": null,
  "S_ArchivedInstanceInfo": null,
  "searchColumn": "SPEAR TALK DEMOPROG DEMO PROGRAM 1",
  "RowNum": 2
}

接下来的1000批次将以相同的方式编入索引 . 我是否需要检查索引是否存在?或者有没有办法从ElasticSearch了解?

1 回答

  • 1

    Elasticsearch将根据对象的结构自动创建索引,但请记住,任何自定义字段设置都不能以这种方式维护 .

    如果要检查索引是否存在,请使用:

    curl -XHEAD -i 'http://localhost:9200/your_index'
    

    或者等同于您使用的客户 .

    如果要停止自动创建索引,请将其添加到config / elasticsearch.yml:

    action.auto_create_index: false
    

    可以在这里找到:Automatic index creation

相关问题