我正在以1000个批量索引大数据 . 我有100000个文档 . 在中间,如果我直接从弹性搜索中删除索引(来自:http://localhost:9200/_plugin/head/),它将重新创建索引并索引新文档,以便丢失旧文档 . 如果索引不存在,我需要通过错误 . 下面是两条记录的json查询(实际为1000条)
{ "index" : {"_index":"1020","_type":"PROGRAMS","_id":"3149012","_routing":"PROGRAMS"} }
{
"OBJID": 3149015,
"MAINTITLE": "SPEAR TALK",
"A_S_DESC": null,
"A_S_ORIG_NA": "PFT",
"EPISODE_NAME": "DEMOPROG",
"A_S_DURATION": null,
"A_S_EP_NU": "111",
"A_S_EP_NA": "DEMOPROG",
"S_SOM": "10:00:00:00",
"S_FRAMERAT": 25,
"A_S_QUALITY": "HD",
"A_S_TX_TIME": "150200",
"A_S_TX_DATE": "20150228",
"TX_DATE_TIME": "20150228150200",
"REGISTRATION": "20150228",
"REGISTRATIO2": "150240",
"REGISTRATION_DATE_TIME": "20150228150240",
"CreatedOn": "2015-02-28T15:02:40",
"A_S_VERSION": "MIX",
"SUG_MAINTITLE": "DEMO PROGRAM 1 EP 111",
"A_DISPLAY_NA": "DEMO PROGRAM 1",
"channel": "DEMO-CHANNEL1",
"CHANNEL_DISPLAY_NA": "DEMO CHANNEL 1",
"IS_ARCHIVED": "NOT ARCHIVED",
"IS_TXRC": "TX",
"OBJECTCLASS": "PROGRAMS",
"SUB_OBJECTCLASS_FACET": "Assets",
"OBJECTCLASS_FACET": "Programs",
"kxjrt94fbr": "kxjrt94fbr",
"SortOrderValue": "1",
"VideoURL": null,
"ThumbURL": null,
"GENRE": null,
"S_ArchivedInstanceInfo": null,
"searchColumn": "SPEAR TALK DEMOPROG DEMO PROGRAM 1",
"RowNum": 2
}
{ "index" : {"_index":"1020","_type":"PROGRAMS","_id":"3149015","_routing":"PROGRAMS"} }
{
"OBJID": 3149015,
"MAINTITLE": "SPEAR TALK",
"A_S_DESC": null,
"A_S_ORIG_NA": "PFT",
"EPISODE_NAME": "DEMOPROG",
"A_S_DURATION": null,
"A_S_EP_NU": "111",
"A_S_EP_NA": "DEMOPROG",
"S_SOM": "10:00:00:00",
"S_FRAMERAT": 25,
"A_S_QUALITY": "HD",
"A_S_TX_TIME": "150200",
"A_S_TX_DATE": "20150228",
"TX_DATE_TIME": "20150228150200",
"REGISTRATION": "20150228",
"REGISTRATIO2": "150240",
"REGISTRATION_DATE_TIME": "20150228150240",
"CreatedOn": "2015-02-28T15:02:40",
"A_S_VERSION": "MIX",
"SUG_MAINTITLE": "DEMO PROGRAM 1 EP 111",
"A_DISPLAY_NA": "DEMO PROGRAM 1",
"channel": "DEMO-CHANNEL1",
"CHANNEL_DISPLAY_NA": "DEMO CHANNEL 1",
"IS_ARCHIVED": "NOT ARCHIVED",
"IS_TXRC": "TX",
"OBJECTCLASS": "PROGRAMS",
"SUB_OBJECTCLASS_FACET": "Assets",
"OBJECTCLASS_FACET": "Programs",
"kxjrt94fbr": "kxjrt94fbr",
"SortOrderValue": "1",
"VideoURL": null,
"ThumbURL": null,
"GENRE": null,
"S_ArchivedInstanceInfo": null,
"searchColumn": "SPEAR TALK DEMOPROG DEMO PROGRAM 1",
"RowNum": 2
}
接下来的1000批次将以相同的方式编入索引 . 我是否需要检查索引是否存在?或者有没有办法从ElasticSearch了解?
1 回答
Elasticsearch将根据对象的结构自动创建索引,但请记住,任何自定义字段设置都不能以这种方式维护 .
如果要检查索引是否存在,请使用:
或者等同于您使用的客户 .
如果要停止自动创建索引,请将其添加到config / elasticsearch.yml:
可以在这里找到:Automatic index creation