DEV Community

Mallikarjun H T
Mallikarjun H T

Posted on • Updated on

Bulk insert data to ES

#elasticsearch #automation #elasticdump

Elastic Search Version 6.2 is used for this example

Elasticdump

take index mappings dump to json 

/usr/bin/elasticdump \
  --type=mapping \
  --input=http://localhost:9200/index_mame \
  --output "/file/to/write/index_name.mapping.json"
Enter fullscreen mode Exit fullscreen mode

take index data dump to json 

/usr/bin/elasticdump \
  --type=data \
  --concurrency=100 \
  --intervalCap=500 \
  --input=http://localhost:9200/index_mame \
  --output "/file/to/write/index_name.data.json"
Enter fullscreen mode Exit fullscreen mode

create index with mappings 

/usr/bin/elasticdump \
 --type=mapping \
  --input "/path/to/maping-file.mapping.json"  \
  --output=http://localhost:9200/index_name
Enter fullscreen mode Exit fullscreen mode

restore data from other index 

/usr/bin/elasticdump \
  --type=data \
  --concurrency=100 \
  --intervalCap=500 \
  --input "/file/to/data-dump.data.json"  \
  --output=http://localhost:9200/index_name
Enter fullscreen mode Exit fullscreen mode

_source only backup 

/usr/bin/elasticdump \
  --type=data \
  --concurrency=100 \
  --intervalCap=500 \
  --sourceOnly=true \
  --input=http://localhost:9200/index_name \
  --output "/file/to/data-dump.data.json"
Enter fullscreen mode Exit fullscreen mode

_bulk API 

curl -XPOST localhost:9200/index_name/Document_Type/_bulk -H 'Content-Type: application/json' --data-binary @/path/to/file
Enter fullscreen mode Exit fullscreen mode

Top comments (0)

Read next

nonso01 profile image

How to take selfies with Javascript 😽📸

Nonso Martin -

paulund profile image

Laravel Log DB Queries

Paulund -

allenchrios profile image

From Concept to Click: The Journey of Mobile App Making

allenchr -

drrich profile image

Boomi Community Post

Richard -