Remove snapshot/backup from elasticsearch

Question

0.00/5 (No votes)

See more:

I snapshot all my indexes on 2019-01-01 snapshot name: S1

Then, I snapshot all my indexes on 2019-01-02 snapshot name: S2, since there is nothing changed on 2019-01-02, so i assume S2 contains no record.

If i remove S1 via elasticsearch api, so i think i cannot restore my data from S2.

is my assumption correct?

so if i have a back up plan, which back up my data every day. I cannot lose any of these back up files, otherwise i can restore my data up to date.

is that correct?

What I have tried:

how is the best way to make the back up plan?

Posted 28-May-19 21:02pm

855

Updated 29-May-19 21:55pm

Richard MacCutchan

v3

Add a Solution

Comments

Richard MacCutchan 30-May-19 3:56am

"[Please delete this question]"
Please do not replace the question title with a request for it to be deleted. This is a public forum and questions, and their answers, are kept here, so they may be of help to other developers who may have similar issues.

2 solutions

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

phil.o · Answer 1 · 2019-05-28T21:58:00

Solution 1

On Snapshot and Restore | Elasticsearch Reference[^] is clearly stated:

The index snapshot process is incremental.

It means that, yes, you need previous snapshots to be able to restore indices, since what is saved in the snapshot is only what have changed since last snapshot.

Posted 28-May-19 21:58pm

phil.o

Comments

855 29-May-19 4:57am

what is the best way to schedule back up plan. keep all the back up files and never clear up?

phil.o 29-May-19 5:09am

Having read the article I mentioned in the link, I don't think you have much choice, anyway.

Mohammadreza Sahelgozin · Answer 2 · 2022-06-28T00:59:00

You can delete older snapshots to free up your space as well as decreasing number of snapshots that may cause performance issues and increasing amount of RAM usage for master node to handle large number of snapshots.
You can delete snapshots manually by delete snapshot API:

Delete snapshot API | Elasticsearch Guide [8.2] | Elastic[^]

Also you can use retention configuration of Elasticsearch SLM tool to delete older snapshots taken by SLM, when number of snapshots or age of snapshots exceed your defined threshold:

Create a snapshot | Elasticsearch Guide [8.2] | Elastic[^]

and

Create or update snapshot lifecycle policy API | Elasticsearch Guide [8.2] | Elastic[^]

These deletions of older snapshots do not affect restore process of newer snapshots. Because, when you delete a snapshot (manually or by SLM retention), only those segments that are kept in that snapshot will be deleted and other segments that are pointed by another snapshots remain. Refer to the Elasticsearch Documentation:
"Each snapshot is also logically independent. When you delete a snapshot, Elasticsearch only deletes the segments used exclusively by that snapshot. Elasticsearch doesn’t delete segments used by other snapshots in the repository."

Reference:
Snapshot and restore | Elasticsearch Guide [8.2] | Elastic[^]