I’m running Nebula Graph database on AWS with the Twitter dataset (3 graph spaces), and each space has a data volume of around 500GB.
I know that the compaction process is quite time-consuming. Can I run compaction for all 3 graph spaces at the same time? I don’t want to get an OOM. I don’t see a caution in their docs, but I still doubt it…
I hope someone with such experience can see this question ASAP. Otherwise I’ll have to explore the unknown.
>Solution :
It is generally not recommended to run compaction for multiple graph spaces at the same time in Nebula Graph. This is because compaction can be a resource-intensive process, and running it concurrently for multiple graph spaces can potentially lead to resource contention and potential out-of-memory (OOM) errors.
Instead, it is generally recommended to run compaction for each graph space individually, and to monitor the resource usage during the compaction process to ensure that it does not exceed the available resources. This will help to minimize the risk of OOM errors and ensure that the compaction process runs smoothly.
If you are concerned about the time required to run compaction for each graph space individually, you may want to consider running the compaction process during periods of lower activity in your database, such as during off-peak hours. This will help to minimize the impact on your database performance and ensure that the compaction process runs efficiently.
I hope this helps!