you can have just one open session

[alm0ra]

I have a problem with that why when it's open by a session it will lock for others.

I want to use that to give the option to use other's concurrent

[alm0ra]

I have a problem with that why when it's open by a session it will lock for others.

I want to use that to give the option to use other's concurrent

Exception: IO error: While lock file: /home/ali/b/test_dict/LOCK: Resource temporarily unavailable

[Congyuwang]

Rocksdb by design cannot be shared across processes, while it may be shared across threads. Given that python is a single threaded language, you might want to use some messaging techniques or queues to orchestrate your multiple processes while utilising a single process for writing to the database.

[Congyuwang]

I don't understand how it works. Currently you seem to be using python dict, which cannot be shared across multiple instances (python processes) too? So how do different instances share your current in-memory k-v store (the kafka_store.py)?

[Congyuwang]

If you need multiple instances of rocksdb, one way is to just name them differently. So that they are multiple independent k-v stores, instead of multiple instances the rocksdb sharing the same files (which does not work).

[alm0ra]

Dear @Congyuwang
Actually the problem is here i cant have multiple instance and need yo have a storage but how manage multiple instances for writing on rocksdict

[alm0ra]

@Congyuwang but name different result different k,v

Imagine 2 instance are 2 different consumer from different service and they want to talk each other like kafka .

[Congyuwang]

No, I don't think we can open (read & write) the same rocksdb database at the same time in multiple Python processes by design.