1
0
mirror of https://github.com/nxshock/zkv.git synced 2024-11-27 11:21:02 +05:00

Add notes about current store state

This commit is contained in:
nxshock 2022-12-11 21:33:51 +05:00
parent 5f0d33828f
commit d950b6546c

View File

@ -4,17 +4,17 @@ Simple key-value store for single-user applications.
## Pros ## Pros
* Simple one file structure * Simple two file structure (data file and index file)
* Internal Zstandard compression by [klauspost/compress/zstd](https://github.com/klauspost/compress/tree/master/zstd) * Internal Zstandard compression by [klauspost/compress/zstd](https://github.com/klauspost/compress/tree/master/zstd)
* Threadsafe operations through `sync.RWMutex` * Threadsafe operations through `sync.RWMutex`
## Cons ## Cons
* Index stored in memory (`map[key hash (28 bytes)]file offset (int64)`) * Index stored in memory (`map[key hash (28 bytes)]file offset (int64)`)
* Need to read the whole file on store open to create file index (you can use index file options to avoid this) * No transaction system
* Index file is fully rewrited on every store commit
* No way to recover disk space from deleted records * No way to recover disk space from deleted records
* Write/Delete operations block Read and each other operations * Write/Delete operations block Read and each other operations
* Need to decode whole file until stored value
## Usage ## Usage
@ -63,9 +63,6 @@ type Options struct {
// Disk write buffer size in bytes // Disk write buffer size in bytes
DiskBufferSize int DiskBufferSize int
// Use index file
UseIndexFile bool
} }
``` ```
@ -87,6 +84,17 @@ File is log stuctured list of commands:
| Length | Record body bytes length | int64 | | Length | Record body bytes length | int64 |
| Body | Gob-encoded record | variable | | Body | Gob-encoded record | variable |
Index file is simple gob-encoded map:
```go
map[string]struct {
BlockOffset int64
RecordOffset int64
}
```
where map key is data key hash and value - data offset in data file.
## Resource consumption ## Resource consumption
Store requirements: Store requirements:
@ -97,4 +105,4 @@ Store requirements:
## TODO ## TODO
- [ ] Add recovery previous state of store file on write error - [ ] Add recovery previous state of store file on write error
- [ ] Add fast file seek to value (add compressed block start position) - [ ] Add method for index rebuild