mirror of
https://github.com/nxshock/zkv.git
synced 2024-11-27 11:21:02 +05:00
Add notes about current store state
This commit is contained in:
parent
5f0d33828f
commit
d950b6546c
22
README.md
22
README.md
@ -4,17 +4,17 @@ Simple key-value store for single-user applications.
|
|||||||
|
|
||||||
## Pros
|
## Pros
|
||||||
|
|
||||||
* Simple one file structure
|
* Simple two file structure (data file and index file)
|
||||||
* Internal Zstandard compression by [klauspost/compress/zstd](https://github.com/klauspost/compress/tree/master/zstd)
|
* Internal Zstandard compression by [klauspost/compress/zstd](https://github.com/klauspost/compress/tree/master/zstd)
|
||||||
* Threadsafe operations through `sync.RWMutex`
|
* Threadsafe operations through `sync.RWMutex`
|
||||||
|
|
||||||
## Cons
|
## Cons
|
||||||
|
|
||||||
* Index stored in memory (`map[key hash (28 bytes)]file offset (int64)`)
|
* Index stored in memory (`map[key hash (28 bytes)]file offset (int64)`)
|
||||||
* Need to read the whole file on store open to create file index (you can use index file options to avoid this)
|
* No transaction system
|
||||||
|
* Index file is fully rewrited on every store commit
|
||||||
* No way to recover disk space from deleted records
|
* No way to recover disk space from deleted records
|
||||||
* Write/Delete operations block Read and each other operations
|
* Write/Delete operations block Read and each other operations
|
||||||
* Need to decode whole file until stored value
|
|
||||||
|
|
||||||
## Usage
|
## Usage
|
||||||
|
|
||||||
@ -63,9 +63,6 @@ type Options struct {
|
|||||||
|
|
||||||
// Disk write buffer size in bytes
|
// Disk write buffer size in bytes
|
||||||
DiskBufferSize int
|
DiskBufferSize int
|
||||||
|
|
||||||
// Use index file
|
|
||||||
UseIndexFile bool
|
|
||||||
}
|
}
|
||||||
|
|
||||||
```
|
```
|
||||||
@ -87,6 +84,17 @@ File is log stuctured list of commands:
|
|||||||
| Length | Record body bytes length | int64 |
|
| Length | Record body bytes length | int64 |
|
||||||
| Body | Gob-encoded record | variable |
|
| Body | Gob-encoded record | variable |
|
||||||
|
|
||||||
|
Index file is simple gob-encoded map:
|
||||||
|
|
||||||
|
```go
|
||||||
|
map[string]struct {
|
||||||
|
BlockOffset int64
|
||||||
|
RecordOffset int64
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
where map key is data key hash and value - data offset in data file.
|
||||||
|
|
||||||
## Resource consumption
|
## Resource consumption
|
||||||
|
|
||||||
Store requirements:
|
Store requirements:
|
||||||
@ -97,4 +105,4 @@ Store requirements:
|
|||||||
## TODO
|
## TODO
|
||||||
|
|
||||||
- [ ] Add recovery previous state of store file on write error
|
- [ ] Add recovery previous state of store file on write error
|
||||||
- [ ] Add fast file seek to value (add compressed block start position)
|
- [ ] Add method for index rebuild
|
||||||
|
Loading…
Reference in New Issue
Block a user