2022-12-02 21:37:56 +05:00
|
|
|
# zkv
|
|
|
|
|
|
|
|
Simple key-value store for single-user applications.
|
|
|
|
|
|
|
|
## Pros
|
|
|
|
|
2022-12-03 12:41:11 +05:00
|
|
|
* Simple one file structure
|
|
|
|
* Internal Zstandard compression by [klauspost/compress/zstd](https://github.com/klauspost/compress/tree/master/zstd)
|
2022-12-02 21:37:56 +05:00
|
|
|
* Threadsafe operations through `sync.RWMutex`
|
|
|
|
|
|
|
|
## Cons
|
|
|
|
|
|
|
|
* Index stored in memory (`map[key hash (28 bytes)]file offset (int64)`)
|
|
|
|
* Need to read the whole file on store open to create file index
|
|
|
|
* No way to recover disk space from deleted records
|
|
|
|
* Write/Delete operations block Read and each other operations
|
|
|
|
|
|
|
|
## Usage
|
|
|
|
|
|
|
|
Create or open existing file:
|
|
|
|
|
|
|
|
```go
|
|
|
|
db, err := Open("path to file")
|
|
|
|
```
|
|
|
|
|
|
|
|
Data operations:
|
|
|
|
|
|
|
|
```go
|
|
|
|
// Write data
|
|
|
|
err = db.Set(key, value) // key and value can be any of type
|
|
|
|
|
|
|
|
// Read data
|
|
|
|
var value ValueType
|
2022-12-03 20:57:50 +05:00
|
|
|
err = db.Get(key, &value)
|
2022-12-02 21:37:56 +05:00
|
|
|
|
|
|
|
// Delete data
|
|
|
|
err = db.Delete(key)
|
|
|
|
```
|
|
|
|
|
2022-12-03 20:57:50 +05:00
|
|
|
Other methods:
|
|
|
|
|
|
|
|
```go
|
|
|
|
// Flush data to disk
|
|
|
|
err = db.Flush()
|
|
|
|
```
|
|
|
|
|
2022-12-02 21:37:56 +05:00
|
|
|
## File structure
|
|
|
|
|
|
|
|
Record is `encoding/gob` structure:
|
|
|
|
|
|
|
|
| Field | Description | Size |
|
|
|
|
| ---------- | ---------------------------------- | -------- |
|
|
|
|
| Type | Record type | uint8 |
|
|
|
|
| KeyHash | Key hash | 28 bytes |
|
|
|
|
| ValueBytes | Value gob-encoded bytes | variable |
|
|
|
|
|
|
|
|
File is log stuctured list of commands:
|
|
|
|
|
|
|
|
| Field | Description | Size |
|
|
|
|
| -------| ------------------------ | -------- |
|
|
|
|
| Length | Record body bytes length | int64 |
|
|
|
|
| Body | Gob-encoded record | variable |
|
2022-12-03 21:03:27 +05:00
|
|
|
|
|
|
|
## TODO
|
|
|
|
|
|
|
|
- [ ] Implement `Copy()` method to copy store without deleted records
|
|
|
|
- [ ] Test [seekable zstd streams](https://github.com/SaveTheRbtz/zstd-seekable-format-go)
|
|
|
|
- [ ] Implement optional separate index file to speedup store initialization
|