TransWikia.com

Best database to store time-series data in memory on Linux? (Embedded application)

Software Recommendations Asked by user221200 on September 25, 2021

I currently working on a Linux embedded application where I do some logging every second for numeric data (I really just need to plot data on a graph for the last 24 hours of operations).

Since SD cards degrade quickly, I am looking for a database that can store data in memory and only really persist on occasion (maybe on demand?). In this way, I am hoping to prolong the lifespan of the SD card. I came across Graphite, but apparently it cannot store data in memory. Any advice?

2 Answers

Not sure if you have now solved this. I would suggest you read a previous answer I posted here.

One of the possible solutions from the top of my head is H2 Database Engine.

Answered by Z Z on September 25, 2021

Suggest SQLite, with an in-memory option: https://www.sqlite.org/inmemorydb.html

Alternatively, can you just write to files in memory? In Linux this would be https://unix.stackexchange.com/questions/59300/how-to-place-store-a-file-in-memory-on-linux

The idea of a "database" is vague. Defined loosely as "an organized collection of data". A set of files could satisfy this. Persistence could be simply copying files to a permanent store. These files could be csv, or a serialization format like pickle https://graphite.readthedocs.io/en/latest/feeding-carbon.html#the-pickle-protocol

If you require some special access to the data, that might dictate a better fitting solution. For example, do you need to perform SQL queries?

I can load csv files into excel and plot a graph, so that seems like it would work, barring any further information.

Answered by cmonkey on September 25, 2021

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP