{"id":1402,"date":"2024-06-19T11:01:06","date_gmt":"2024-06-19T09:01:06","guid":{"rendered":"https:\/\/www.rocworks.at\/wordpress\/?p=1402"},"modified":"2024-06-19T11:01:52","modified_gmt":"2024-06-19T09:01:52","slug":"questdb-my-time-series-datas-new-best-friend-%f0%9f%93%88","status":"publish","type":"post","link":"https:\/\/www.rocworks.at\/wordpress\/?p=1402","title":{"rendered":"QuestDB: My time series data&#8217;s new best friend? \ud83d\udcc8"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">My first tests with QuestDB on 10 years of home automation data (1.4 billion rows) are promising.<br><br>\ud83d\udc49 Fast ingestion of parquet files (~1 hour on an old Intel NUC i5)<br><br>I have stored my data in parquet files, one per month, and imported it with a simple Python script. The import on my really old Intel NUC i5 took only about one hour. I&#8217;ve never been able to do this so quickly with any other database.<br><br>\ud83e\udd14 Btw.: I think storing data in <a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=parquet&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7208922855575584769\">#parquet<\/a> files, or any other open table format, like Apache <a href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=iceberg&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7208922855575584769\">Iceberg<\/a>, is one of the best choices to keep data. Because it\u2019s independent of a database engine.<br><br>\ud83d\udc49 Familiar SQL syntax. I experienced that QuestDB has a powerful SQL engine. I converted some Postgres SQL statements to QuestDB without big issues or changes. And I love SQL \ud83d\udc9a<br><br>\ud83d\udc49 Great query response times &#8211; see image. Not a representative query, but still impressive speed.<br><br>\ud83d\udc49 By using ZFS with compression the used disk space can be reduced to a good value.<br><br>Do you want to log your OPCUA data to QuestDB? I have added this option to the <a href=\"http:\/\/automation-gateway.com\/\">automation-gateway.com<\/a> seven days ago.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/www.rocworks.at\/wordpress\/wp-content\/uploads\/2024\/06\/Bildschirmfoto-2024-06-18-um-21.29.04.png\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"575\" src=\"https:\/\/www.rocworks.at\/wordpress\/wp-content\/uploads\/2024\/06\/Bildschirmfoto-2024-06-18-um-21.29.04-1024x575.png\" alt=\"\" class=\"wp-image-1404\" srcset=\"https:\/\/www.rocworks.at\/wordpress\/wp-content\/uploads\/2024\/06\/Bildschirmfoto-2024-06-18-um-21.29.04-1024x575.png 1024w, https:\/\/www.rocworks.at\/wordpress\/wp-content\/uploads\/2024\/06\/Bildschirmfoto-2024-06-18-um-21.29.04-300x168.png 300w, https:\/\/www.rocworks.at\/wordpress\/wp-content\/uploads\/2024\/06\/Bildschirmfoto-2024-06-18-um-21.29.04-768x431.png 768w, https:\/\/www.rocworks.at\/wordpress\/wp-content\/uploads\/2024\/06\/Bildschirmfoto-2024-06-18-um-21.29.04-1536x862.png 1536w, https:\/\/www.rocworks.at\/wordpress\/wp-content\/uploads\/2024\/06\/Bildschirmfoto-2024-06-18-um-21.29.04.png 1783w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>My first tests with QuestDB on 10 years of home automation data (1.4 billion rows) are promising. \ud83d\udc49 Fast ingestion of parquet files (~1 hour on an old Intel NUC i5) I have stored my data in parquet files, one &hellip; <a href=\"https:\/\/www.rocworks.at\/wordpress\/?p=1402\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1,29,39],"tags":[],"class_list":["post-1402","post","type-post","status-publish","format-standard","hentry","category-allgemein","category-bigdatanosql","category-frankenstein"],"_links":{"self":[{"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/1402","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1402"}],"version-history":[{"count":3,"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/1402\/revisions"}],"predecessor-version":[{"id":1406,"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/1402\/revisions\/1406"}],"wp:attachment":[{"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1402"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1402"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rocworks.at\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1402"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}