Commit Graph
222 Commits
Author SHA1 Message Date
J. Nick KostonandGitHub 4dbc1ed7a7 Add dialect (database engine) and version to recorder system health data (#72339) 2022-05-22 21:29:30 -07:00
9c3f949165 Add live streaming logbook websocket endpoint (#72258)
Co-authored-by: Paulus Schoutsen <paulus@home-assistant.io>
2022-05-22 14:57:54 -05:00
J. Nick KostonandGitHub 1001f9e39a Fix last state in history minimal respones when all the states at the end are skipped (#72203) 2022-05-19 20:58:32 -07:00
Erik MontnemeryandGitHub edd7a3427c Remove support for databases without ROW_NUMBER (#72092) 2022-05-18 21:52:38 -05:00
Erik MontnemeryandGitHub 037f6947d8 Fail recorder setup with unsupported dialect or version (#70888) 2022-05-18 16:52:46 +02:00
J. Nick KostonandGitHub a4c1bcefb9 Tune sqlite based on configured settings (#72016) 2022-05-17 18:12:15 -05:00
J. Nick KostonandGitHub a70e2a33dc Fixing purging legacy rows and improve performance (#71916) 2022-05-15 21:25:07 -07:00
98809675ff Convert history queries to use lambda_stmt (#71870)
Co-authored-by: Paulus Schoutsen <paulus@home-assistant.io>
2022-05-15 10:47:29 -05:00
J. Nick KostonandGitHub 8c2743bb67 Avoid storing last_changed in the database if its the same as last_updated (#71843) 2022-05-14 12:06:31 -07:00
J. Nick KostonandGitHub a8f1dda004 Use ciso8601 for parsing MySQLdb datetimes (#71818)
* Use ciso8601 for parsing MySQLDB datetimes

The default parser is this:

https://github.com/PyMySQL/mysqlclient/blob/5340191feb16b1f99a7b43fe7c74a2f690138cb1/MySQLdb/times.py#L66

* tweak

* tweak

* add coverage for building the MySQLdb connect conv param
2022-05-13 19:26:09 -05:00
J. Nick KostonandGitHub 7ab4960b1e Restore v23 stats migration tests (#71743) 2022-05-12 21:14:02 -04:00
J. Nick KostonandGitHub 1d9fb4bca8 Fix process_datetime_to_timestamp and add test coverage (#71755) 2022-05-12 17:12:50 -07:00
J. Nick KostonandGitHub e2cef55162 Add history/history_during_period websocket endpoint (#71688) 2022-05-11 17:52:22 -05:00
J. Nick KostonandGitHub 222baa53dd Make database access in the eventloop raise an exception (#71547) 2022-05-09 15:22:08 -05:00
J. Nick KostonandGitHub 7c9c0e911a Move do_adhoc_statistics to recorder test helpers (#71544) 2022-05-08 12:45:57 -07:00
J. Nick KostonandGitHub a8aa0e1cca Add Estimated Database Size to the recorder system health (#71463) 2022-05-07 21:02:54 -07:00
eb77f8db85 Complete strict typing for recorder (#71274)
* Complete strict typing for recorder

* update tests

* Update tests/components/recorder/test_migrate.py

Co-authored-by: Martin Hjelmare <marhje52@gmail.com>

* Update tests/components/recorder/test_migrate.py

Co-authored-by: Martin Hjelmare <marhje52@gmail.com>

* Remove the asserts

* remove ignore comments

Co-authored-by: Martin Hjelmare <marhje52@gmail.com>
2022-05-04 12:22:50 -05:00
J. Nick KostonandGitHub 13ce0a7d6a Fix history using pre v25 queries during v26 migration (#71295) 2022-05-04 08:56:50 -07:00
J. Nick KostonandGitHub e30940ef2a Move processing of recorder service call arguments into services.py (#71260) 2022-05-03 13:56:22 -07:00
J. Nick KostonandGitHub e1be6dd34f Move recorder services to services.py (#71249) 2022-05-03 10:38:44 -07:00
J. Nick KostonandGitHub 29bda196b5 Break apart recorder into tasks and core modules (#71222) 2022-05-02 21:53:56 -07:00
J. Nick KostonandGitHub 75026f9fed Separate recorder logic for state_changed and non-state_changed events (#71204) 2022-05-02 17:22:53 -05:00
J. Nick KostonandGitHub 188040b8bb Use lambda_stmt for recorder queries and migrate them to queries module (#71219) 2022-05-02 15:17:21 -07:00
5db014666c Avoid recording state_changed events in the events table (#71165)
* squash

fix mypy

* Update homeassistant/components/recorder/models.py

Co-authored-by: Paulus Schoutsen <paulus@home-assistant.io>

* pass all columns

* fix commented out code

* reduce logbook query complexity

* merge

* comment

Co-authored-by: Paulus Schoutsen <paulus@home-assistant.io>
2022-05-02 02:10:34 -05:00
J. Nick KostonandGitHub c23866e5e5 De-duplicate event data into a new event_data table (#71135) 2022-05-01 21:01:17 -05:00
J. Nick KostonandGitHub ff48720c6a Remove db schema v23 stats migration tests (#71137) 2022-05-01 16:11:11 -07:00
J. Nick KostonandGitHub 66a21e0bc3 Add basic system health data to the recorder (#71086) 2022-04-30 11:10:20 -05:00
J. Nick KostonandGitHub 195811843b Remove get_state and get_states history api calls (#70830) 2022-04-26 16:05:43 -07:00
J. Nick KostonandGitHub 6ce768465f Improve purge performance for non-sqlite databases (#70576) 2022-04-26 13:11:57 -07:00
J. Nick KostonandGitHub 1c4a785fb3 Prevent autoflush from happening during attrs lookup (#70768) 2022-04-26 13:04:58 -07:00
f073f17040 Refactor tracking of the recorder run history (#70456)
Co-authored-by: Erik Montnemery <erik@montnemery.com>
2022-04-26 09:59:43 -10:00
Erik MontnemeryandGitHub 3016b5fbfc Use recorder fixtures and helpers in tests (#70773) 2022-04-26 06:08:00 -10:00
J. Nick KostonandGitHub 89e3a48751 Use database executor in migration test (#70774) 2022-04-26 07:42:28 -07:00
Erik MontnemeryandGitHub d045e8678d Use recorder test fixtures in tests (#70652) 2022-04-25 14:23:52 +02:00
Erik MontnemeryandGitHub 28ebab9c5a Simplify waiting for recorder in tests (#70647) 2022-04-25 12:04:47 +02:00
J. Nick KostonandGitHub 9f11063724 Fix state_changes_during_period bakery caching for limit and descending (#70610) 2022-04-24 21:47:21 -07:00
982e314de6 Use recorder_mock in tests (#70363)
Co-authored-by: Paulus Schoutsen <balloob@gmail.com>
2022-04-22 19:29:44 -10:00
J. Nick KostonandGitHub 3737b58e85 Avoid fetching metadata multiple times during stat compile (#70397) 2022-04-22 00:25:42 -10:00
J. Nick KostonandGitHub 3142a106fc Additional prep work for sqlalchemy 2.0 (#70358) 2022-04-21 12:39:18 -10:00
89807f0d2d Reduce the number of queries needed to compile statistics (#69731)
Co-authored-by: Erik Montnemery <erik@montnemery.com>
2022-04-15 09:13:29 -07:00
J. Nick KostonandGitHub c85387290a Increase recorder queue max backlog to 40k, improve message (#70065) 2022-04-14 11:45:07 -10:00
Erik MontnemeryandGitHub eb3458a3d2 Add MutexPool for recorder tests (#69410)
* Add MutexPool for recorder tests

* Fix get_schema_version

* Update test test_last_run_was_recently_clean

* Update test test_shutdown_before_startup_finishes

* Revert comments in test_write_lock_db

* Make the MutexPool lock a class variable

* Remove stale comment

* Move MutexPool

* Tweak debug prints
2022-04-12 07:41:46 -10:00
72fffde77a Fix spelling of periodic in recorder (#69658)
Co-authored-by: Martin Hjelmare <marhje52@gmail.com>
2022-04-07 23:37:02 -10:00
J. Nick KostonandGitHub 66f0a3816a Reduce memory pressure during database migration (#69628) 2022-04-07 18:29:31 -10:00
Erik MontnemeryandGitHub 949b0e1b65 Don't allow in-memory SQLite database (#69616) 2022-04-08 00:43:09 +02:00
Erik MontnemeryandGitHub 4a7c978f69 Speedup recorder test test_write_lock_db (#69578) 2022-04-07 15:36:58 +02:00
J. Nick KostonandGitHub 5c7c09726a Cleanup recorder history typing (#69408) 2022-04-07 00:09:05 -10:00
J. Nick KostonandGitHub bde3646293 Always use a commit interval of 0 for the in memory db in tests (#69330) 2022-04-05 12:06:06 -10:00
J. Nick KostonandGitHub ec131d685e Auto repack the database on the second sunday of the month (#69314) 2022-04-04 21:39:12 -10:00
J. Nick KostonandGitHub f5a13fc51b Add ability to exclude attributes from being recorded by entity domain (#68824) 2022-03-29 20:13:08 -07:00