Commit Graph
116 Commits
Author SHA1 Message Date
Kyle AltendorfandGitHub ed4c5bfaca store merkle, key, and value blobs in files (#19528)
* store merkle, key, and value blobs in files

* update expected columns

* fixup tests

* more

* cleanup disk

* better wrapped path identification

* todos for potential filesystem locking

* suppress not precheck

* handle not-present new path configuration entries

* log exception

* replace hard coded 32

* three layers of directories for bytes paths
2025-04-25 11:56:59 -04:00
Kyle Altendorf f1796ccb6a remove python merkle blob code 2025-03-06 13:17:39 -05:00
+1
Kyle AltendorfGitHubwjblankeAmine KhaldiArvid Norbergdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>Earle LoweEarle Lowegithub-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>ChiaAutomationZachary Brown
85c47c6649 catchup: into long_lived/datalayer_merkle_blob from main @ 329ce24c89 (#19351)
* update pin to chia-blockchain-gui (#19292)

* Update the anchor against the checkpoint.

* mypy annotation for `test_dos.py` (#19036)

* remove unused function, get_block_path()

* add type annotation to test_dos.py

* use chia_rs directly for foliage (#19308)

* use chia_rs directly for weight proof (#19315)

* build(deps): bump ruff from 0.8.5 to 0.9.6 (#19260)

* build(deps): bump ruff from 0.8.5 to 0.9.6

Bumps [ruff](https://github.com/astral-sh/ruff) from 0.8.5 to 0.9.6.
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ruff/compare/0.8.5...0.9.6)

---
updated-dependencies:
- dependency-name: ruff
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update source to ruff 0.9.6

* Apply suggestions from code review

Co-authored-by: Kyle Altendorf <sda@fstab.net>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Earle Lowe <e.lowe@chia.net>
Co-authored-by: Earle Lowe <30607889+emlowe@users.noreply.github.com>
Co-authored-by: Kyle Altendorf <sda@fstab.net>

* build(deps): bump mypy from 1.14.1 to 1.15.0 (#19319)

* build(deps): bump mypy from 1.14.1 to 1.15.0

Bumps [mypy](https://github.com/python/mypy) from 1.14.1 to 1.15.0.
- [Changelog](https://github.com/python/mypy/blob/master/CHANGELOG.md)
- [Commits](https://github.com/python/mypy/compare/v1.14.1...v1.15.0)

---
updated-dependencies:
- dependency-name: mypy
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* adjust accordingly

* remove another

* and windows

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kyle Altendorf <sda@fstab.net>

* build(deps): bump pyinstaller from 6.11.1 to 6.12.0 (#19318)

Bumps [pyinstaller](https://github.com/pyinstaller/pyinstaller) from 6.11.1 to 6.12.0.
- [Release notes](https://github.com/pyinstaller/pyinstaller/releases)
- [Changelog](https://github.com/pyinstaller/pyinstaller/blob/develop/doc/CHANGES.rst)
- [Commits](https://github.com/pyinstaller/pyinstaller/compare/v6.11.1...v6.12.0)

---
updated-dependencies:
- dependency-name: pyinstaller
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* use chia_rs directly for sized bytes (#19326)

* build(deps): bump keyring from 25.5.0 to 25.6.0 (#19150)

Bumps [keyring](https://github.com/jaraco/keyring) from 25.5.0 to 25.6.0.
- [Release notes](https://github.com/jaraco/keyring/releases)
- [Changelog](https://github.com/jaraco/keyring/blob/main/NEWS.rst)
- [Commits](https://github.com/jaraco/keyring/compare/v25.5.0...v25.6.0)

---
updated-dependencies:
- dependency-name: keyring
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump filelock from 3.16.1 to 3.17.0 (#19164)

Bumps [filelock](https://github.com/tox-dev/py-filelock) from 3.16.1 to 3.17.0.
- [Release notes](https://github.com/tox-dev/py-filelock/releases)
- [Changelog](https://github.com/tox-dev/filelock/blob/main/docs/changelog.rst)
- [Commits](https://github.com/tox-dev/py-filelock/compare/3.16.1...3.17.0)

---
updated-dependencies:
- dependency-name: filelock
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump pre-commit from 4.0.1 to 4.1.0 (#19166)

Bumps [pre-commit](https://github.com/pre-commit/pre-commit) from 4.0.1 to 4.1.0.
- [Release notes](https://github.com/pre-commit/pre-commit/releases)
- [Changelog](https://github.com/pre-commit/pre-commit/blob/main/CHANGELOG.md)
- [Commits](https://github.com/pre-commit/pre-commit/compare/v4.0.1...v4.1.0)

---
updated-dependencies:
- dependency-name: pre-commit
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump types-setuptools from 75.6.0.20241126 to 75.8.0.20250225 (#19320)

build(deps): bump types-setuptools

Bumps [types-setuptools](https://github.com/python/typeshed) from 75.6.0.20241126 to 75.8.0.20250225.
- [Commits](https://github.com/python/typeshed/commits)

---
updated-dependencies:
- dependency-name: types-setuptools
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* build(deps): bump boto3 from 1.35.90 to 1.37.1 (#19322)

Bumps [boto3](https://github.com/boto/boto3) from 1.35.90 to 1.37.1.
- [Release notes](https://github.com/boto/boto3/releases)
- [Commits](https://github.com/boto/boto3/compare/1.35.90...1.37.1)

---
updated-dependencies:
- dependency-name: boto3
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* use chia_rs directly for pool target (#19332)

* address issue introduced in #19207 (#19328)

address issue introduced in #19207 where empty transaction blocks would not have None transactions_block_generator

* CA Cert updates (#19312)

adding ca updates

Co-authored-by: ChiaAutomation <automation@chia.net>

* bump chia_rs to 0.21.0 (#19337)

* bump chia_rs to 0.21.0

* update mempool tests with the new, stricter, rules

* use chia_rs directly for reward chain block (#19336)

* cache `get_unspent_lineage_info()` (#19335)

* no need to pass get_unspent_lineage_info_from_puzzle_hash function into create_bundle_from_mempool(), we already have it as a member now

* cache results from get_lineage_info_for_puzzle_hash()

* fix

* fixup

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: wjblanke <wjb98672@gmail.com>
Co-authored-by: Amine Khaldi <amine.khaldi@reactos.org>
Co-authored-by: Arvid Norberg <arvid@libtorrent.org>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Earle Lowe <e.lowe@chia.net>
Co-authored-by: Earle Lowe <30607889+emlowe@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: ChiaAutomation <automation@chia.net>
Co-authored-by: Zachary Brown <z.brown@chia.net>
2025-03-05 11:52:01 -05:00
Kyle AltendorfandGitHub 5cf5d576a0 fix MerkleBlob.get_min_height_leaf() (#19340) 2025-03-05 09:30:37 -05:00
Kyle Altendorf 7a6e9b3d12 Merge commit '329ce24c89e29f8c7f0d4a8bb4d04fc2b0438d95' into catchup/long_lived_datalayer_merkle_blob_from_main_329ce24c89e29f8c7f0d4a8bb4d04fc2b0438d95 2025-03-04 16:43:20 -05:00
Kyle AltendorfandGitHub d50b6e0883 use chia_rs directly for sized bytes (#19326) 2025-02-28 09:35:25 -08:00
Kyle AltendorfandGitHub 1567fa3df6 use chia_rs proof of inclusion for datalayer (#19327) 2025-02-27 14:19:38 -05:00
Kyle Altendorf b54c22faf0 Merge commit 'e446d6b726a03f6d917083b4d039abfec503e54e' into catchup/long_lived_datalayer_merkle_blob_from_main_e446d6b726a03f6d917083b4d039abfec503e54e 2025-02-25 11:30:14 -05:00
Kyle AltendorfandGitHub c6d78c38fe use rust datalayer errors for consistency (#19307) 2025-02-25 08:47:09 -05:00
Kyle AltendorfandGitHub a8724f0113 parametrize datalayer proof of inclusion for rust as well (#19281)
* parametrize datalayer proof of inclusion for rust as well

* rs fixup

* update chia_rs
2025-02-18 15:05:04 -05:00
Kyle AltendorfandGitHub 06a1e2523e more datalayer python/rust parametrization (#19269) 2025-02-14 14:19:14 -05:00
Florin Chirica 3336417d0f Remove DL method for get_node_by_hash. 2025-02-14 02:28:19 +02:00
d1b9b2b6a1 Update chia/data_layer/util/merkle_blob.py
Co-authored-by: Kyle Altendorf <sda@fstab.net>
2025-02-14 02:21:33 +02:00
Florin Chirica 6b6da264f4 Don't work on data structures. 2025-02-13 17:29:18 +02:00
Florin ChiricaandGitHub 8219d4f666 Merge branch 'long_lived/datalayer_merkle_blob' into fc.remove_hashes_table 2025-02-13 00:12:02 +02:00
Kyle Altendorf aff2611b37 drop MerkleBlob.get_lineage_by_key_id() 2025-02-07 14:00:50 -05:00
Florin Chirica 186f1ad3e6 Lint. 2025-02-05 16:45:42 +02:00
Florin Chirica 6d9616cd51 Lint. 2025-02-04 19:46:51 +02:00
Florin Chirica a37eaa7c5a Remove DL hashes table 2025-02-04 19:36:59 +02:00
Kyle Altendorf a8cbd24d81 straight int to TreeIndex 2025-02-03 09:03:48 -05:00
Kyle Altendorf adf6e0d181 use chia_rs provided KeyId, ValueId, TreeIndex 2025-01-30 14:23:17 -05:00
Kyle Altendorf 0a682779e3 Merge branch 'long_lived/datalayer_merkle_blob' into streamable_for_merkle_blob_serialization 2025-01-27 10:02:50 -05:00
Kyle Altendorf cfd08e21ca Merge branch 'long_lived/datalayer_merkle_blob' into separate_key_and_value_id_types 2025-01-24 13:44:12 -05:00
Kyle Altendorf c40b977e41 focus 2025-01-24 13:42:42 -05:00
Kyle Altendorf e403fb0378 separate KvID to KeyId and ValueId 2025-01-24 10:43:50 -05:00
Kyle Altendorf 96fd8ecf7c more 2025-01-24 10:01:07 -05:00
Kyle Altendorf 42c5020d1b wip 2025-01-16 13:55:32 -05:00
Kyle Altendorf 7756bef1f5 wip 2025-01-15 11:04:03 -05:00
Kyle Altendorf f201873696 streamable for merkle blob serialization 2025-01-15 10:52:23 -05:00
Florin Chirica 1882ac09ac ruff 2025-01-10 06:07:23 +02:00
Florin Chirica 89580493d9 Ruff. 2025-01-10 05:59:32 +02:00
Florin Chirica 0988c0a267 Move code into merkle blob. 2025-01-10 05:46:49 +02:00
Kyle AltendorfandGitHub 825cd4c18b Optimize DL benchmark. (#18906)
<!-- Merging Requirements:
- Please give your PR a title that is release-note friendly
- In order to be merged, you must add the most appropriate category
Label (Added, Changed, Fixed) to your PR
-->
<!-- Explain why this is an improvement (Does this add missing
functionality, improve performance, or reduce complexity?) -->

### Purpose:

<!-- Does this PR introduce a breaking change? -->

### Current Behavior:

### New Behavior:

<!-- As we aim for complete code coverage, please include details
regarding unit, and regression tests -->

### Testing Notes:

<!-- Attach any visual examples, or supporting evidence (attach any
.gif/video/console output below) -->
2024-11-26 17:34:03 -05:00
450297b71c Apply suggestions from code review
Co-authored-by: Kyle Altendorf <sda@fstab.net>
2024-11-20 21:47:29 +02:00
Florin Chirica 75dfd81633 Optimize DL benchmark. 2024-11-20 00:17:06 +02:00
Kyle Altendorf 67533ed6ac Merge commit '748c8cec8e24c0feabc10e8db22284dc3712180f' into catchup/long_lived_datalayer_merkle_blob_from_main_748c8cec8e24c0feabc10e8db22284dc3712180f 2024-11-18 16:56:19 -05:00
Florin Chirica 094e5cfc26 Lint. 2024-11-14 03:10:51 +02:00
Florin Chirica c3082076ac Address comments. 2024-11-14 03:08:13 +02:00
Florin Chirica 605ceebdca Lint. 2024-11-07 05:13:32 +02:00
Florin Chirica cef14dbe01 Fix bug. 2024-11-07 05:05:52 +02:00
Florin Chirica 72e271da6e Fix tests. 2024-11-05 03:47:26 +02:00
Matt HauffandGitHub 2808ee2446 [CHIA-1681] Replace black with Ruff (#18813)
* Replace black with Ruff

* Change build_network_protocol_files.py
2024-11-04 15:22:18 -07:00
Florin Chirica 7765bbd504 Lint. 2024-10-29 06:01:22 +02:00
Florin ChiricaandGitHub 81083b2176 Merge branch 'long_lived/datalayer_merkle_blob' into fc.dl_integration 2024-10-29 05:20:52 +02:00
Kyle AltendorfandGitHub 2588600d1c more lowercase types such as in comments (#18737) 2024-10-24 11:52:10 -07:00
Kyle AltendorfandGitHub 9eefca78fa catchup: into long_lived/datalayer_merkle_blob from main @ 8c72d22edf (#18756)
Source hash: 8c72d22edf
Remaining commits: 0
2024-10-23 13:53:03 -04:00
Kyle AltendorfandGitHub c23b284126 use signed integers for keys and values (#18753) 2024-10-23 13:13:13 -04:00
Kyle Altendorf 5bba8852b8 pyupgrade 2024-10-23 10:17:55 -04:00
Kyle Altendorf bd69aace4f Merge commit '8c72d22edf0257e53ece9af54801ccc348472933' into catchup/long_lived_datalayer_merkle_blob_from_main_8c72d22edf0257e53ece9af54801ccc348472933 2024-10-23 10:14:34 -04:00
Florin ChiricaandGitHub 63a58da829 Merge branch 'long_lived/datalayer_merkle_blob' into fc.dl_integration 2024-10-21 18:57:19 +03:00